Deputy Prime Minister John Prescott has warned that the debate about the wearing of the veil by Muslim women could damage community relations.
Mr Prescott said that Jack Straw, the Leader of the Commons, had been right to raise the issue, insisting it should not be a "no go area for debate".
But he voiced concern that it could also lead to "considerable difficulties" in terms of community relations.
"I think this debate does open it up - thank goodness Jack has done that," he told BBC One's Sunday AM programme. "But I fear sometimes people might use it in a more prejudiced way and I am concerned it may damage relations rather than improve them. Let's have the debate but the argument can go either way."
Mr Straw sparked outrage in wide sections of the Muslim community last week when he described the veil as a "visible statement of separation". He also disclosed that he asked women wearing a veil to remove it when they visited his constituency surgery in Blackburn as he found it was a barrier to communication.
Mr Prescott revealed that he discussed the issue with Mr Straw earlier this year.
"To be fair to Jack, I talked to him three months ago about this and he expressed that view and I expressed my concern," he said.
He acknowledged that Mr Straw, whose constituency has a large Muslim population was very knowledgeable about the issues.
But Mr Prescott said that he would not follow Mr Straw's example and ask women visiting him to remove their veils.
"I think a woman who wants to wear a veil - why shouldn't she. It is her choice. It is a cultural difference but it is her choice," he said. "If somebody comes into my constituency, whether they are wearing a skull cap or wearing a turban or very dark glasses, I'm not going to ask them to remove it. I think you can communicate with them."
