Mr Anderson, the Conservative MP for Ashfield and former deputy party chair, was suspended at the weekend after he refused to apologise for claiming "Islamists" had got "control" over London and that Mr Khan had "given our capital city away to his mates".

Speaking on BBC Radio York, the prime minister denied the Tory party has "Islamophobic tendencies" and said: "Lee's comments weren't acceptable, they were wrong. That's why he's had the whip suspended."

"Words matter, especially in the current environment where tensions are running high. I think it's incumbent on all of us to choose them carefully."

Politics latest: Tories label MP's suspension 'final nail in the party's coffin'

In a fresh statement published by GB News on Monday, Mr Anderson admitted his words were "clumsy" but said they were "borne out of sheer frustration at what is happening to our beautiful capital city".

However, he doubled down on his refusal to apologise, saying: "If you are wrong, apologising is not a sign of weakness but a sign of strength.

"But when you think you are right you should never apologise because to do so would be a sign of weakness."

Mr Sunak's statement to local radio was the first time he has directly addressed the comments made by Mr Anderson, who told GB News last week: "I don't actually believe that the Islamists have got control of our country, but what I do believe is they've got control of Khan and they've got control of London... He's actually given our capital city away to his mates."

His comments sparked condemnation from across the political divide, including from Tory peer Baroness Warsi, who said she was "really disturbed by where the Conservative Party has gone" and that "anti-Muslim racism is being used as an electoral campaign tool".

Mr Sunak said it was "incumbent on all of us, especially those elected to parliament, not to inflame our debates in a way that's harmful to others".

"Words matter, especially in the current environment where tensions are running high and I think it's incumbent on all of us to choose them carefully, he said.

The statement published by GB News was drawn up on Saturday, shortly after he made his provocative comments to the channel.

However, it was not released because of Mr Anderson's refusal to apologise to the London mayor as requested by Tory chief whip Simon Hart.

In the statement Mr Anderson said: "Seeing the words 'From the river to the sea' on Elizabeth Tower made me feel sick to the pit of my stomach."

Repeating his opposition to the mayor, he said: "Khan has stood by and allowed our police to turn a blind eye to the disgusting scenes around parliament.

"It is not my intention to upset anyone, I believe in free speech and have 100% respect for people of all backgrounds.

"The vast majority of Muslims are not Islamists in the same way the vast majority of Christians are not conservatives or socialists.

"My words may have been clumsy but my words were borne out of sheer frustration at what is happening to our beautiful capital city.

"We've got to get Khan out at the elections in May."

Elsewhere in his interview with local radio, Mr Sunak rejected suggestions that his party had a problem with Islamophobia.

The prime minister said it was "not a fair characterisation at all" to argue he had taken a tough stance on antisemitism but had overlooked Islamophobia in his party - saying racism or prejudice "any kind" was "completely unacceptable" and "not British".

This morning a cabinet minister appeared to leave the door open to Mr Anderson regaining the Tory whip, which allows him to sit as a Conservative MP in the Commons.

Asked what Mr Anderson needed to say to be welcomed back, Transport Secretary Mark Harper told Kay Burley on Sky News that he should "reflect on what he said" and "retract those comments and apologise".

"He's contributed a lot in the past. I'd like to see him be able to contribute to the Conservative Party in the future," he said.

Read more:
Lee Anderson row blunts Rishi Sunak's moral authority on racism
MPs set to debate Gaza ceasefire again after Commons chaos

While a number of senior Tories have criticised Mr Anderson for his comments, Mr Harper was the second cabinet minister to refuse to say whether the remarks were "racist".

Yesterday, Mr Dowden backed the decision to suspend the Ashfield MP but refused to say whether he was racist.

Mr Harper's words come as WhatsApp messages leaked to Sky News reveal some Tory MPs regard Mr Anderson's suspension as a mistake.

The WhatsApp forum is called the "109 group" of Tory MPs elected in 2019.

Jill Mortimer, the Conservative MP for Hartlepool, shared messages from constituents saying they would not vote Tory again and that "Lee Anderson's suspension is the final nail in the party's coffin".