The 44-year-old admitted he felt let down by Amir, 31, after believing they had formed a friendship during their time in the jungle.
The comedian called the father-of-one out for “lying” after seeing clips from the show when he left Australia.
Speaking about watching the footage back, Iain said: “The one that disappointed me the most was Amir because I thought Amir and I got quite close.
“We were talking about going to Pakistan and stuff together,” he said, during an appearance on today’s Loose Women.
“Then I kind of saw some stuff afterwards where he was actually lying about me, so I was disappointed by that.”
However, the father-of-two vehemently denied he was bullied while appearing on the show, saying: “When I came out and there were all these stories of bullying, I don’t class it as bullying.
“People being slightly mean to me behind my back, I don’t call that bullying.”
Despite this, he said he was annoyed that some of the celebrities had accused him of playing a game, adding: “I was really disappointed that people had been saying things behind my back about a ‘game plan’ and that I wasn’t trying hard enough.
“But when you’re in there you do go a bit nuts. Everyone’s hungry. You get so bored. You can have days of doing nothing.”
Meanwhile, Iain revealed that he frequently speaks to Rebekah Vardy and Dennis Wise, despite them both being accused of bullying him.
“I have spoken to Becky since, I’ve been speaking to Becky a lot on WhatsApp. I’ve been speaking to Dennis too.”
Loose Women continues tomorrow on ITV at 12:30pm.