Comedy is subjective, it doesn't mean he's not funny. I know people who don't find Peter Kay funny.

I didn't find the stand up funny, I can't stand Keith Lemon or James Corden so that puts your theory out the window.

I think he's quite funny when he's just making comments about the other contestants.