He said, rather loudly, that wasn't funny. I didn't mind him at the end of the series but I thought that was very rude.
He was referring to his own impression suggesting his jokes weren't funny in Andy's defence. Andy's jokes are a million times more funny than this guy.