I wouldn't let my grandparents go in the Big Brother house. My two nan's would probably join in the party anyway.
I understand Jim doesn't like the music and the partying but it's not just him their. Fair enough, take yourself off but don't start huffing because you don't like it. It's Big Brother.
However, I am one who doesn't really like to party (I'd actually be one of the younger ones) but if I was in Big Brother, I would understand that they throw parties and as it's meant to be a game/social experiment, I wouldn't get drunk but I would socialise and try to enjoy myself as best as possible as it's a once in a life time opportunity.