I think Panos sort of shot himself in the foot by acting as he has up to now. He's made people laugh, he's been entertaining but hasn't really shone at any of the tasks (although his team-mates would do well to remember he secured the deal with Insomnia a few tasks back, no mean feat!) and as a result his contemporaries think he's just there for the fun and don't really rate him, Plus the fact that he wasn't prepared to actually give up his job, just take a break, where the others (claim) they jacked theirs in and so have bet all on this ride, reinforces that belief --- justified or not --- that he is not serious about the job.
That's probably why they're all leery of giving him the PM job, as they think he'll just faff about and then claim the credit if the team wins. However, they really can't be forgiven for not trusting him to lead an ONLINE TASK, for god's sake! Panos needs to push himself more and maybe apply himself to the tasks to show that he has what it takes to lead one, or he's destined to always be the one who is seen as being just there to make up the numbers.