Because they know he's not a threat to their female winner agenda. They've been right toerags about orchestrating things the way they want this year, it makes a joke of audience participation. I don't think there is an overall grand master plot to get a specific winner, but they know they want a female celeb lifting that trophy this year. Patrick won't challenge it, he doesn't have the fan base or the underdog vote whereas there was always a chance Ashley, with his good looks, youth appeal and consistent undermarking, could have been a threat had he reached the final as the only boy.
Personally I like Patrick, and I like Anya - she's my fave of the new pros - but I know they won't win. Maybe there are others that feel the same defeat and haven't bothered voting? Susanna and Kevin are likely to win, as much as I'd like it to be Abbey, Sophie or even Natalie. It feels like a foregone conclusion at this point. To me, anyway.