I prefer to listen to what he has to say anyway. It is very informative, and I also like the way he always has something complimentary to say about the other pros and something encouraging for the celebs, without being smarmy about it. I think he is excellent in this spot.
Perhaps if they were on alternate spots i.e. separately, on different days, that would solve the problem.