I personally would never buy an album of someone who I can't stand. When you listen to his 'heartfelt' songs (I haven't listened to any of his albums but presume they have some slow,'sad' songs on there?) do you just listen to his voice and appreciate it or are you thinking all the time "you're such a twat?"
I don't really think about his personality, tbh. Just like when I'm listening to any other artist I'm not sitting thinking about their personalities either.