Because he thought him turning up had ruined her christmas, and that's why he was going to leave, he could see how annoyed/upset she was and that's why he was going to leave, but he didn't say 'I love you' because he didnt think it was the right time maybe, she seeemed upset from it. That just a little bit of me that thinks that, I have wishes and wonders what could happen next