Ben adored Lexi when she was a baby. We even know that Lola used to take her to visit him in prison. It never made sense that he didn't want to know her when he was released. Some scenes with his daughter would have made him more human, but instead we have a lame love triangle. I think TPTB wanted to lose Ben's soft side.