Ever since he found out his home was lost but not destroyed in the time war it has been burning in the background. Genie out of bottle ,Cat out of bag. Eventually he will have to deal with it. Eventually he will get home. What happens next?. Should ,could he bring his planet ,people, family back into "our" universe/reality?. Always going to be consequences. He was warned about what would happen several times. If Galifrey and the time lords return the time war could reignite plunging the rest of the universe into chaos. Do we really want to be in the cross fire ?.
Tasha Lem warned him she would do anything to stop that happening. Plus Kovarian is still out there maybe she will return too. He would only return for a short time anyway . He is not going to give up traveling all of time and space. Wouldn't that be more upsetting for his family to briefly see him then he is gone again ?. Maybe he should leave Galifrey where it is. However the Doctor being the Doctor he won't. Look forward to seeing where they go next with this storyline. Imagine him giving Clara a tour round some of his old haunts. 

Tasha Lem warned him she would do anything to stop that happening. Plus Kovarian is still out there maybe she will return too. He would only return for a short time anyway . He is not going to give up traveling all of time and space. Wouldn't that be more upsetting for his family to briefly see him then he is gone again ?. Maybe he should leave Galifrey where it is. However the Doctor being the Doctor he won't. Look forward to seeing where they go next with this storyline. Imagine him giving Clara a tour round some of his old haunts. 