Does the Doctor remember Rory? Clearly Amy doesn't but i think there was a level of ambiguity to his response, particularly when he said 'are you OK?' towards the end.
Certainly Rory was part of Amy's world but he wasn't part of the Doctors.
Certainly Rory was part of Amy's world but he wasn't part of the Doctors.