In my headcanon, right after he was sent back, Rory tried to search for the others, then he realised and sat down in confusion. Amy found him then.
I love those two and I miss them too x
This is my favorite thing in the history of ever.
Kids, stop lying to your parents.