We compress each other, recursively, and we never internally traverse our own social graphs.
A friend recently asked me how many people I can name. I respond, thousands, and I start with my priests. Along this I had a realization about the compression mechanisms in the brain - you can remember so much, do such a deep search, and you remember so many more people than you're ever cognizant of.