Mostly as I go around town gender-bending (e.g., "a guy in a skirt"), I see strangers... maybe they've seen me around before, but they don't know me at all and mostly they don't care and promptly forget me. There is, of course, the exception of the sales agents at the stores I go to, especially the ones I go to more often -- though some of the ones I go to seldom can name off exactly what I bought the last time I was there (say) 8 months before.
In particular, when I go around gender-bending in public, I very seldom see anyone who knows anything about me, such as my full name, or where I live, or where I work, etc..
However, though one of those statistical oddities, there is one fellow I encounter into every couple of months who does know me from guy mode. He was a security guard for a time where I work, and, uh, his supervisors were told he need not be assigned shifts at our building; the word I got from my contacts is that he was a pathological liar. Certainly some of the things I myself heard him say were rather implausible (though not completely impossible.)
But this one guy... I meet him on the bus from time to time. So he's seen me as "a guy in a skirt" more often than anyone except my social club. And every time he sees me, whether I'm gender-bending or not, he puts on this knowing smirk. It's a put-down without saying a word... and it distinctly conveys an aspect of of "I may only be a security guard, but look how far below me the mighty have fallen!"
Well, I suppose if I'm going to Be Out (go public and open with my dressing), I will need to develop a "thicker skin". I guess I'll know I'm "There" when a smirk from he and his like cease to bother me.