Krisi (#17) makes a good point. I suppose the mind see what it is use to seeing and defaults to its memory. I do not intentionally interact with humans when out. The only times I have interact has been on Halloweens. The interaction ranged from a nice compliment to outright false laughter. He was buying beer in a Safeway grocery store, and, was probably getting a resupply after consuming too much. I thought on both occasions I looked alright, but, it was Halloween. So, if someone identified me as a man wearing a dress as a 'costume,' then I guess I should not have been upset or deflated.
It does pose a question. I can readily understand if a person is transitioning, either way, then the person can feel deflated. My wife's second cousin is transitioning from woman to man, and, he has the look that can go either way due to stature and facial features. I, on the other hand, having no desire to be a woman, but, only wear women's clothing, I have to accept the fact that I am being viewed as a male wearing women's clothing. So, if a viewer sees me for what I truly am, I cannot complain. Those many years ago I was 175 pounds and six foot one without heels. If I had no chance of passing as a woman then, it ain't happening now. If I cannot convince myself I'm not going to convince anyone else.