Hi Sherry, I suppose that the average person looking at their feet or smart phones would not notice me. From a peripheral vision point of view, I do not have an appearance that would draw attention, I am only 5'7" and about 150 pounds, and I dress for the venue, time, and my generation. I tend to think men are less observant than women so half the population is easier to walk past.
Still, we are more than our faces to the world. Our body shape is very different from that of a woman's (I don't wear any padding other than forms). Observe the shape of the male head-neck-shoulder. That's a significant difference. And then there is our jaw line and of course, the Adam's apple.
Frankly, I do not think any casual cross dresser can hope for more than passing the glance test. I think many here confuse the fact that people do not saying something with passing. I'll restate that I think people may suspect we are transitioned and not cross dressers. But, here's the litmus test: can you spot the cross dresser?