I've had two times I would consider a "challenge" to my appearance. The first time was in a mall a couple of years ago, a group of preteen boys asked me if I was a man. I ignored them and walked on. At the time I don't blame them, I had a beard shadow that would shame Fred Flintstone. It was late in my day and I saw it was becoming obvious thru the makeup.
Removing my beard didn't stop the second challenge. I was in a bakery on morning and my voice would just not get into a higher range. The teenage girl behind the counter figured me out and would loudly say 'sir' every chance she could. Luckily her boss saw the treatment I was getting and took action. I thanked the boss and walked on.