Wow - I think you need to understand there is a tremendous difference between anxiety and obscure phobias, Eryn. Many people with very common mental illnesses struggle just to get thru every day, and it may not be easy to simply think they can develop coping strategies.
And if you are a 6 ft 2 inch crossdresser, you may not be perceived as a tall woman in the bathroom but more likely a man in a dress in a bathroom. You probably would not push anyone over the brink, but you might upset them. And you would never know.
I am not suggesting that you give up your rights, and not protect yourself, but there is certainly some care and sensitivity that we, perhaps more than others, should display.