Yes, a very logical, rational explanation to this fundamentally vexing question. Unfortunately, logic and reason often don't enter into the equation.
Funny, when it comes to "religious freedom" to justify discriminating against us or curtailing our rights - or even the current frenzy around the various already enacted and pending "Bathroom Bills" in the U.S. - our miniscule numbers and the unlikely odds of the average "muggle" ever encountering one of us in the wild seem to carry no weight.
To hear the politicians and their rabid adherents who champion these bills tell it, we are literally the "Barbarians at the Gate", Western civilization as we know it is in peril, and the Apocalypse is sure to follow if TG people are allowed to use the washrooms that conform to their true gender identity.