How can the truth be dishonest? Thousands of us visit restrooms every day without incident. Incidents of harassment are few enough that they are discussed individually in detail.
I'm sorry you've had a problem. My social circle, which includes TG folks who have been going out since the '60s, doesn't report any, and we have discussed this issue at length.
Certainly I I'm aware of the possibility and avoid questionable situations, but I'm not going to allow a tiny number of incidents to cause me unfounded fear.