My guess is you missed the last 100 years or more? Especially the last decade or so where epithets that disparage homosexuals are bandied about among certain peer groups. The saying "that is so gay" isn't a compliment. It is a put down. How do you feel about other groups and what they have been called in the past? It doesn't bother you as much because you are in a group that is "entitled". You don't have to worry about that label when you go for a job. You don't have to worry about that label when you leave a bar. Ha Ha Funny!
Before you start on the "I am a TG and part of a minority" part, you can hide that part and you do. Try being a TG 24/7 even if you are not transitioning. Yes, my ox is gored by all this because I look at what may hurt someone.