As sad as it is, and I do agree that it is sad, there is a huge difference between your two examples. The percentage of women to the total population (say it is 50%), is much greater than the percentage of TGs, which I'm guessing is between a fraction of 1% and 5% depending on where you get the statistics.
If there were as many GMs wanting to wear women's clothes as there were GGs wanting to wear slacks, society would soon change its attitudes as well. It would have no choice.