Yes, but you have to remember that is how society at large thinks of us. The only way that they can process Crossdresser is to link it with being gay, unfortunately. As I understand, the largest constituency among us is straight males, but what you would likely hear is: "You can't tell me that anyone who wears...". Because of this reaction, it could be that there is a backlash within our community.