Crossdressing resides at a very funky intersection of human existence. We have machismo and we have womanliness (don't know the corresponding Spanish word), we have men who are more like women and women who are more like men. All that is pretty clear because you are either attracted to the oposite sex or the same sex. However, crossdressers represent a whole spectrum of people and attractions. I think people have a difficult time dealing with us they don't know where we fit. I think this is what makes it easy to attempt to dismiss all of us as gay. So, that's one point: it's not obvious to people who we are and where we stand. The other thing is this: remember the line from Shakespeare "Me thinks he doth protesteth too much.". Your doing a bit of veiled crossdressing (crossshoeing?) seems to have struck a nerve. Perhaps if he pointed a finger at you, no one would ever question him. Whatever it is, he feels that he must keep the attention on you rather than himself. Maybe his wife got him to wear a Baby Doll to bed once and he's never gotten over it. Who knows?