I was a non-CDer for the first fifty plus years of my life. I never had a real "interest" in wearing women's clothes and never considered the possibility of wearing them in public or even regularly in private. But, in those first fifty years, out of curiosity, I tried mascara exactly once and tried on various items of my wife's clothing for minutes at a time. There was no particular interest in continuing the practice because my curiosity was satisfied in the moment. I don't think that's as rare as you seem to think.
The need to posture in public is a very real societally enforced requirement, especially in the teenage years. We tend to internalize the enforcement without question if the cost of being ostracized is high enough. The world I worked in was very rigid in that same enforcement and any variance was only practiced in private.
[SIZE=1]- - - Updated - - -[/SIZE]
This is very true but, as can be seen in so many threads here on the forum, it is our significant others that enforce the rules most emphatically. Even if we, as individuals, reject the norms, those whom we associate can make the cost extravagantly high. Many of our wives do not look at the whole gender issue as you do and I am wondering how much your viewpoint was present before becoming involved with your SO.