Almost all women who I know crossdress, matter of fact it is so accepted that they go out in public like that all the time! They see each other shamelessly wearing jeans that were initially designed as only for men. They even wear short sleeve shirts that were made for men to wear. Over the last 50 to 75 years they have even forgotten to feel ashamed about it anymore. All of the women I have dated in my life were always wanting to wear some of my clothes, every girl I have ever been with was a crossdresser. Matter of fact I've even had some girlfriends who I wasn't even intimate with that wanted to wear my shirts sometimes, what a bunch of weirdo's right?

I don't think you have a crossdressing problem, I think you have a problem with personal shame. Sure society will take away your man card if they find out you like to crossdress just like every woman on the planet almost. I doubt your need to crossdress is really that strong though is it? Just do it every now and again if need be and close the blinds. Heck, Cary Grant almost exclusively wore panties and he was still quite a man.

Don't let societies misguided and completely ignorant views on some topics make you feel bad about yourself.