If you love it, no harm done. I swing both ways as far as dressing. I have clothing that you will find only in a strip club, little school girl skirts with the white blouse, 6" platform heels, jean skirts that are way too short to be worn in public, pleather skirts and tops, and so on, then I switch up to my 1960's June Cleaver dress, long full skirt, below the knee and high neck line or a formal floor length gown with a sexy slit up the side. I wore the gown while relaxing with my wife last night. I love wearing it with a garter belt and stockings and letting the slit open up while crossing my legs, showing off the stocking tops and garter. My wife has seen me in all of it and can't help but laugh when I get a bit ****ty!
You need to realize you are not hurting anyone. Now on the other hand most people do not understand our desire to dress, so be careful if you take it public. The general public might have a problem with a CD'er dressed like a hooker wandering the streets, but wear clothing to blend in and they might not notice you.