Interesting, I think this applies ( applied? ) to me.
Now I have a GF, who makes no bones about how attractive she finds me ( irrespective of how I am dressed ) I am finding my feelings on this subject are changing. i still want to dress in a body conscious way, but i am leaning more towards doing it with more male apparel. IIt helps that I work for a company that allows sporty clothing ( even somewhat encourages it )
I've said before, that I think some CD urges come from the fact that it isn't generally accepted for males to dress in a body displaying fashion. The old joke, "Cycling shorts look more ridiculuous the further you get from the bike" comes to mind.