In my case, it's not that wearing men's clothing makes me feel less feminine. My problem is that wearing those is associated with pretending to conform to the male gender stereotype.
Whether I am forced to pretend to be "him" or free to express my inner self, I still know that I am a woman trapped in the wrong body.