This is maybe just semantics, but I think for me it's more like both male and female rather than in between. In fact the androgynous inbetween-ness is not very appealing to me - I like to present myself either as a male or a female, the in between zone is not very comfortable for me to be honest. I still see myself as one person though. Naturally you can't change your body with different appearance, but that's not something you can change so easily, maybe all I am trying to say, is that if I could go further with the change, I would change my body as well ( similar to trans sexual ) but I would not want to do it permanently. So it's not just clothes, it's the law of physics and reality
and a bit of common sense