OK Batty, I'm drawn into this discussion ...
Let me ask you a question: Who decides what sex the clothing is that we "choose to feed the fetish with"?
And following on from that:
Shall I allow these people to project their perceptions of the sex of the clothing onto me, thereby labelling me?
And here are a few more to tickle your brain cells ...
If you had a partner that wears all the feminine clothing that you crave to feed your fetish, and she/he wears them quite freely, of their own choice, thereby satisfying your craving/fetish, would you still have the urge to crossdress?
If not, would you still be transgendered (in your terms, not mine)?