While there is certainly some truth to wrong wiring, I think this really only applies to TS's... Who basically know from early on that they were born into the wrong body.
For CD's, I think it's more a question of desire to express oneself as one feels.
There is probably a gray area in between...