Jumping in late here...
Maybe I'm reading too much into this, but do you think your wife allows/encourages your crossdressing so you are less likely to want sex? If CD'ing relaxes you and makes you feel good, maybe you won't feel so much pressure for sex?