Yes, it must be incredibly difficult. I can't imagine how difficult, since people who don't solidly identify with one gender or the other have absolutely no blueprint for this. No role models, no sense of having met others like themselves when they grew up, on top of knowing that society rejects non-binary gender.
I think it takes a great deal of inner strength for bigenders to reach an inner peace and acceptance of who they are, all while trying to fit within society's rules. I don't blame CDers for wanting to look feminine. It's a necessary coping mechanism, I think.
Disclaimer: this doesn't apply to everyone. We all know how varied is this community.