There are indeed some double standards, but poking on them won't help you.
1.) A lot will deny it. 2.) They are not the reason for rejecting CDing. 3.) Nobody said that the world is or has to be fair.
Make the best out of it and dress fem-casual. Almost nobody will realize that you crossdress. The fem-feeling comes from the mind and not so much from the clothes.
