Here in Vegas we have two very active drag performers. One is called Norma Lee Aman (normally a man) and the another Felinda Bush ( fell in the bush) both have beards. Also there are other cross dressers around with beards. So don't feel like you would be the only one.

Now at the very least cross dressing puts you into a gender non conforming role. If you are not conforming to one then why sorry about conforming to the other? To me it seams rediculous to set rules for those bending or breaking the rules already. Don't worry about what others tell you and do your own thing. If you weren't ok with that you probably wouldn't be cross dressing.