Anyone who compares the "rights" of a crossdresser to use a ladies restroom to the struggle of racial minorities for equal opportunity in housing, education, jobs, etc. is seriously insulting the minorities who went through (and in some cases are still going through) that struggle. We are talking about men who dress up as women and go out in public attempting (or not) to pass themselves off as women. We are not women, we are men with penises and testicles. Throwing on a dress and a wig (or not in some cases) does not make us women.
Women expect to have privacy (from men) when they visit the ladies restroom. That's the very reason there are usually separate restrooms for males and females. This sometimes puts us in awkward situations, but we should try to remember that other people have rights, not just us.
Best to find a family or single stall unisex restroom.
