I have never used the men's room while out and about.

It's unusual but I have seen women use the men's room, if the queue for the women's room is far too long.

This has tended to happen when a group of women decide they just cant wait any longer.