The BOTH the configuration and likelihood of problems ARE significant in this discussion. Privacy or lack fit, is THE issue. Privacy defines what is reasonable and what is not.
The outer door is NOT the definition of where the space begins. It is only inside that matters. As I have stated before, a public toilet houses several private spaces. Whether it is has a male symbol or a female symbol on the door. Anyone inside that space can have personal privacy. When I am cross dressed, who am I more likely to offend? And this is a choice I have to make. What LOOKS weirder? I have to make this choice too. I choose to use the private space that offends the least, and looks the least weird. That happens to be what matches my presentation, in either mode.