Can you define what "identifying as a woman" means to you here? I'm not sure that I understand having an identity that is contingent on what you're wearing.
I'm not proposing any specific regulations. I would propose that if the entitlement comes purely from safety concerns with men, then we need to address safety concerns with men. Perhaps by providing more gender neutral or single-use spaces, or alternatively by starting to actually do something in society about the pervasive culture of toxic masculinity.