Form, function, fashion, trends, and, rights...
Just to add a few things not mentioned so much, so far....
Much of what passes for "men's clothing" is job related - a particular "outfit" for a particular job or occupation. Wearing a welder's bib to weld makes sense for any welder, wearing a three piece Brooks Brothers suit would not. Women, when they were allowed to weld for the war effort, could make it look good - see the posters.
Much of what passes for "men's clothing is life related. To "be a man" is to be ready to compete - be it a footrace (after a purse snatcher), a "wrassling match" (catching a purse snatcher), and to bring the food back to the cave: "Here's your purse. Do you know how we can cook and eat this guy?"
Much of what passes for "menswear" is defensive. A dress doesn't do much to keep the hands off your "junk" and it's too easy for someone to grab the blanket wrapped around your waste to hinder you, throw you off balance, etc. Tight fitting, "slippery" clothes - being less of negative - are a defensive advantage.
Fashion is a presentation of availability for a particular purpose. It could be, "See, I'm a competent banker." It could also be, "Come hither." Fashion, therefore, can be a very tricky thing as non-verbal communication. "No, I'm not a banker; I"m going to a funeral." "No, I'm not looking for a date, I just felt like wearing something fun this evening - go away."
For me, men wearing skirts (only) requires a cost/benefit analysis: "Is it worth the probable hassle that comes with various interpretations people have, or, could have?
Frankly, I think it's easier to crossdress fully as it's generally a more easily understood presentation than a "man-a-taur" wearing a skirt and a suit coat....
There are again, no "fashion police" and no "absolute" rights and wrongs when it comes to clothing. But, there is "being reasonable..."
If you want to wear a skirt, thats up to you, but YOU take what comes with it.
What you do about what comes with it, depends on how much effort you want to put into doing what you're doing.
If you want the "rights," you'll need to gather the votes to have and keep them.
"Unalienable rights" are "just" ideas until put into laws and codes - and the "putting" takes more effort than just talking or writing about it now and then - from your password protected computer, hourly hotel room, or, closet sanctuary.