I'm pretty much the same way (except I'm a GM and in pants or a dress I'm still the same guy )
Although, for me a skirt with tights works in winter...
I have heard plenty of GGs say they had to wear dresses or skirts when they were young and that's one reason they don't wear them so much now.
In the end, though, GGs should have as much freedom to wear what they want without snarky or negative comments as we would like to have.