I am currently wearing a denim skirt and tights (pantyhose for the US). Both of which I bought from a store that does not state whether they are selling men's or women's clothes.
In my opinion, clothes do not have a gender. So crossdressing is never really possible.
What determines whether pants are for women or men? They are always bifurcated (split into two legs) garments.