But what was his story??? Where was he going? How was he dressed? What time of day was it?
You still haven't really given any info that can help people give you any insight.
Maybe you work the night shift, and you came home at midnight and he was dressed like a prostitute and headed out to a club to try to hook up with somebody. Or maybe he had some kind of afternoon hookup he found on Craigslist that he was going to meet.
OR
Maybe he just really needed to have some personal dress-up time and was dressed like a normal woman and was just going to go to the mall or maybe just drive around, and you really shouldn't be angry.
One of them is a huge betrayal and you should divorce him, and the other one is totally innocent and you should try to get him to be more open. But who knows which one it is.
If you honestly don't know what he was up to, that's a bad sign.