As we can see from the resistance to gays serving in the military and the need for equal protection laws (in the USA), there are a lot of people who "care". I don't think they should and you don't, but they do. And that's just in civilized countries. There are countries in the mid east where you would be stoned to death for dressing as a female.