The right to exist as a human being is not selfish. Its easy to be browbeat into a one sided idea of balance and engage in self-flagellation anytime you have to exist because it doesn't conform to anothers timetable. If children are involved its time to teach them that not everyone is the same and perhaps stop raising more closed-minded individuals.
Crossdressing is no more selfish then being, gay, asian, black, canadian, terminally ill, or short.