Don't suppress it - embrace it!
I'm a mature man attracted to a man who cross-dresses as a woman to attract and enhance an interaction with a man. A cross-dresser, I believe, has a need to be on the submissive side of a dominant/assertive - submissive/passive sexual encounter with a man. It allows a male to explore through role-playing as a female that aspect of traditionally femininity normally reserved for genetic females. As a former cross-dresser who is now attracted to those that cross-dress, I have been on both sides of this equation and am speaking from experience.
I stopped fighting 'it' and embraced it as an aspect of my personality that makes me different from others on a planet of over 7 billion people. Not doing 'it' would only suppress the urge, but never extinguish it leading to other mental and physical stress-related issues.