I know I'm not a man but I wanted to add my two cents on this topic, as it's something I have questioned since I was a teen and have gone from thinking a was straight to maybe I am a lesbian, maybe bi, to this day I am still not 100 on it.
I met my future husband while I was a junior in high school and knew he was a cross dresser before we started dating. In the back of my mind I always questioned if being with a cd is my way of being "straight" while still having a relationship with a "girl. I don't know if I would say I am attracted to him when he is dressed but I do think he looks cute, and I sometimes find my self getting turned on watching him getting dressed.
I also like looking at pictures of cross dressers but I don't know on what level I like it if that makes sense lol. I don't know maybe I am bi or maybe just a straight girl who likes cds.