If it means anything, I've read many posts in this forum over the years by crossdressers who said they did the same thing. IMO, they were making a subconscious choice that the crossdressing was more important to them than any relationship with a GG ... which makes sense, when you think about it. It's not a pastime or a hobby and they'd rather be alone than risk finding someone who will not accept.
My SO told me at the very beginning of our romantic relationship, right after our first kiss. I've often wondered if s/he would have lost interest in me, had I not been supportive.
... come to think of it, she did set it up like that. She told me in an email and she said, "If this is not your thing, I'll understand and I hope we can still be friends." :p