Your experience is not uncommon and reading your account of your sexual journey reminded me a lot of my journey. I started cross dressing at a very young age and my sexual exploration up to the age of about 14 was through cross dressing. Then I became interested in girls and thought I was just a hetero cross dresser. In my thirties I had an encounter with another cross dresser but didn't pursue that path for several years before exploring relationships with men while dressed. Those were the most intense relationships for me. I don't know what label to attach and am not concerned about that. If you feel really uncomfortable or stressed over this I would support the suggestion that you seek help from an experienced counsellor. I do mean experienced, so choose carefully.