Women who work very hard to maintain their appearance and look beautiful often see a cross-dresser in a short skirt, heels, and looking fabulous - and are pissed that the guy looks better than they do. I've had several women tell me "I won't date you because you have better legs than I do". Getting those D-cup breast forms may make you look more like a woman, but it will also upset many of those same women, especially if you already have great legs. To them, it's not fair that you - a guy in a dress, have better legs and bigger boobs than they - women who want to be women - have been given by their creator.
Women are also acutely aware that for cross-dressers, it's just a part-time gig, and that can also be a bone of resentment. You, a beautiful cross-dresser, come in to a bar and hustle guys for free drinks and other "perks" - and then you go home and go to work tomorrow in your suit and tie. She may not even notice that you are buying your own drinks.