My personal experience is very much the opposite of what you've described. I have friends ranging in age from 14 to over 70, including the daughter of the woman who does my nails, many of the other members of a beauty web site, my neighbours, my nieces, the staff and other patrons of the restaurant that my friends and I go to every week and shop staff all over the place. I am personally acquainted with well over 100 people who accept me, fewer than 10 who are neither positive or negative about me (including some who were like that even before they knew about my crossdressing) and none who have actively rejected me. I know at least 200 more people who accept me online who I haven't met yet, and I know of just 3 people online who have actively rejected me.
Things are getting better for us all the time. I see things improving from week to week, month to month and year to year. Not being able to see this says more about the personal fear of the observer than about the society around us.