Andrea, one of the comments you made stood out. It was about the comments you heard when you were not en femme. The vast majority of people have enough sense to not say bad comments to someone's face. But, when the person of whom they are commenting upon is not present, then he or she is filleted with a knife. As a closeted cross dresser, and, one who is comfortable where s/he is, I hear comments all the time about transgenders, African-Americans, Latinos, Roman Catholics, et al. Of course, these people have no clue that all of those and then some more, such as Native-Americans are my family relatives.
I've said it many times before as Andrea has stated there is little or no legal protection in many states. Consider relocating to Washington State. Maybe, if your wife lived in a more accepting environment of alternative lifestyles, she would not fear the consequences that may befall you and her, when, not if, the haters discover you.