In my experience I have learned that when I have been forced to refrain from dressing either from my parents, my x-wife, or my own fears I was very irritable, would fly off the handle over the smallest things, and a whole lot of other disruptive activities. I was not a happy person at all. When I am dressing I am a very different person. I am very relaxed, easy going, fun loving and a very happy person. No one will ever force me to refrain from dressing again. I am just a better person when I am dressing. That being said as with most CD's I am a man, I love being a man and do not want to be a woman. I was loyal to my x-wife and am loyal to my two girls and my SO. I Love them all and wouldn't want to lose them.
You are not a bad wife. The fact that you are trying to understand your husband is proof of that. My x-wife of 10 years told me either her or CDing, nothing in-between. I would say that compromise is in order and a good marriage consoler with knowledge of gender identity issues would be a big help for both of you. There are CDing groups in your area that your husband could join. All of these could be helpful.
You both can be happy and safe.