I had something similar happen when shaving my legs. I figured my wife wouldn't see it because it was that time of the month so i knew nothing would be happening where we would be rubbing legs together and I wear pants 99% of the rest of the time.
I was wrestling with my kids and one of my pant legs pulled up a bit and she saw it. She got mad and we argued for almost 3 hours afterwards.
In all honesty, im continuing to shave my legs. It makes me happy, doesn't physically hurt anyone, and as for my wife.... well, if she wants me to keep them unshaved, she's going to have to give me a reason that its better than just bedroom time once a month or something. That's about the only time she feels my legs or even sees them.
I plan on changing one thing per month that makes me happy. It may involve coming out more or it may not have anything to do with dressing, but I think it's important to be happy and little steps in that direction are what I'm focusing on. I'm working slowly so that things don't come to a boil too fast for the frog in the pot. ;-)