My wife knows I underdress and is not supportive. Other than that, I don't think anyone else has a "need to know".
I do think it could be fun to have a GG to go shopping with me, but that's another thing that would upset my wife. I don't want to create the illusion of something more intimate going on.
So, I happily underdress for my own enjoyment.