I shave mine. My wife has been close to me in the shower, bed, couch and other places.
Has not even noticed. I guess I am kinda lucky.
Never been a problem, though never said anything either.
Just shave late at night when she is sleeping and don't let it get too long so she notices.