I have had only one person (co-worker -GG) actually ask if I shaved my legs and I came back with the "why are you always checking me out? Interested?" and the conversation died on the spot. This past summer I was having a conversation with a GG friend about hygiene and deodorants, don't remember how it came up but showed her my shaved armpits and her reply was "I wish doug shaved his, they stink really bad".
Now I have been completely shaved now for over a year except for my arms. I cut them down to a #1 with a trimmer. No one has really noticed or said anything including my GF. If you haven't shaved yet, just out of fear, you should. do it slowly till there is nothing there if you are worried.