I agree with the notion that most people don't really pay attention to hair on a man's legs, unless it's really thick.
Like many, I'm not very hairy, except for my eyebrows that if not attended to, I would put Bert from Sesame Street to shame.
I've shaved my six or so hairs on my chest for years as well as my armpits. I started on my legs not long ago and was somewhat nervous about any reactions I would get. After about three days, I finally told my wife as she never even noticed!!! She was a little taken back at first, but since has actually taken a liking to this.
Went to work in shorts, waiting for the guys to take liberties on my smooth legs...... Nothing. It's been a few months now and they still don't notice, and these guys live for taking pokes at people.
According to my hairdresser who also does my brows, she has a lot of male clients that get their legs, chests, arms and backs waxed. It seems like such a common thing nowadays, that people don't view it as being odd.