Not at all... I wear panties 24/7 and don't mind the word at all. My wife on the other hand hates it. To her all is underwear.
Here when we go shopping there are always signs in the stores "Panty sale" or something of the like. Just listen to the V.S. commercials and hear that they sell "Bras and Panties".
Just a matter of taste...