It's not so much a need to thrust an explanation on them. Half the battle can be won just by being nice when we do interact with the public. Basic good manners and a smile will leave them thinking there goes a nice person. Sooner or later when we crop up in a conversation they'll be more likely to defend us if others are being derogatory.