Paula [IMO] there will be at least some people in any town [regardless of size] "sharp enough" to interact with you as they always have in the past regardless of what they have been told/heard/think they know. They are not going to allow gossip, inuendo and speculation to ruin whatever Relationship they have with you built up over who knows how many years. They may or may not care to hear "your side" of the story [from YOU] but I would not volunteer it unless they ask if I were in your shoes.
Did you do the waxing yourself?