Taking what Dee wrote a step further, what the neighbors think about what they see at my house is none of my business.
No one has ever asked me about any visitor in my 25 years in this house. Everyone knows that everyone in the neighborhood can protect themselves, so any dangerous visitors would not remain dangerous for long.