I'd ask "What impact is that? This affects no one besides me. Sure, some people get upset about it - but I don't actually harm them, or any property. It doesn't make any statement about other people at all. Therefore, there is no impact on others. I'm not responsible for anyone else's feelings regarding my clothing choices. People can get upset about all manner of arbitrary and random things that are problems only inside of their minds. I'm not responsible for that stuff either."