Since I've dressed for Halloween at work I have been kidded about it. Just laugh it off and go about your business.
Two of my coworkers know, another I know is fishing, him I play with. I don't get flustered and let him think what he wants.