It's much easier than you think. Put aside how you're dressed. Are you sexually attracted to males, and if you are an adult, have you either acted upon that attraction. If the answer is yes, then you might be gay. If you aren't attracted to men, regardless of how you fantasize, then, no.