Just don't bother talking with people like that, if they're ignorant enough to think anything other than being attracted to men means you're gay. Also, though, you shouldn't care so much whether you're gay or not.