He should not be getting grumpy at YOU for asking a reasonable question, or making snarky comments to you. It's time he had an attitude adjustment and realize how fortunate he is to have a gf that's OK with his fetish.