I just took an informal survey of all the CDs in the house (me), and the only sexual relations I'm having are with my wife. I think I classify myself as a serially monogamous hetero. I just like to play dress-up, that's all.
Your SO may be different, but the only way to find out is to let him know you're concerned about the issue. Bring in a marriage counselor, if necessary.
Nancy