I'm not entirely sure how to phrase this so it comes across correctly. However:

When dressed as a woman, the term 'Sissy' does not bother me at all.

When in male mode, it really bothers me a lot.

Strange, I know.