I have cat sat for my sisters two bengal cats several times (as an aside this was the first time I spent enfemme for 5 or 6 days straight but that is another story) and she always comments that it is odd, they normally don't get on with men (highly strung doesn't begin to cover it) but are OK with me.
My own cat couldn't care less, as long as I feed her.