Of course it all depends on the relationship you have with your wife and what your joint and independent intentions are. It is a little like the "prisoner's deilemma" paradox that is often taught in ethics classes.

My ethics?... it would be a straight no. My wife is way too more important. Would I see the other individually is a different question. I am naturally curious and probably would... but with some very strict personal rules of engagement. There is only one SO I want in my life... and I do not want to lose her unless she wants to lose me..