I don't think you are selfish, just enjoying yourself and there is no need to share it with anyone.
It is when you start relationships behind others backs that it gets on to touchy turf.