Sometimes we are, especially if you have a wife who can accept the fact but doesn't really appreciate it.
AT the same time, everyone occasionally does need to be selfish and take care of themselves. I would rather be selfish like this than be abusive, self destructive, etc.