Nadine, you will be vilified for this rather obvious truth. In my case it was simple cowardice that held me back for 20+ years. I came clean a few years ago and have lived a much better life for it. After I told my wife she said, "I can understand why you kept that secret." She wasn't happy that I kept this secret but it is such a monumental thing that telling is hard to do.
Honesty is the best policy, we all know this but it is easy to justify behavior when you are afraid.