I think a better phrase would be "you never were the man I married". The real problem is not that you have changed, but that you kept it a secret from before you were even married.
I believe in total honesty in a marriage. Your spouse should be the one person you can tell anything. Maybe I am just lucky, but it works for me.
In reality, I suspect that most crossdressers make better husbands. It should be an asset.
Juno