I think you're wise to do this. There was a study in Italy you might be interested in. They surveyed thousands of young men under 30 (not older men), and they discovered that with the proliferation of available internet porn, there is an abnormally high percentage of younger men who are supposed to be at the peak of their sexuality, who have Erectile Disfunction when they are with women!
http://www.psychologytoday.com/blog/...rowing-problem
They do say that abstinence from porn is the only way to fix this.
Be careful though to not replace the porn with masturbating every time you dress. This can eventually lead to autogynephilia (AGP ... the love of oneself as a woman) which makes it just as difficult, if it is severe enough, to have sex with women, since your preferences and fantasies will lie elsewhere.
