I think that in most cases, the guilt comes from going against our social programming. We are taught that crossing gender boundaries is wrong, that boys or supposed to be boys. The sexes are crystallized into absolute definitions, and going outside the lines takes getting used to.
Also, hiding it from your loved ones might have something to do with it also.
