The words that define someone's sexual orientation do not cause guilt. Some people in our society do, who believe it is wrong to be homosexual and who are vocal about this.
We don't want to ditch the terms. It's important to be able to describe ourselves accurately to the people we love or are beginning to love. We do need words for this.