Sorry to hear this happened to ypu Dee, unfortunatly their are some idiots out there who will do this. you done the right thing by ignoring them. If you react you may have found that the situation would have got worse, also maybe his mates would have joined in. Then you would have felt that every one is the side of the idiot.
You look good in your avi pic and i suspect you look good in real life. As yo say in another town you found no problems.
I have to say one time i got heckled a lady and her husband had a right real go at the person.