I've had this happen to me as well. I still ride my bicycle often, I just ignore them. It has been my experience though, that its often teens who just got their license and they think it fun to heckle those either walking, waiting for the bus or riding a bicycle. But maybe one day, Karma will pay them a visit and they'll be in the same spot.
