My guess is that hate crimes are considered different from ordinary crimes because their are more victims. In addition to the direct victim or victims, there is everyone else in the same protected group who feels threatened because they are now being targeted. In essence, a hate crime is a kind of terroristic threat; they often occur because the perpetrators want that "kind" to know they aren't wanted around here.