Some of the consequences of hate speech are human rights violations; others are not. Only the former are good reasons to criminalize hate speech and carve out an exception to the right to free speech. Rights can only be limited for the sake of other rights or the rights of others (more here). Let’s go over the different possible consequences of hate speech and see whether or not they imply rights violations.
Hate speech lowers self-esteem in the targets. People who are repeatedly subjected to hateful remarks or jokes about their race, gender, sexual orientation etc. tend to develop feelings of inferiority, stress, fear and depression. Of course, there’s no right not to be depressed, fearful, stressed etc. Therefore, we can say that hate speech should be protected speech when its consequences are limited to these. These are harmful and brutal consequences, but not harmful or brutal enough to be rights violations. We should be concerned about them and try to do something, but this “something” doesn’t include limiting free speech rights. However, people who are extremely intimidated and stressed and who have a deeply negative view of themselves tend to isolate themselves. Isolation isn’t a human rights violation, but couldn’t we argue that willfully isolating people means violating some of their rights? Isolated people don’t speak, assemble, associate etc. In that case, we could argue for limits on the rights of hate mongers.
Hate speech often has even more extreme consequences. Targets of hate speech may feel compelled to leave their homes and move elsewhere, to quit their jobs, and to avoid certain parts of town and public areas. This is a direct violation of their freedom of movement, freedom of residence, right to work and possibly even their right to a certain standard of living. It’s obvious that the free speech rights of the haters should in such cases be deemed less important than the many rights of their victims.
Hate speech can also means invasion of privacy, for example in the case of repeated phone calls, hate mail, or stalking.
Violations of property rights are another possible consequence of hate speech. Hate speech sometimes means vandalism, graffiti (sometimes even inside the homes of the targets), cross burning in someone’s front lawn etc. These cases of hate speech already start to resemble hate crime.
The line between hate speech and hate crime is even thinner when speech is not just hateful but an incitement to violence. For example, hate speech can provoke race riots; it can help hate groups with an existing tendency toward violence to attract new recruits etc. (a larger group will feel more confident to engage in hate violence). And what if hate speech allows hate groups to gain control of (local) government? That would probably lead to discriminating policies and laws.
This overview of possible and actual consequences of hate speech should concern those of us who care about more human rights than just freedom of speech, and who know that different human rights aren’t always in harmony with each other. In some circumstances, some rights need to give way in order to protect other rights. That’s an unfortunate but inevitable consequence of the value pluralism inherent in the system of human rights.