Jeremy Waldron claims that tolerance is more than merely the absence of violent assault on people who have adopted beliefs and practices we don’t like, and more than simply abstaining from persecution and legal sanction. He says that tolerance also implies the absence of hate speech and a legal prohibition of hate speech. Members of minority groups whose beliefs and practices are strongly disapproved of by the rest of society, have a right to go about their lives without the threat of constant hatred, vilification, insult and humiliation. They have a right to visit the shops and restaurants they want to visit, and to generally interact with others without being treated as pariahs.
And, indeed, that sounds quite reasonable. People undoubtedly have and should have such rights. But others have rights as well: hate mongers have a right to free speech, and racist shop keepers and restaurant owners have a right to ban whoever they want from their private property, under certain circumstances.
When the rights of the haters and the rights of despised minorities come into conflict, the different rights have to be balanced. I argued before that the right of private property of racists, or the freedom of association of prejudiced groups wanting to exclude homosexuals for example, should no longer be protected when these racists and bigots have become so numerous and authoritative that the objects of their racism or bigotry no longer have any alternative options and risk having their own rights violated. In the Jim Crow era, for example, it was very difficult for blacks to move around, find decent housing etc. because there were so many transport companies and landowners discriminating against them that their options were seriously diminished. Hence their rights were violated, and violated to such a degree that limitations on the rights of their tormentors were justified.
Similarly, in our current example, hate speech should only be banned and the right to free speech of hate mongers should only be limited when there’s an impact on the rights of their targets. Claiming, as Waldron seems to do, that a tolerant society generally requires such bans and limits will not do. That’s just not enough as a justification. For example, writing blood libel on an obscure blog that nobody reads should probably not be prohibited. On the other hand, burning crosses in the front yards of black people and forcing them to move elsewhere is a violation of their right to freely choose their residence. The same is true if people dare not walk the streets because of the risk of being constantly cursed at. These two cases of expressions of hate speech can and should be banned because they result in rights violations. Other expressions of hate speech should be protected. A general claim that tolerance requires not just constraints on coercion and violent persecution but also a general respect for people’s dignity and a social atmosphere free of hatred, insult and defamation, goes too far. It would be nice if the world was free of hate and if respect for dignity was the normal attitude, but there’s no right to such a world. Nor should there be.
If we were to adopt such a right, we’d run the risk of terminating debate altogether. If tolerance includes a general ban on hate speech it’s likely that it will also imply banning vehement discussion of other people’s supposed errors. You don’t need to engage in hate speech in order to have a vehement and lively discussion and criticism of others, but a lot of such criticism can be readily understood and perceived by its targets as an expression of hate and an insult to dignity. These targets can then use the power of law to shut down the debate, and that’s not something we want. Ideally, specific instances of speech should not be judged as inadmissible instances of hate speech and proper objects of legal sanction simply on the basis of the feelings or perceptions of the targets, but only on the basis of the objective consequences for the rights of the targets. Tolerance that includes a ban on all hate speech is a tolerance that in the end may silence us all.