Yes, that's his point. Tolerating "Jews should not be able to vote" as an opinion will ironically lead to a less tolerant society. You must be intolerant with the intolerant.
You literally just said "Jews should not be able to vote" and the world did not explode. Words are much more nuanced than you seem to want to believe. We are not equipped to properly censor them without doing much more damage than we do good.
