The real issue with the parent comment is that it's not sustainable in the end. When they say "everyone but (x) understands this", they are alluding to a sense of shared understanding.
That, to a certain extent, is a culture. In a society with several cultures, alluding to a sense of shared understanding is virtually impossible, because the interpretation is at root a cultural one. There's simply no way to guarantee that what they mean by "intolerant" is exactly what everyone else means.