We have always made a distinction between things that are not the fault of the individual (skin color, gender, ethnicity) and things that are (speech and actions). Which seems perfectly reasonable to me.
As usual, this stops the conversation cold, because it doesn't fit anyone's narrative. Free speech advocates want to claim that the marketplace of ideas will lead people to good ideas, while people for restricting speech want to claim that it's possible to restrict speech without going full-on totalitarian dystopia. The case of religion shows quite starkly that both narratives completely fail to describe a central example with great historical and current relevance.
Free speech is a good idea for game-theoretic reasons. That's it. Free speech lets people fight it out with only the occasional riot and attempted overthrow of the republic. That's better than the alternative.
This one is in flux, I suspect. In the past, people were born into their religion, and today, at least in the west, it is becoming more common for people to choose their religion. So I guess this is the exception that proves the rule.