There is no paradox when you see tolerance through the lens of a social contract.

When one party breaks the contract, the other party is no longer under any obligation to abide by it either.