It probably starts with corporal punishment of children. That gives society a baseline predisposition towards violence and doled our suffering in order to enforce conduct. Adults who were beaten as children or felt that they suffered for their transgressions may feel that it’s unfair for someone to avoid suffering for transgressions, when they had to suffer in the past for theirs.