Slashdot also had the concept of meta-moderation, where the site's users could vote on whether a particular mod's actions were appropriate/fair or not. Presumably mods that were voted as problematic stopped getting the ability to mod.

Slashdot was in many ways way ahead of their time. I think Reddit (and even HN) could benefit from this kind of check/balance.