Considering that prisons in their current form overflowing with brutality and cruelty are an acceptable mainstream position, I'd rather not care about being extreme. If one believes that prisons as a structure inevitably lead to arbitrarily bad abuse of power, then one is for the abolition of prison.
There are many traditions of communal justice that aren't retributive. Keywords that can be googled are restorative justice and transformative justice, for example. Traditional conflict resolution still persists in areas where the reach of the state does not extend. Approaches to justice that eschew centralized authority have a very different character, and I understand that it can be difficult to come up with such examples on one's own. It requires a different approach to the problem.
In any case, prison abolition is a wide topic with a lot of point of views and I could not do any of them justice in an Internet comment. I hate referring someone to wikipedia, but all the other sources I'd cite have a distinctly leftist approach and I think wikipedia is probably the most approachable entrypoint for someone who does not already ascribe to certain ideological premises: https://en.wikipedia.org/wiki/Alternatives_to_incarceration
I can't speak for OP, but I'd think Anarchists can swing to both extremes. Self defense is not the same as enforcing a dictated law. This is reduction ad absurdum, but still worth thinking about. IMHO, anarchy is not an alternative to other rules, it's the foundation of free will, the empty set that is part of every other set. Of course, anarchism as a label is used with a different message.
