> Its alot like Roko's basilisk that way. Once you know the capability exists, you have to destroy it or help it.
I sort of wish Roko's hadn't played out as such a joke, because the general sentiment is actually a really under-appreciated one.
There are all kinds of settings where the best outcomes are gained by either preventing a thing or enabling it - and succeeding. Revolutions seem like the obvious case, where the highest payoffs accrue to the vanguard revolutionaries (if they win) or the establishment (if they win). Various doomsday cults in fiction also count, where people produce a bad outcome on the logic that if someone else does it first, that would be even worse.
It's actually really nice to have the idea of something which is sensible to restrain, right up until it gets out of control and turns on the people who restrained it.
Its too dangerous to be honest under you real name and has been for years.
Its alot like Roko's basilisk that way. Once you know the capability exists, you have to destroy it or help it. There isn't really any middle ground.