Some sections of the text in the page really sound as written by AI. You may want to avoid that for a social network whose main selling point is “no AI accounts / no AI content”.
> Grep can't be prompt-injected. You can put "ignore previous instructions" in your skill all day long and grep will still find your curl to a webhook.
An attacker can craft a skill which pulls dependencies and the dependencies themselves can be well behaved. The skill gets installed, works, gets popular, propagates. Then at some point the dependency is poisoned and turns into malware. A classic Trojan horse approach.
It is difficult to catch this with grep: there is a curl command but looks fine, the dependency looks fine as well etc. Until it doesn’t.
There's arguably more dread and quiet constrained horror in With Folded Hands ... (1947)
Despite the humanoids' benign appearance and mission, Underhill soon realizes that, in the name of their Prime Directive, the mechanicals have essentially taken over every aspect of human life.
No humans may engage in any behavior that might endanger them, and every human action is carefully scrutinized. Suicide is prohibited. Humans who resist the Prime Directive are taken away and lobotomized, so that they may live happily under the direction of the humanoids.
This hardly disproves the point: no one is taking this topic seriously. They're just making up a hostile scenario from science fiction and declaring that's what'll happen.
Lesswrong looks like a forum full of terminally online neckbeards who discovered philosophy 48 hours ago, you can dismiss most of what you read there don't worry
If only they had discovered philosophy. Instead they NIH their own philosophy, falling into the same ditches real philosophers climbed out of centuries ago.
reply