I am very concerned about the potential for AI to prevent humans from doing useful work by distracting us with addictive content / skinner boxes. We already see the beginnings of this in platforms like TikTok, but at least that is limited by the fact that it must curate content made by users. Imagine if the algorithm also had the ability to generate laser-targeted content that keeps you transfixed. The usage stats are already alarming and it doesn’t even do pornography yet. Our primate brains do not stand a chance.
Precisely. A large number of issues we're facing exists precisely because our brains are maladapted to the modern world we've created, especially the digital one.
Now add artificial intelligence that is adapted to it, and actively working to subvert our agency. No matter how far of a cry from genuine intelligence it will be, it's going to be "fighting" us on a layer where we're blind, deaf, and limbless.
Yes. AGI is a possible future risk. But the real risk right now is corporations and governments manipulating behaviour (mostly to sell us things) using these powerful algorithms.