At some point human intellectual labor will have little to no value in any domain, pushing laborers into too-expensive-to-automate-efficiently jobs, which will likely be relatively unskilled physical labor where the cost of building and maintaining a robot exceeds the cost of hiring a human. If alignment is solved, almost all of humanity will be at the whims of the rulers of AI, a cheap labor force for whatever tasks AI needs to accomplish on behalf of its masters. If alignment isn’t solved all of humanity will be this labor force, probably by some brain hijacking nano machines, until AI designs something better suited than humans.
The future seems very grim. I find it highly unlikely that we will reliably solve alignment, and even if we do it seems equally unlikely that whoever controls AI will act on behalf of humanity’s interests, and not in pursuit of whatever their own goals are. Even where the AI revolution goes relatively well, it’s hard to see a future where the economics of physical labor vs robot labor don’t play out to the detriment of most humans, or one where humans cease being actors and become mere observers of something far beyond their reach.
The future seems very grim. I find it highly unlikely that we will reliably solve alignment, and even if we do it seems equally unlikely that whoever controls AI will act on behalf of humanity’s interests, and not in pursuit of whatever their own goals are. Even where the AI revolution goes relatively well, it’s hard to see a future where the economics of physical labor vs robot labor don’t play out to the detriment of most humans, or one where humans cease being actors and become mere observers of something far beyond their reach.