I think the people worried about AGI have an oddly positive view of the world - like it's so wonderful as-is that we need to guard it from any disturbances.
Perhaps if they paid closer attention to how profoundly bad so much of human existence is, people living in squalor, dying from awful diseases, killing each other, they'd understand how truly acceptable that dice roll is.
I’m curious what AGI discourse looks like in Israel right now where they’re working on the same shit but actually facing an existential threat. Somehow doubt it’s that high
I think there are many highly intelligent people that would prefer less intelligent people don't gain additional intelligence. They are perfectly happy with the relative value of their own intelligence and know that relative value goes way down in a world that everyone has access to additional intelligence.
Perhaps if they paid closer attention to how profoundly bad so much of human existence is, people living in squalor, dying from awful diseases, killing each other, they'd understand how truly acceptable that dice roll is.
Pedal to the metal all the way.