Do people really buy this nonsense? I mean just this week Sora 2 is creating videos that were unimaginable a few months ago. People writing these screeds at this point to me seem like they’re going through some kind of coping mechanism that has nothing to do with the financials of AI companies and everything to do with their own personal fears around what’s happening with machine intelligence.
So, wait, you're saying that these guys just aren't impressed by the AI technology, and that is blinding them to the fact that the AI companies' economics look really good?
That is a laughable take.
The AI technology is very very impressive. But that doesn't mean you can recover the hundreds of billions of dollars that you invested in it.
World-changing new technology excites everyone and leads to overinvestment. It's a tale as old as time.
I’m saying that seeing dubious economics is blinding people from accepting what’s actually going on with neural networks, and it leads to them having a profoundly miscalibrated mental model. This is not like analyzing a typical tech cycle. We are dealing with something here that we don’t really understand and transcends basic models like “it’s just a really good tool.”
I've followed the human level intelligence stuff for about 45 years, back before it was called AGI and the basic thesis is kind of anti religious. It's that human intelligence is basically the result of a biologically constructed computing device, not some god given spirit, and as human built computing devices continue their Moore's law like progression they will overtake at some point.
It's been true and kind of inevitable since Turing et all started talking about it in the 1950s and Crick and Watson discovered the DNA basis of life. It's not religious, not a mania, not far fetched.
The angle currently is the opposite. They're positing that the machine has some sort of spirit - see the other poster talking about "unexplained emergent intelligence".
Saying we don’t understand why LLMs are intelligent is both true and completely unrelated to religion. You inserted the word “spirit” so perhaps you are the one conflating the two.
Well it's sort of true in that people stick these LLMs together and they produce intelligent seeming outputs in ways that the people building them don't fully understand. Kind of like how evolution stuck a bunch of biological neurons together without needing to fully understand how it works.
It’s not a religious angle, we literally don’t know how or why these models work.
Yes we know how to grow them, but we don’t know what is actually going on inside of them. This is why Anthropic’s CEO wrote the post he did about the need for massive investment in interpretability.
It should rattle you that deep learning has these emergent capabilities. I don’t see any reason to think we will see another winter.
Correct, my opinions have nothing to do with financials. If I was around for the discovery of fire I wouldn’t be wondering about the impact on the bottom line.
(To be clear, I do agree that AI is going to drastically change the world, but I don't agree that that means the economics of it magically make sense. The internet drastically changed the world but we still had a dotcom bubble.)
