> Okay, but is that because brains are just better at optimization of linear algebra? Or is quantum mechanics involved?
No such magic.
The average ML neuron is connected in layers to maybe 100 other neurons. The brain is connected to far more ~1000 -10000 So its the dense interconnectivity at play. Whatever successes we have had with LLM now is because we are increasing the parameters of the network (although we haven't similarly scaled connectivity if I am not wrong, but definitely making progress there - for e.g. Pathways networks from Google by Jeff Dean et. al)
Look, nobody knows what makes a thing conscious or not, and anyone who claims they do with certainty is talking out of turn. Is this guy being a bit silly? Yeah, I think so. But let's not pretend that anyone on earth has suddenly answered a question that humanity has been thinking about without significant progress for thousands of years.
What is sentience then? Last I checked the Searle Chinese Room argument was still unresolved.
Is it not possible that our brains are also just "large scale statistical knowledge assimilation" machines?