> to accurately produce the next token you must have an understanding of the world you're talking about.
I don't think this is true. It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.
>It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.
I'm not sure that there is a difference. If there is, what would be an example of true understanding vs just statistics? All of intelligence is ultimately recognizing patterns and layers of patterns of patterns.
I don't think this is true. It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.