That's fair, but it is a negative take that disregards all emergent properties. If you strip all emergent properties from it, there is nothing left. The same thing is true of all biological systems.
Why bother being "human". We are all just a bunch of cells exchanging chemicals and electrical signals. That's all there is to it. There is no reasoning, just a bunch of signals going back and forth.
How honestly can you say that "emergent properties" are real if you haven't really seen the training data or you don't actually know how the thing works?.
It stand's to reason that the bigger the model, the more likely you'll get an answer to a question you're looking for. Even the apparently "tricky questions".
Even things like translating code from one coding language to another...
Anyway, maybe we are ALL stochastic parrots (including ChatGPT-10) and that's all we'll ever be...bravo.
Emergent properties are never "real". They just are and you can see them happening, but "underneath" it's nothing.
Edit: I meant to say I don't need access to training. By experimenting with in/outputs you can get a basic picture. I don't need to see biological scans to say something about your personality either.
I do not. What I say is that I perceive them. Their realness is a non-issue (to me). "Factual", you mean by "authorities"? I do get your point, but I think you overthink the issue. If you see something, it is there. It can be illusory, sure, but think about why that matters.
Why bother being "human". We are all just a bunch of cells exchanging chemicals and electrical signals. That's all there is to it. There is no reasoning, just a bunch of signals going back and forth.