I agree. Instance from today; I have a very novel task at work that nobody seems to know how to approach, I had a hunch that metaheuristics could play a role; I used ChatGPT to help me better formulate the problem and at least now there is a way to tackle the problem.
It made a few errors in at least presenting my ideas, but these errors were a consequence of my misunderstanding and lack of clarity.
The errors themselves, in my opinion, are invaluable because they force you to think, to be clear, and to guide the model into giving me useful ideas to look into.
For all intents and purposes, it was an example of the Socratic method, albeit inverted, where the student is asking questions to an all knowing teacher, and the teacher / LLM responds with ideas and hints. Ultimately, it's up to the student to synthesize the solution, be critical of the data, and tie everything together.
It made a few errors in at least presenting my ideas, but these errors were a consequence of my misunderstanding and lack of clarity.
The errors themselves, in my opinion, are invaluable because they force you to think, to be clear, and to guide the model into giving me useful ideas to look into.
For all intents and purposes, it was an example of the Socratic method, albeit inverted, where the student is asking questions to an all knowing teacher, and the teacher / LLM responds with ideas and hints. Ultimately, it's up to the student to synthesize the solution, be critical of the data, and tie everything together.