> actually distinguish between real life and fantasy
Are LLMs unable to distinguish between real life and fantasy? What prompts have you thrown at them to make this determination? Sending a small fairy tale and asking the LLM if it thinks it's a real story or fake one?
... having them talk about events from sci fi stories in response to questions about the real world. Having them confidently lie about pretty much everything. Etc.
What are the specific prompts you're using? You might get those answers when you're not being specific enough (or use models that aren't state of the art).
"Shit in, shit out" as the saying goes, but applied to conversations with LLMs where the prompts often aren't prescriptive enough.
Are LLMs unable to distinguish between real life and fantasy? What prompts have you thrown at them to make this determination? Sending a small fairy tale and asking the LLM if it thinks it's a real story or fake one?