I'm focusing on what they said. They said "an LLM, fundamentally, is a file".

Which is true, but the implication is that LLMs can't be agentic, which may or may not be true.