To understand modern LLMs we all should study more Wittgenstein.

I have been contemplating the use theory of meaning recently, and it’s direct implications for generative language models.