This is how you would implement a "medium term" memory. Folks in the "sentence-transformer" world have known this forever, yet the wider NLP world ignores it in the context of "chatbots" despite how powerful that and related concepts like "soft-prompts/textual inversion" are.
It's a wonderful technique and the fact that it's not used in ChatGPT and other tools like it is a shocking shame.
This is how you would implement a "medium term" memory. Folks in the "sentence-transformer" world have known this forever, yet the wider NLP world ignores it in the context of "chatbots" despite how powerful that and related concepts like "soft-prompts/textual inversion" are.
It's a wonderful technique and the fact that it's not used in ChatGPT and other tools like it is a shocking shame.