Does lossy means you may see previous inputs change ?!

Lossy doesn't necessarily imply that it is non-deterministic, just irreversible.

Only the model’s view, doesn’t have to be yours, just like you can participate in a long conversation without perfect memory that might in retrospect slightly differ from a recording.

with the added bonus that these things are unreliable and the compressor could drop important tokens