My thinking is that those are additions developers can use to enable better experiences with a service hosted remotely. The local LLM seems like an end-user feature.
The local LLM feels like it could/should be its own app, separate from the browser. If the point of the local AI is not keep the users data local, it seems confusing to have it in the browser at all.
The local LLM feels like it could/should be its own app, separate from the browser. If the point of the local AI is not keep the users data local, it seems confusing to have it in the browser at all.