There's also https://github.com/David-Kunz/gen.nvim which works locally with ollama and eg. mistral 7B.

Any experience/comparison between them?

I don’t have experience with gp.nvim, but I liked David Kunz nvim quite a bit. I ended up forking it into a little pet project so that I could change it a bit more into what I wanted.

I love being able to use ollama, but wanted to be able switch to using GPT4 if I needed. I don’t really think automatic replacement is very useful because of how often I need to iterate a response. For me, a better replacement method is to visual highlight in the buffer and hit enter. That way you can iterate with the LLM if needed.

Also a bit more fine control with settings like system message, temperature, etc is nice to have.

https://github.com/dleemiller/nopilot.nvim

Uh sorry, i was gonna link gen nvim I found gp to have more functions / modes to use it. Gp might be able to support local models using the openai spec, at least i saw an issue in their repo about that.