https://github.com/karthink/gptel might interest you as well

csdvrx · on Dec 31, 2023

It was linked in a few commends so I look at the readme:

> Setup > ChatGPT > Other LLM backends > Azure

Llama.cpp is down to the end, so I think it's for those having priorities than freedom.

ParetoOptimal · on Dec 31, 2023

I was one of the reasons llama.cpp instructions was recently added.

The ordering is because of date added I'm pretty sure.

However I bet an issue about ordering based upon freedom respectfulness would be well received.