They are good for single batch inference and have very good tok/sec/user. ollama works perfectly in mac.
They are good for single batch inference and have very good tok/sec/user. ollama works perfectly in mac.