Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Don't sleep on the 9B version either, I get much faster speeds and can't tell any difference in quality. On my 3070ti I get ~60tok/s with it, and half that with the 35B-A3B.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: