What is the recommended hardware to run a model like that locally on a desktop P... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kleiba 11 months ago \| parent \| context \| favorite \| on: Yi-Coder: A Small but Mighty LLM for Code What is the recommended hardware to run a model like that locally on a desktop PC?

tadasv 11 months ago [–]

you can easily run 8b yi coder on 4090 rtx. Probably could do on a smaller gpu (16GB). I have 24gb, and run it through ollama.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact