Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Running in cpu ram works fine. It’s not hard to build a machine with a terabyte of RAM.




Admittedly I've not tried running on system RAM often, but every time I've tried it's been abysmally slow (< 1 T/s) when I've tried on something like KoboldCPP or ollama. Is there any particular method required to run them faster? Or is it just "get faster RAM"? I fully admit my DDR3 system has quite slow RAM...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: