Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Having only 48GB of RAM per card seems low. The full server system with 8 cards barely has enough RAM to run modern large open models. And batching together user requests eats quite a lot of memory, too. Curious to see how these machines and cards are received by the market.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: