Hacker News new | past | comments | ask | show | jobs | submit login

https://github.com/oobabooga/text-generation-webui/wiki/LLaM... Here you go. You'll need a Nvidia GPU with at least 8 GB VRAM though.



Thanks! I have a Linux laptop with 16G ram and a 10G NVidai 1070, so I might be good to go.


Any examples on running on multiple GPUs?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: