I can reliably crash my system using kobold.cpp with Vulkan running an AMD GPU. ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		imtringued on May 13, 2024 \| parent \| context \| favorite \| on: GPUs Go Brrr I can reliably crash my system using kobold.cpp with Vulkan running an AMD GPU. All it takes is a slightly too high batch size.

latchkey on May 13, 2024 [–]

What is slightly too high of a batch size? If max size is 100 and you're at 99, of course 100 will crash it.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact