They can and they have been look on HuggingFace or search torrent sites. You onl... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

MacsHeadroom on March 12, 2023 | parent | context | favorite | on: Running LLaMA 7B on a 64GB M2 MacBook Pro with Lla...

They can and they have been look on HuggingFace or search torrent sites.

You only actually need about 30GB of VRAM (or unified memory) and no ram to run the largest 65B model.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact