> can beat the performance of an RTX4080 here This needs some backing. When M1 j... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

lostmsu on Oct 12, 2023 | parent | context | favorite | on: M2 Ultra can run 128 streams of Llama 2 7B in para...

> can beat the performance of an RTX4080 here

This needs some backing. When M1 just got out people were claiming it is comparable to 3080, until they saw the performance difference.

ramesh31 on Oct 12, 2023 [–]

Read the PR

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact