> The difference is that the A6000 absolutely smokes the Mac. Memory Bandwidth :... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

c1b 7 months ago | parent | context | favorite | on: DBRX: A new open LLM

> The difference is that the A6000 absolutely smokes the Mac.

Memory Bandwidth : Mac Studio wins (about the same @ ~800)

VRAM : Mac Studio wins (4x more)

TFLOPs: A6000 wins (32 vs 38)

bevekspldnw 7 months ago [–]

VRAM in excess of the model one is using isn’t useful per se. My use cases require high throughput, and on many tasks the A6000 executes inference at 2x speed.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact