Are the NPUs really that powerful? I was under the impression that they were pri... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		throwa356262 13 days ago \| parent \| context \| favorite \| on: BitNet: Inference framework for 1-bit LLMs Are the NPUs really that powerful? I was under the impression that they were primarily designed for low power use.

		help

lemonish97 13 days ago [–]

They seem to be getting better or more powerful. The newer Intel Panther lakes and AMD Ryzen are over 50 TOPS now, IIRC

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact