Also missed in the post is fp8 is really much more efficient The H100s are actua... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

emadm on Aug 1, 2023 | parent | context | favorite | on: Nvidia H100 GPUs: Supply and Demand

Also missed in the post is fp8 is really much more efficient

The H100s are actually very good for inference..

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact