Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> single consumer-grade NVIDIA A6000 GPU with 48GB memory

I wouldn't call an A6000 "consumer-grade" -- it's about $5000 and 99% of consumers that have graphics cards wouldn't have that.

Top of the line consumer grade GPU would be a Nvidia RTX 4090/3090 with 24GB VRAM.



It is solidly a workstation card that is often deployed in data centres. Consumers are far better off with a 4090.


“Consumer grade” here means “you can buy it in a store”. (This is not true of DGX devices.)


Your local MicroCenter doesn’t stock DGX A100/H100 ???


So "off the shelf" rather then.


Agreed, but two RTX 3090/4090 should be as capable in this regard (having 2x 24GB).


AFAIK the 4090 cannot share ram like that (no nvlink)


Is it? It might have even more computing power, but are cards now able to share VRAM now? My hands-on experience of all this is from a few years ago and I think it was not possible back then.


DeepSpeed is designed to take care of spreading the work for you.

You can link two 3090s with nvlink to increase bandwidth.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: