Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
alecco
7 months ago
|
parent
|
context
|
favorite
| on:
Karpathy: Let's reproduce GPT-2 (1.6B): one 8XH100...
Also
https://x.com/karpathy/status/1811467135279104217#m
iforiq
7 months ago
[–]
How much did gpt2 training cost when it came out in 2019?
ozr
7 months ago
|
parent
|
next
[–]
About $50,000.
withinboredom
7 months ago
|
parent
|
prev
[–]
They probably spent more on the training data, to be honest. They had to get it the hard way.
Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: