Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
h_mirin
on June 9, 2023
|
parent
|
context
|
favorite
| on:
Understanding GPT tokenizers
I didn't know that GPTs have such duplicated tokens! The image in the article means that there're three davids ("David", " david", "david") in the tokens, right?
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
