Does Llama model has a token limit like ChatGPT api (4k tokens)? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		0xakhil on March 11, 2023 \| parent \| context \| favorite \| on: Llama.cpp: Port of Facebook's LLaMA model in C/C++... Does Llama model has a token limit like ChatGPT api (4k tokens)?

MacsHeadroom on March 11, 2023 [–]

It's currently 2048 tokens. But like GPT-3, that can be improved in the future.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact