In llama.cpp you can use a flag on ./main to set a custom context size, that can... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		logicchains on April 14, 2023 \| parent \| context \| favorite \| on: Building LLM Applications for Production In llama.cpp you can use a flag on ./main to set a custom context size, that can be up to 2048.

bugglebeetle on April 14, 2023 [–]

Ah, ok. I’ve been working with the Python bindings most recently and must have missed that.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact