Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Seems to truncate the input to only 2048 input tokens


Oops! That's an Ollama default setting. You can fix that by increasing the num_ctx setting - I'll try running this again.

The num_predict setting controls output size.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: