Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Care to also check if they do prompt decomposition into multiple prompts?


You're asking if they break the user prompt into multiple chunks?

All I can find is counting number of tokens and trimming to make sure the current turn conversation fits. I can not find any chunking logic to make multiple requests. This logic exists in the classes that extend IIntentInvocation which as buildPrompt() method.


I believe it's this paper, but... not certain: https://arxiv.org/abs/2210.02406

will update when i find more info.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: