Have you tried invoking code-davinci-002 directly and comparing the overall token use (and thus cost)?
(edit)
> or maybe if it allowed us to create custom sessions where it had-preingested the corpus of project documentation. That'd be a security nightmare, though.
That's what fine tuning is used for... and its not cheap, but its also limited to use by one organization.
(edit)
> or maybe if it allowed us to create custom sessions where it had-preingested the corpus of project documentation. That'd be a security nightmare, though.
That's what fine tuning is used for... and its not cheap, but its also limited to use by one organization.