I'd love games that leverage language models to dynamically update non-critical dialogues. Shopkeepers have to say "Welcome, traveler!", but a model can receive the line of dialogue and shift it, instructed with in-game knowledge that you have a certain equipment, recently performed certain actions, that you have various flags set, and any and all little details.

Have it voiced by AI, a new welcome message every single time you go into town so it doesn't get old. He could get increasingly upset that you don't say hi back.

I'm not even a AI guy and I could have that pipeline up and running in a weekend.

When will I see this tech in mainstream games?

I don't understand your comparisons.

> So its like a API but less reliable and harder to use

Regular customers can't interface with an API, so that's not an apt comparison. A lot of people call customer service or use chat for things they can't or don't want to figure out how to do on the website.

> Also much more expensive.

It isn't more expensive -- the whole point is that it's cheaper than paying customer service reps.

It works like this, they have an API, say:

/refund/<order id>

It has all business rules encoded into it, so the API decides with regular code if you are getting a refund or not.

Instead of:

<button onclick="/refund/<order_id>">

Just being added to the orders page, you have to convince ChatGPT to call the refund API for you by writing it a story.

Worse UX, more expensive.

Allow me to repeat my comment:

> A lot of people call customer service or use chat for things they can't or don't want to figure out how to do on the website.

It's not inherently worse UX, it's multiple ways of interacting for different customers who have different preferences.

And when you say "It has all business rules encoded into it", that's literally what I already said twice -- "hard business logic guardrails in actual code, not in the LLM".