I don't think this can run on real time on current hardware yet, so it would only work for pre-rendered cutscenes

Did you notice the hands in the video? I don't think computer games can accept that level of error. I would ask again in a decade, when this technique is more viable. Until then, I feel game developers will still need humans to do the work.

You appear to be shadowbanned. Most of your (reasonable-looking) comments are showing up as dead to me.

Sounds interesting, thanks! I had a few informative but controversial comments in the past... that may be the reason.

Seconded, I just had to vouch for you in the above comment to un-dead it.

Aha, it was when you said this:

https://news.ycombinator.com/item?id=15725493