Related comments: https://news.ycombinator.com/item?id=40242939 I pointed out that you can use llama.cpp to do something like this with it's Classifier-Free Guidance (CFG) feature (may be easier than using Pytorch or such).