An LLM burns through how much power, compared to the tiny Arc server? You could outsource it, of course... But then you have a third party dependency.
Then you have the problem that LLMs continually and constantly change words to be "simpler" and destroy the very sensitive meanings, especially words in tech. Like auto-correcting Fediverse into Universe. Or C into C++.
An LLM burns through how much power, compared to the tiny Arc server? You could outsource it, of course... But then you have a third party dependency.
Then you have the problem that LLMs continually and constantly change words to be "simpler" and destroy the very sensitive meanings, especially words in tech. Like auto-correcting Fediverse into Universe. Or C into C++.