I think that this is a big reason that agents aren’t prevalent as one might otherwise expect. Quality control is very important in my job (legal space, but IANAL), and I think while LLMs could do a lot of what we do, having someone whose reputation and career progression is effectively on the line is the biggest incentive to keep the work error free - that dynamic just isn’t there with LLMs.

Right: the one thing an LLM will never be able to do is stake their credibility on the quality or accuracy of their output.

I want another human to say "to the best of my knowledge this information is worth my time". Then if they waste my time I can pay them less attention in the future.

This is a highly underrated point. It's the same reason AI might replace paralegals but won't replace lawyers.

They do this all the time. There's a reason we have the term "AI slop". LLM output definitely has a reputation.

Bingo. Accountability is one of the most important aspects that makes people be fearful and complain about LLMs because they essentially want to avoid having it.

If you can't explain why you're putting some code you don't understand it and it's not really acceptable.