> There will be attempts at improving reliability but at some point it becomes too expensive and ineffective to try to improve it.

At some point it will be self improving. Either through humans telling it to quit spewing bullshit or by learning fact-checking is a good system of improvement.