Seems to me that the use of AI is irrelevant[1], and the real problem is the absurd error rate.

[1] In the sense of "it doesn't matter if it caused the problem", rather than "it probably didn't have any effect". Because after all, "to err is human, but to really foul things up takes a computer".