>> It took the lawyers an average of 92 minutes to complete the NDA issue spotting, compared to 26 seconds for the LawGeex AI.
Issue-spotting an NDA is not a typical task for an actual lawyer. It is the sort of thing handled by a legal intern or paralegal... then signed off on by a lawyer. It isn't typical legal work. The results are therefor of limited application in the real world.
Better test: Client asks "Do I need an NDA?" or, conversely, "can I break this NDA I signed last year?". Ask C3PO to handle that question. That is the sort of problem where the real legal expertise happens.
Issue-spotting an NDA is not a typical task for an actual lawyer. It is the sort of thing handled by a legal intern or paralegal... then signed off on by a lawyer. It isn't typical legal work. The results are therefor of limited application in the real world.
Better test: Client asks "Do I need an NDA?" or, conversely, "can I break this NDA I signed last year?". Ask C3PO to handle that question. That is the sort of problem where the real legal expertise happens.