An interesting paper would take the existing LLMs and see how well they can do flagging problematic work.
I would like to see this as well. I would be curious if LLM's start to see the same patterns I see having read half of nih.gov going down many rabbit holes of researchers scratching each others backs, pencil whipping reviews and such. Can LLM's pick up on such behavior or might that require something closer to human intelligence? I do not know enough about LLM's to even guess. Could it perhaps at least pick up on entirely fake papers from Youtubers pranking the system to see if they can get their silliest papers published? I report them but by the time they are taken down the Youtubers have had a large number of views and laughs.
I would like to see this as well. I would be curious if LLM's start to see the same patterns I see having read half of nih.gov going down many rabbit holes of researchers scratching each others backs, pencil whipping reviews and such. Can LLM's pick up on such behavior or might that require something closer to human intelligence? I do not know enough about LLM's to even guess. Could it perhaps at least pick up on entirely fake papers from Youtubers pranking the system to see if they can get their silliest papers published? I report them but by the time they are taken down the Youtubers have had a large number of views and laughs.