Using OSF storage as a proxy. The title is a bit clickbait, that alone gives you an idea of the incentives that cause people to publish when they don’t have something. Not to take away from the premise, but people already know there are some fields where faking is rampant.
An interesting paper would take the existing LLMs and see how well they can do flagging problematic work. A solution that works well at scale is needed.
Heck, an AI assistant to aid peer review would be great.
An interesting paper would take the existing LLMs and see how well they can do flagging problematic work.
I would like to see this as well. I would be curious if LLM's start to see the same patterns I see having read half of nih.gov going down many rabbit holes of researchers scratching each others backs, pencil whipping reviews and such. Can LLM's pick up on such behavior or might that require something closer to human intelligence? I do not know enough about LLM's to even guess. Could it perhaps at least pick up on entirely fake papers from Youtubers pranking the system to see if they can get their silliest papers published? I report them but by the time they are taken down the Youtubers have had a large number of views and laughs.
An interesting paper would take the existing LLMs and see how well they can do flagging problematic work. A solution that works well at scale is needed.
Heck, an AI assistant to aid peer review would be great.