Breaking
World leaders gather for emergency summit on climate crisis • Tech giants announce major breakthrough in fusion energy • Stocks reach all-time high as global trade recovers • Global News 24 launches premium news experience • Stay updated with real-time headlines •
BACK TO NEWS
Technology5 days ago

ArXiv will ban researchers who upload papers full of AI slop

The Verge
The Verge

Verified Publisher

ArXiv will ban researchers who upload papers full of AI slop

ArXiv, a popular platform for preprint academic research, is taking a new step to attempt to reduce the volume of papers that include AI slop. If a paper has "incontrovertible evidence that the authors did not check the results of LLM generation," such as hallucinated references or "meta-comments" left by an LLM, authors will be […]

Science AI News ArXiv will ban researchers who upload papers full of AI slop Leaving AI prompts or other ‘incontrovertible evidence’ will make it harder to use the site going forward.

Leaving AI prompts or other ‘incontrovertible evidence’ will make it harder to use the site going forward.

ArXiv, a popular platform for preprint academic research, is taking a new step to attempt to reduce the volume of papers that include AI slop.

If a paper has “incontrovertible evidence that the authors did not check the results of LLM generation,” such as hallucinated references or “meta-comments” left by an LLM, authors will be banned from ArXiv for a year, according to Thomas Dietterich, ArXiv’s section chair of its computer science section. Future ArXiv submissions will also have to be accepted at “a reputable peer-reviewed venue.” Here’s what he said on X : Attention @arxiv authors: Our Code of Conduct states that by signing your name as an author of a paper, each author takes full responsibility for all its contents, irrespective of how the contents were generated.

If generative AI tools generate inappropriate language, plagiarized content, biased content, errors, mistakes, incorrect references, or misleading content, and that output is included in scientific works, it is the responsibility of the author(s).

We have recently clarified our penalties for this. If a submission contains incontrovertible evidence that the authors did not check the results of LLM generation, this means we can’t trust anything in the paper.

The penalty is a 1-year ban from arXiv followed by the requirement that subsequent arXiv submissions must first be accepted at a reputable peer-reviewed venue.

Examples of incontrovertible evidence: hallucinated references, meta-comments from the LLM (“here is a 200 word summary; would you like me to make any changes?”; “the data in this table is illustrative, fill it in with the real numbers from your experiments”) Authors can appeal ban decisions, Dietterich told 404Media . He also noted that this policy will only apply “to cases of incontrovertible evidence” and that “our internal process requires first a moderator to document the problem and then for the Section Chair to confirm before imposing the penalty.” Related AI-generated research papers are overwhelming peer review Last year, ArXiv also updated its policies to reduce AI slop by only allowing computer science review articles and position papers to be published if they have been peer reviewed and have been accepted at a conference or a journal. “The advent of large language models have made this type of content relatively easy to churn out on demand, and the majority of the review articles we receive are little more than annotated bibliographies, with no substantial discussion of open research issues,” ArXiv said at the time .

Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.

Jay Peters AI News Science Most Popular Most Popular Microsoft starts canceling Claude Code licenses Leaked images reveal Xbox Elite 3 controller with mysterious new buttons Leaked images show Microsoft’s new Xbox Cloud Gaming controller Use this map to find the data centers in your backyard Closing time The Verge Daily A free daily digest of the news that matters most.

Email (required) Sign Up By submitting your email, you agree to our Terms and Privacy Notice .

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Advertiser Content From This is the title for the native ad

Read original story at The Verge

Continue reading this article on the publisher's website.

Visit Website

More from The Verge

SpaceX just filed for what could be the biggest IPO ever
Technology
The Verge
The Vergeabout 2 hours ago1 min read

SpaceX just filed for what could be the biggest IPO ever

Elon Musk's final frontier is officially open for business now that SpaceX has formally filed its S-1 prospectus with the SEC. That kicks off what could be the largest initial public offering ever when it lists on the Nasdaq stock exchange with the ticker SPCX. According to the filing, SpaceX generated $18.67 billion in revenue […]

‘Solve all diseases,’ you say?
Technology
The Verge
The Vergeabout 2 hours ago1 min read

‘Solve all diseases,’ you say?

This is Optimizer, a weekly newsletter sent from Verge senior reviewer Victoria Song that dissects and discusses the latest gizmos and potions that swear they're going to change your life. This week's issue is a special early edition tied to The Verge's Google I/O coverage. You can expect our next issue at its usual time […]

I’ve tested the latest Switch 2 controllers, and this one is the best
Technology
The Verge
The Vergeabout 5 hours ago1 min read

I’ve tested the latest Switch 2 controllers, and this one is the best

If you choose to get an extra controller for your Nintendo Switch 2, you can spend a lot — and get a lot in return. Buying Nintendo’s own $89 Switch 2 Pro Controller, for instance, will net you the console’s only wireless controller with a 3.5mm headphone jack for private listening, not to mention great-feeling […]