Why ArXiv is Cracking Down on AI-Generated Research

ArXiv’s new policy stems from a broader concern in the academic community: the rise of AI-assisted research that lacks human oversight. While tools like ChatGPT and other LLMs can accelerate drafting, summarizing, or even generating preliminary ideas, they are not designed to replace critical human review. Common issues include:

• Hallucinated references: AI-generated citations that don’t exist or misrepresent real sources.
• Plagiarized or incoherent text: LLM outputs that reuse phrases without attribution or contain logical inconsistencies.
• Meta-comments from AI: Prompts or internal notes left by AI tools within the paper, signaling insufficient human curation.
• Biased or erroneous content: AI outputs that reflect training biases or contain factual inaccuracies.

As Dietterich noted on X (formerly Twitter), “If generative AI tools generate inappropriate language, plagiarized content, biased content, errors, or misleading content, and that output is included in scientific works, it is the responsibility of the author(s).” The policy explicitly states that authors must take full responsibility for their submissions, regardless of how the content was generated.

The New Penalties: What Happens If You Submit AI Slop?

ArXiv’s enforcement will be rigorous. Authors caught submitting papers with “incontrovertible evidence” of unchecked LLM generation will face:

• A one-year ban from ArXiv. During this period, the author cannot submit new preprints to the platform.
• Mandatory peer-review acceptance for future submissions. After the ban, any new ArXiv submissions must first be accepted at a reputable peer-reviewed journal or conference.

This policy aligns with ArXiv’s existing Code of Conduct, which emphasizes that authors must vouch for the integrity of their work. The shift reflects a growing industry-wide push to ensure that AI tools are used as assistants—not replacements—for human expertise.

How Will ArXiv Detect AI-Generated Content?

While ArXiv does not use automated AI detection tools (such as those developed by companies like Turnitin or Crossref), its moderators will rely on:

• Human review: Experts in each field will scrutinize submissions for signs of unchecked AI output, such as inconsistent citations, nonsensical claims, or internal AI prompts.
• Community reporting: Researchers and reviewers can flag suspicious papers, triggering further investigation.
• Pattern recognition: Repeated submissions from the same author with similar AI-related issues may raise red flags.

Dietterich clarified that the burden of proof lies with the authors: “If we can’t trust anything in the paper, we have no choice but to impose penalties.” This approach prioritizes transparency and accountability over automated enforcement.

What This Means for Researchers and the Future of AI in Academia

The policy sends a clear message: AI tools are valuable for research, but they must be used responsibly. Here’s how researchers can adapt:

• Use AI as a drafting tool, not a final product. LLMs can help generate ideas or initial drafts, but human review is essential for accuracy and integrity.
• Fact-check all AI-generated content. Verify citations, data, and claims independently before submission.
• Avoid leaving AI prompts or internal notes in submissions. Clean up any traces of AI assistance to prevent detection as “slop.”
• Consider peer-review before preprint submission. If a paper contains significant AI-generated content, seeking peer review first may mitigate risks.

Beyond ArXiv, this policy could influence other preprint repositories and journals. Platforms like bioRxiv and chemRxiv may adopt similar measures as the academic community grapples with the ethical use of generative AI.

Key Takeaways

• ArXiv’s new policy imposes a one-year ban for submissions with unchecked AI-generated content.
• Future submissions by banned authors must be peer-reviewed before ArXiv acceptance.
• The focus is on human responsibility, not automated detection.
• AI tools are allowed but must be vetted—hallucinations, plagiarism, and meta-comments are red flags.
• This policy may set a precedent for other academic repositories.

FAQ: ArXiv’s AI Slop Policy

1. What counts as “AI slop” under ArXiv’s new policy?

AI slop refers to unchecked LLM-generated content that includes:

• Hallucinated or fabricated references.
• Plagiarized or incoherent text.
• Internal AI prompts or meta-comments left in the paper.
• Biased, erroneous, or misleading information.

2. Will ArXiv use AI detection tools to enforce this policy?

No. ArXiv will rely on human moderators and community reporting to identify suspicious submissions. Automated tools are not part of the enforcement process.

3. Can I still use AI tools for research?

Yes, but you must review and verify all AI-generated content before submission. Remove any AI prompts or internal notes, and ensure citations and claims are accurate.

4. What if my paper was partially generated by AI?

If AI contributed significantly, consider seeking peer review first or disclosing AI assistance transparently. ArXiv’s policy targets unchecked AI output, not responsible use.

5. Will this policy affect other fields beyond computer science?

While initially rolled out in the computer science section, ArXiv may expand enforcement to other fields if AI slop becomes widespread. Researchers in all disciplines should treat AI-generated content with caution.