Sound Agentic Science Requires Adversarial Experiments

Dionizije Fa, Marko Culjak · 2026

Read Sound Agentic Science Requires Adversarial Experiments by Dionizije Fa, Marko Culjak (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22080.txt.

Description

Fa and Culjak argue that LLM-based agents, fast-spreading in scientific data analysis, speed a known failure. They enable the rapid production of plausible endless rewrites, turning hypothesis space into claims backed by hand-picked work. Tests that could have disproven the claim never ran or never appeared. The authors propose a fail-first rule for lab-free claims made with agent help. Agents should hunt for failure modes of the claim, not craft the most compelling narrative.

Catalog record

CREATORDionizije Fa, Marko Culjak
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23531
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22080

Browse the full library · About the Tower of Babel