Position: Prioritize Identifying Structure, Not Complex Models, for Scientific Discovery

Tyler H. McCormick · 2026

Read Position: Prioritize Identifying Structure, Not Complex Models, for Scientific Discovery by Tyler H. McCormick (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02632.txt.

Description

McCormick argues that science with machine learning should hunt structure, not build ever more complex models. Large language models now draft hypotheses and mechanistic stories from observational data. In high-dimensional proxy regimes, that search is underdetermined. Many incompatible mechanisms yield the same observational patterns. Predictive success then proves little about mechanism. Coherent explanations prove little as well.

Language models add a special hazard. They collapse wide classes of rival explanations into one fluent narrative. The paper proposes concrete standards for mechanistic machine learning. The norms would let model-centered workflows support science rather than simulate it. The position reframes what counts as discovery. Fluency is not evidence. Structure that survives the equivalence class is. The paper offers a yardstick for judging future claims of machine-found mechanisms.

Catalog record

CREATORTyler H. McCormick
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.02632

Browse the full library · About the Tower of Babel