Position: Prioritize Identifying Structure, Not Complex Models, for Scientific Discovery
Tyler H. McCormick · 2026
Read Position: Prioritize Identifying Structure, Not Complex Models, for Scientific Discovery by Tyler H. McCormick (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02632.txt.
Description
McCormick argues that science with machine learning should hunt structure, not build ever more complex models. Large language models now draft hypotheses and mechanistic stories from observational data. In high-dimensional proxy regimes, that search is underdetermined. Many incompatible mechanisms yield the same observational patterns. Predictive success then proves little about mechanism. Coherent explanations prove little as well.
Language models add a special hazard. They collapse wide classes of rival explanations into one fluent narrative. The paper proposes concrete standards for mechanistic machine learning. The norms would let model-centered workflows support science rather than simulate it. The position reframes what counts as discovery. Fluency is not evidence. Structure that survives the equivalence class is. The paper offers a yardstick for judging future claims of machine-found mechanisms.
Catalog record
| CREATOR | Tyler H. McCormick |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02632