How Open Must Language Models be to Enable Reliable Scientific Inference?

James A. Michaelov, Catherine Arnett, Tyler A. Chang, Pamela D. Rivière, Samuel M. Taylor, Cameron R. Jones, Sean Trott, Roger P. Levy, Benjamin K. Bergen, Micah Altman · 2026

Read How Open Must Language Models be to Enable Reliable Scientific Inference? by James A. Michaelov, Catherine Arnett, Tyler A. Chang, Pamela D. Rivière, Samuel M. Taylor, Cameron R. Jones, Sean Trott, Roger P. Levy, Benjamin K. Bergen, Micah Altman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26539.txt.

Description

Michaelov and co-authors ask how open a language model must be for science built on it to stay reliable. They sort the ways hidden details of a model's build and deployment can threaten inference. Closed models, they argue, are mostly ill-suited to research, with a few clear exceptions. For each threat they discuss fixes or ways to soften the risk. They urge researchers to name threats and mitigations up front, and to justify why a given model was chosen for a study.

Catalog record

CREATORJames A. Michaelov, Catherine Arnett, Tyler A. Chang, Pamela D. Rivière, Samuel M. Taylor, Cameron R. Jones, Sean Trott, Roger P. Levy, Benjamin K. Bergen, Micah Altman
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38104
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26539

Browse the full library · About the Tower of Babel