Inducing Artificial Uncertainty in Language Models

Sophia Hager [email protected], Simon Zeng, Nicholas Andrews [email protected] · 2026

Read Inducing Artificial Uncertainty in Language Models by Sophia Hager [email protected], Simon Zeng, Nicholas Andrews [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13595.txt.

Description

Sophia Hager, Simon Zeng and Nicholas Andrews pose the problem of artificially inducing uncertainty in language models. Safety-critical uses need models that report uncertainty as meaningful probabilities. Supervised uncertainty methods need hard unseen data, scarce for models trained on vast scraped text. The authors test ways to induce artificial uncertainty on trivially easy data when no hard data exists at training time. Probes trained on artificial uncertainty beat plain probes at spotting real uncertainty, with higher calibration on hard data and minimal loss on easy data.

Catalog record

CREATORSophia Hager [email protected], Simon Zeng, Nicholas Andrews [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56140
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13595

Browse the full library · About the Tower of Babel