Inducing Artificial Uncertainty in Language Models
Sophia Hager [email protected], Simon Zeng, Nicholas Andrews [email protected] · 2026
Read Inducing Artificial Uncertainty in Language Models by Sophia Hager [email protected], Simon Zeng, Nicholas Andrews [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13595.txt.
Description
Sophia Hager, Simon Zeng and Nicholas Andrews pose the problem of artificially inducing uncertainty in language models. Safety-critical uses need models that report uncertainty as meaningful probabilities. Supervised uncertainty methods need hard unseen data, scarce for models trained on vast scraped text. The authors test ways to induce artificial uncertainty on trivially easy data when no hard data exists at training time. Probes trained on artificial uncertainty beat plain probes at spotting real uncertainty, with higher calibration on hard data and minimal loss on easy data.
Catalog record
| CREATOR | Sophia Hager [email protected], Simon Zeng, Nicholas Andrews [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56140 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13595