On the Effect of Uncertainty on Layer-wise Inference Dynamics
Sunwoo Kim, Haneul Yoo, Alice Oh · 2025
Read On the Effect of Uncertainty on Layer-wise Inference Dynamics by Sunwoo Kim, Haneul Yoo, Alice Oh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06722.txt.
Description
Sunwoo Kim, Haneul Yoo, and Alice Oh probe how uncertainty moves through a language model's layers in a 2025 paper. Models are known to encode their own uncertainty in hidden states, which could help detect hallucinations. Whether that uncertainty changes how the model processes information layer by layer was underexplored.
Using a tool called the Tuned Lens, the team watched output probabilities evolve across layers for certain and uncertain answers. The dynamics were largely aligned in both cases. The finding suggests uncertainty is recorded in the model without rerouting its computation, a useful fact for anyone building hallucination detectors.
Catalog record
| CREATOR | Sunwoo Kim, Haneul Yoo, Alice Oh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-06722