Reading Calibrated Uncertainty from Language Model Trajectories
Aliai Eusebi, Alexander Herzog, Xiaoyu Liang, Marie Vasek, Enrico Mariconti, Lorenzo Cavallaro · 2026
Read Reading Calibrated Uncertainty from Language Model Trajectories by Aliai Eusebi, Alexander Herzog, Xiaoyu Liang, Marie Vasek, Enrico Mariconti, Lorenzo Cavallaro (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22864.txt.
Introduction
Eusebi and five colleagues read calibrated uncertainty from the path a language model's representation takes through its layers, not just its final probabilities. They trace eleven scale-invariant geometric features of cumulative MLP updates and feed these to a sparse linear probe. The probe beat the standard maximum-probability baseline under selective abstention, gaining up to 21 points where miscalibration was worst. Its coefficients show which layers commit too early or drift from the endpoint.
Catalog record
| CREATOR | Aliai Eusebi, Alexander Herzog, Xiaoyu Liang, Marie Vasek, Enrico Mariconti, Lorenzo Cavallaro |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38075 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22864
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reading Calibrated Uncertainty from Language Model Trajectories Aliai Eusebi, Alexander Herzog, Xiaoyu Liang, Marie Vasek, Enrico Mariconti, Lorenzo Cavallaro Abstract The maximum softmax probability (MSP) represents a default approach when evaluating uncertainty quantification for language model generation with structured output. Although cheap, it is often miscalibrated. Methods that probe the model’s internal activations feed raw hidden states into opaque classifiers, reading activations as static snapshots and leaving implicit the layer-wise trajectory by which a representation is formed. Yet, similar endpoints can arise from very different paths, and how evidence accumulates, reinforces, or reverses across depth might reveal uncertainty that final probabilities obscure. We extract eleven scale-invariant geometric features, tracing the cumulative path of per-layer MLP updates, and feed them to a sparse linear probe. The probe outperforms MSP under selective abstention, with gains scaling with baseline miscalibration up to 21 AURC points. Because every feature has a closed-form geometric meaning, the probe’s coefficients trace how and where along depth errors take shape – which layers commit prematurely, which contradict the running state, where trajectories drift away from their endpoint. 1 Introduction A trustworthy language model should know when it might be wrong. Calibrated uncertainty quantification (UQ) captures this requirement: a model’s confidence should reflect its likelihood of being correct. Two equally accurate models can nevertheless differ substantially in reliability. If a model assigns low confidence to most of its errors, uncertain predictions can be deferred, abstained from, or escalated for human review. By contrast, when confidence is poorly aligned with correctness, high-confidence errors become indistinguishable from reliable predictions. In clinical triage, the first model would set its uncertain cases aside for a clinician to review; the second would queue a life-threatening case behind a routine one, both stamped high-risk with equally strong confidence. Calibrated uncertainty therefore serves a triage function, enabling uncertainty to guide which predictions warrant intervention or verification. The default approach to UQ in discrete choice settings is the Maximum Softmax Probability (MSP) ( 37 ; 8 ) , which uses the predicted token’s softmax probability as a confidence score. MSP incurs no additional computational cost and is often surprisingly competitive. However, it may inherit the well-known pathology of miscalibration: confidence scores that fail to reflect the true likelihood of correctness, often remaining high even when the prediction is wrong ( 16 ) . A parallel line of work reads from the model’s activations directly, on the premise that the internal computation leading to a generation carries information about its truthfulness that the output distribution alone does not. 2 demonstrated that a simple classifier trained on hidden activations can predict whether an LLM’s answer is truthful, and a growing body of work has since traced the contours of this “geometry of truth" ( 26 ; 33 ; 8 ; 29 ; 4 ; 3 ) . Yet across this literature, activations are typically read as static snapshots – a hidden state extracted from one layer, or averaged across layers, and analyzed for the information it contains. This discards the layer-wise trajectory by which the representation is formed. A final hidden state is the endpoint of a path through representation space, and similar endpoints may arise from qualitatively different trajectories. Some representations may develop steadily, others may emerge late, fluctuate, or be partially reversed before settling. These trajectories are not incidental to the prediction as they encode how evidence is accumulated, reinforced, attenuated, or revised across depth. We therefore read activations not only as states, but as representational trajectories; we show that their geometry reveals uncertainty that final probabilities alone may obscure. We calibrate by tracing the answer-position residual stream as the cumulative path induced by per-layer MLP write-vectors during the forward pass. We summarize this trajectory by computing scale-invariant geometric features and feed them to a sparse linear probe. Confidence-calibration is evaluated under selective abstention via AURC ( 12 ) . This leads to an interpretable UQ method that goes beyond single-point evaluation (MSP) while avoiding the opacity of dense probes on raw activations. To summarize, our main contributions are as follows: 1. We propose a compact set of geometric features that describe how representations evolve across network-depth, and feed them to a sparse linear probe that outperforms MSP under selective abstention, with gains scaling with the baseline’s miscalibration. 2. We consider end to end interpretability of the probe: each feature has a closed-form geometric meaning, and its coefficients reveal not only whether the model is likely to err but also how , which layers commit prematurely, which contradict the running state, and where trajectories drift away from their endpoint. We show that correct and wrong predictions sharing the same MSP score leave different trajectory signatures, exposing information otherwise flattened by the output distribution. 3. We perform a comprehensive set of empirical experiments across 9 instruction-tuned LLMs from three model families (Qwen, Llama, DeepSeek) spanning 3B to 72B parameters on five representative natural language processing tasks. Feature Formula Interpretation [0pt][0pt] Depth distribution Relative update magnitude \|m_{\ell}\|/\bar{n} Per-layer update size vs. the mean Cumulative path fraction T^{-1}\sum_{k\leq\ell}\|m_{k}\| Front- vs. back-loading of computation [0pt][0pt] Local trajectory shape Consecutive cosine \cos(m_{\ell-1},\,m_{\ell}) Directional consistency of updates Curvature 1-\cos(m_{\ell-1},\,m_{\ell}) Abrupt changes of direction Update–state alignment \cos(m_{\ell},\,s_{\ell-1}) Reinforcement vs. contradiction with prior state [0pt][0pt] Relation to endpoint \hat{u}=s_{L}/\|s_{L}\| Direction to final \cos(s_{\ell},\,s_{L}) State convergence to endpoint Update to final \cos(m_{\ell},\,s_{L}) Update alignment with endpoint direction Signed final support † \langle m_{\ell},\,\hat{u}\rangle/\|m_{\ell}\| Cosine alignment, magnitude-aware framing Contradictory support \max\bigl(0,\,-\langle m_{\ell},\,\hat{u}\rangle/\|m_{\ell}\|\bigr) Magnitude of opposition to endpoint Orthogonal mass fraction \sqrt{1-\cos^{2}(m_{\ell},\,s_{L})} Fraction of update orthogonal to endpoint [0pt][0pt] Efficiency Cumulative coherence \|s_{\ell}\|/\sum_{k\leq\ell}\|m_{k}\| Net displacement vs. path length Table 1: Eleven per-layer trajectory features grouped by what they measure. Symbols are defined in the text. Features involving m_{\ell-1} or s_{\ell-1} are undefined at \ell=1 and assigned conventional values ( 1 for Consecutive cosine , 0 for Curvature and Update-state alignment ). † Signed final support is numerically identical to Update to final ; both rows are retained because they correspond to distinct geometric formulations (the L1 probe is invariant to this). 2 Background 2.1 Uncertainty Quantification Predictive uncertainty is commonly decomposed into two components: epistemic uncertainty, which stems from limited data or model misspecification and in principle reducible, and aleatoric uncertainty, which reflects the intrinsic stochasticity of the data-generating process and therefore irreducible ( 21 ) . A related dichotomy has emerged in the LLM literature: factual uncertainty pertains to the correctness of generated content with respect to ground-truth knowledge, whereas semantic uncertainty arises from the multiplicity of valid continuations admitted by a prompt; the former is epistemic in nature, the latter aleatoric ( 30 ) . As factual uncertainty is the primary concern in automated decision-making ( 8 ) , we restrict our analysis to this component. We employ multiple-choice questions, which act as a noise-reduction mechanism that isolates factual gaps by neutralizing the semantic uncertainty found in open-ended text ( 27 ) . UQ methods aim to associate each prediction with a scalar score indicative of its correctness, enabling downstream decisions such as abstention, deferral, or selective generation. Existing approaches for LLM uncertainty estimation fall into three groups that differ primarily in computational cost. Single-sample methods derive uncertainty from a single forward pass, using signals such