Read Your Own Mind: Reasoning Helps Surface Self-Confidence Signals in LLMs
Jakub Podolak, Rajeev Verma · 2025
Read Read Your Own Mind: Reasoning Helps Surface Self-Confidence Signals in LLMs by Jakub Podolak, Rajeev Verma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23845.txt.
Introduction
Jakub Podolak and Rajeev Verma ask why a reasoning model's spoken confidence is so often wrong, and how to fix it. DeepSeek R1, asked for an answer and then its confidence, is regularly overconfident, while sampling-based semantic entropy stays reliable. Their hypothesis: entropy works because it spends compute exploring the model's spread of possible answers.
Give the model a long forced chain of thought before answering, and its verbal confidence sharpens dramatically, even on simple fact questions that need no reasoning. A separate reader shown only the chain reconstructs nearly the same confidence scores, suggesting the spoken number is a summary of the alternatives the reasoning surfaced. Reliable self-knowledge, the authors conclude, requires explicit exploration first.
Catalog record
| CREATOR | Jakub Podolak, Rajeev Verma |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23845
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Read Your Own Mind: Reasoning Helps Surface Self-Confidence Signals in LLMs Jakub Podolak, Rajeev Verma Abstract We study the source of uncertainty in DeepSeek R1-32B by analyzing its self-reported verbal confidence on question answering (QA) tasks. In the default answer-then-confidence setting, the model is regularly over-confident, whereas semantic entropy—obtained by sampling many responses—remains reliable. We hypothesize that this is because of semantic entropy’s larger test-time compute, which lets us explore the model’s predictive distribution. We show that granting DeepSeek the budget to explore its distribution by forcing a long chain-of-thought before the final answer greatly improves its verbal score effectiveness, even on simple fact-retrieval questions that normally require no reasoning. Furthermore, a separate reader model that sees only the chain can reconstruct very similar confidences, indicating the verbal score might be merely a statistic of the alternatives surfaced during reasoning. Our analysis concludes that reliable uncertainty estimation requires explicit exploration of the generative space, and self-reported confidence is trustworthy only after such exploration. 1 Introduction Generative language models (GLMs) like GPT, LLaMA, or Deepseek families have achieved great performance on diverse tasks ( Dubey et al. 2024 ; DeepSeek-AI et al. 2025 ) , yet they are prone to failure modes such as ”hallucinations” ( Huang et al. 2023 ) . These inaccuracies can undermine trust and lead to poor decisions in LLM-assisted systems ( Huang et al. 2024 ) . To mitigate this issue, quantification and the communication of model’s uncertainty in its outputs is seen as a potential to entrust these models with reliability. Figure 1: DeepSeek R1-32B’s Verbalized Confidence (VC) improves and matches Semantic Entropy’s (SE) effectiveness, when longer reasoning is forced. . Our work suggests that it is the test-time exploration of the model’s predictive space, not the particular uncertainty heuristic, that makes confidence estimates reliable. Numerous uncertainty-quantification (UQ) approaches have been proposed in this direction. The most natural one of such methods is Semantic Entropy (SE), which essentially constructs a sample access approximation of the model’s predictive distribution by Monte-Carlo sampling many answers, and using the entropy of the distribution as a measure of uncertainty ( Farquhar et al. 2024 ) . Yet, there is also a popular trend of prompting the model directly to elicit its confidence as a measure of generation correctness, for example, ”I’m 85% confident,” — an approach referred to as Verbalized Confidence estimation (VC) ( Xiong et al. 2024 ) . While Verbalized Confidence estimation is easy to use, there is no scientific consensus on what it represents or what its source is, potentially making it unreliable to use in critical scenarios. Furthermore, prior work has shown that Verbalized Confidence is often pathological - for the same question a model might first return “Answer A (100 % confidence)” and, in a second sample, “Answer B (95 % confidence),” even though these probabilities cannot coexist ( Xiong et al. 2024 ) . On a more practical side, verbalized scores are also reported to often be over-confident ( Yang et al. 2024 ; Pawitan & Holmes 2024 ) , whereas Semantic Entropy remains comparatively well calibrated ( Farquhar et al. 2024 ) . Semantic Entropy’s effectiveness can be attributed to its test-time compute—allocating extra tokens at inference ( Snell et al. 2024 ) to explore the predictive distribution. Test-time compute can also come in the form of an extended reasoning chain that precedes the final answer ( Wei et al. 2023 ; DeepSeek-AI et al. 2025 ) , and most recent works show that such reasoning can improve verbalized or token-level calibration as well ( Zeng et al. 2025 ; Jurayj et al. 2025 ) . These findings prompted us to pose a hypothesis: Is the model able to directly quantify and express verbally its uncertainty, or is the test-time token exploration necessary for the model to reliably summarize its confidence? In this paper, we try to answer this question and better understand the source of Verbalized Confidence by performing a set of experiments with DeepSeek R1-32B (distilled Qwen-32B) ( DeepSeek-AI et al. 2025 ) as a representative model. We use 270 QA items drawn from five popular datasets, covering both reasoning-heavy problems and straightforward fact retrieval. Our results show that without any chain-of-thought, DeepSeek ’s verbalized scores carry little information about correctness. As we grant the model progressively larger reasoning budgets, its calibration improves and approaches the reliability of Semantic Entropy, even on simple fact-retrieval items. This trend suggests that meaningful uncertainty estimates emerge only after the model’s predictive space has been explored, and that the final confidence percentage largely summarizes the diversity exposed in this process. We further enforce this hypothesis by using a separate reader model that, by just analyzing DeepSeek ’s reasoning trace, matches the reliability of DeepSeek ’s own Verbalized Confidence. We hope that our work will help researchers and practitioners better understand the limitations of Verbalized Confidence, and encourage them to use more UQ techniques that utilize additional test-time compute. 2 Background and Related Work Generative language models frequently generate fluent but incorrect answers that can cause downstream harm ( Band et al. 2024 ; Huang et al. 2024 ) . These errors arise from objectives that reward fluency over factuality ( McCoy et al. 2023 ; McKenna et al. 2023 ; Wan et al. 2023 ) , gaps or biases in pre-training data ( Baan et al. 2023 ; Ji et al. 2024 ) , or decoding that relies more on marginal probability than crucial context ( Sadat et al. 2023 ; van der Poel et al. 2022 ) . When no external verifier is available, a model’s self-reported confidence is the only proxy for correctness, making reliable uncertainty estimates essential. Calibration of LLM Confidence Scores. A confidence score is calibrated if, for example, predictions tagged “80 % confident” are correct roughly 80 % of the time. Because confidence in LLMs can be extracted at several levels, there is no single way of measuring the calibration. Common approaches to obtain the scores include token-level probabilities treated as a classification score ( Dhuliawala et al. 2022 ) , semantic-level measures that evaluate agreement across multiple sampled completions ( Farquhar et al. 2024 ) , and explicitly verbalized percentages in a model’s output ( Xiong et al. 2024 ; Tian et al. 2023 ) . Semantic Entropy as a way of getting Calibrated Confidence Scores. A generative model, given a question Q , defines a distribution over semantically distinct answers P(A\mid Q) . The uncertainty of this distribution is naturally quantified by its Shannon entropy, and while computing it exactly is infeasible, we can approximate it by Monte-Carlo sampling and clustering semantically equivalent answers. This is exactly how the Semantic Entropy (SE) method ( Farquhar et al. 2024 ) works, leading to better calibrated scores than e.g., asking the model itself if the generated answer was correct. The big downside of this method is that it requires sampling data on test-time (larger test-time-compute budget). Verbalized vs. Intrinsic Model Confidence. Another way to obtain a confidence score is simply to ask the model for one, for instance, “I am 85 % sure.” This Verbalized Confidence (VC) is easy to collect and works with any black-box API ( Xiong