CALIBER: Calibrating Confidence Before and After Reasoning in Language Models
name=Conor Finlay \fa, affiliation=1, name=Joshua Kurien \fa, affiliation=1, name=Saurabh Dash, affiliation=1, name=Marzieh Fadaee \psa, affiliation=1, name=Beyza Ermis \psa, affiliation=1 · 2026
Read CALIBER: Calibrating Confidence Before and After Reasoning in Language Models by name=Conor Finlay \fa, affiliation=1, name=Joshua Kurien \fa, affiliation=1, name=Saurabh Dash, affiliation=1, name=Marzieh Fadaee \psa, affiliation=1, name=Beyza Ermis \psa, affiliation=1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24281.txt.
Introduction
Finlay and colleagues argue that a reasoning model's confidence means two different things, before and after it thinks. Before thinking, a confidence estimate should forecast the chance of solving the prompt at all. After answering, it should judge whether this particular realised answer is correct. Existing practice asks only once, conflating the two targets and supervising both with the wrong labels.
CALIBER elicits both estimates. Each is supervised with the target matching its information state: prompt-level success rates for the early estimate, per-answer correctness for the late one. Under this unified protocol, expected calibration error falls by more than half against the strongest single-confidence baseline, on a digit-arithmetic benchmark for the mid-size model tested. Finlay's 2026 message for builders of reasoning systems is simple. When you ask a model how sure it is determines what its answer can honestly mean.
Catalog record
| CREATOR | name=Conor Finlay \fa, affiliation=1, name=Joshua Kurien \fa, affiliation=1, name=Saurabh Dash, affiliation=1, name=Marzieh Fadaee \psa, affiliation=1, name=Beyza Ermis \psa, affiliation=1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.24281
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CALIBER: Calibrating Confidence Before and After Reasoning in Language Models name=Conor Finlay \fa, affiliation=1, name=Joshua Kurien \fa, affiliation=1, name=Saurabh Dash, affiliation=1, name=Marzieh Fadaee \psa, affiliation=1, name=Beyza Ermis \psa, affiliation=1 Abstract Reasoning language models are increasingly asked not only to answer difficult questions, but also to estimate their likelihood of success. Existing methods typically elicit confidence only once: either before thinking or after answering. We argue that confidence in reasoning models is state-dependent: before thinking, confidence should estimate the chance of the model correctly solving the prompt, while after thinking it should predict whether the realized answer is likely to be correct. This distinction determines the appropriate supervision target: prompt-level success should supervise confidence estimates made after seeing the prompt, while individual answer-level correctness should supervise confidence estimates made after answering. We introduce CALIBER (Calibration Before and After Reasoning), which elicits both estimates and supervises each with the target matched to its information state. Under this unified protocol, CALIBER reduces Expected Calibration Error (ECE) by 52.5% over the strongest single-confidence baseline on BigMathDigits for the 7B model, while achieving the best Brier score and AUROC, and remains within 2.1 points of the best accuracy. Further, on a larger 30B model, CALIBER achieves the best ECE on BigMathDigits while remaining competitive in Brier score and AUROC. Out of distribution, it achieves the best ECE and Brier score on GPQA and TriviaQA, and remains competitive on SimpleQA. Ablations further show that this position–target alignment is most beneficial under distribution shift where it consistently reduces calibration error across all out-of-distribution benchmarks. \affiliations Cohere Labs \corresponding [*]{ beyza , marzieh } {@cohere.com} 1 Introduction Large language models increasingly solve complex tasks through extended thinking. In many applications, a model needs not only to answer, but also to reliably estimate whether its answer is correct. A well-calibrated model signals to users how trustworthy its answers are, supports verification of low-confidence answers, and can be deployed more safely in settings where incorrect answers are costly [ 6 ; 8 ; 16 ] . Prior LLM calibration work explores several confidence elicitation strategies, including token probabilities, consistency across sampled responses, and explicit verbalized confidence [ 11 ; 19 ; 13 ; 25 ] . We focus on verbalized confidence, where the model reports an explicit probability of correctness as part of its response, since such estimates can be easily extracted from reasoning models [ 26 ; 18 ; 9 ] . Reasoning models expose additional information beyond a single answer by including thinking traces alongside their answers, but standard calibration methods are typically designed for single-answer outputs. These extended thinking traces are produced before the model commits to a final response, so the model’s information state changes substantially between the start and end of generation. For reasoning models, the relevant probability concerns the correctness of a solution produced through a multi-step reasoning process. Thus, confidence before and after thinking estimate distinct quantities: the former estimates whether the current policy is likely to solve the prompt, while the latter estimates whether the realized answer is correct, taking into account the reasoning process that produced it. Because these estimates are produced with access to different information, they require different supervision targets. Recent methods address calibration in reasoning models through reinforcement learning with verifiable rewards (RLVR) [ 23 ; 15 ] . Methods vary along two axes: the position of the confidence estimate, either before thinking [ 17 ] or after thinking [ 5 ; 27 ] ; and the calibration target , either instance-wise correctness [ 5 ] , group-wise success across rollouts of the same prompt [ 27 ; 17 ] , or a hybrid of the two [ 20 ] . Existing methods choose one position and one target, but do not ask whether that pairing is optimal given the information state at which confidence is elicited. We argue that the appropriate supervision target is determined by elicitation position: pre-thinking confidence, which conditions only on the prompt, should be supervised against the prompt-level success rate, while post-thinking confidence, which additionally conditions on the realized trace and answer, should be supervised against the correctness of that realized response. Conflating these introduces a mismatch between what the model is asked to estimate and what it is trained to predict. We introduce CALIBER , a framework that elicits confidence both before and after reasoning and supervises each estimate with the calibration target matched to its information state. Rather than forcing a single estimate to serve two roles, the framework lets each one specialize: pre-confidence captures a model’s ability to solve the question, while post-confidence captures whether its stated answer is correct. The gap between them provides a per-example diagnostic of how thinking changes the model’s uncertainty. Isolating the contribution of position–target alignment requires a controlled setting, since prior methods differ simultaneously in confidence position, calibration target, credit assignment technique, and reinforcement learning (RL) algorithm. We therefore compare a controlled set of prior-inspired confidence-position and supervision-target pairings under a shared training and evaluation protocol. Across mathematical reasoning and question-answering benchmarks, CALIBER improves calibration without substantially sacrificing task performance. On BigMathDigits, CALIBER reduces ECE over the strongest single-confidence baseline by 52.5% for the 7B model and achieves the best ECE for the 30B model. These gains transfer out of distribution, where CALIBER obtains the best ECE and Brier score on GPQA and TriviaQA while remaining competitive on SimpleQA. Our contributions are: • We frame confidence in reasoning models as state-dependent: pre-thinking and post-thinking confidence correspond to distinct uncertainty quantities, question solvability and answer-level correctness, and naturally align with group-wise and instance-wise calibration targets respectively. • We introduce CALIBER , which emits both pre- and post-confidence estimates and supervises each with the supervision target matched to its information state. • We present a controlled comparison against prior calibration strategies under a shared protocol, isolating the contribution of position–target alignment from confounding design choices. • We analyze confidence updates by comparing pre- and post-thinking confidence as a per-example signal of how the model’s uncertainty evolves with thinking. 2 Related Work Confidence estimation for LLMs. Confidence estimation techniques for LLMs include token probabilities, sampling-based consistency, internal-state probes, and explicit verbalized confidence [ 7 ] . Token probabilities are easy to obtain, but the estimates are over token-level predictions rather than answer-level correctness [ 25 ] . Verbalized confidence instead asks the model to report a scalar estimate of the probability that its answer is correct. Prior work shows that models can be trained to express uncertainty in words [ 19 ] , with later methods improving confidence estimates through supervised fine-tuning, self-reflective rationales, confidence tuning, or distillation [ 12 ; 26 ; 18 ; 9 ] . Other work suggests that models may encode information about their own correctness internally, even when this information is not reliably surfaced in their responses [ 11 ; 14 ] . RLVR for calibrated verbalized confidence. A current trend for training calibrated reasoning models is to modify standard correctness objectives in RLVR to include calibration rewards [ 23 ; 15 ; 2 ] . Reinforcement Learning with Calibration Rewards (RLCR) augments the standard RLVR correctness reward with a Brier-score reward that encourages the model’s verbalized confidence for a rollout to