The Detection–Extraction Gap: Models Know the Answer Before They Can Say It

Hanyang Wang, Mingxuan Zhu · 2026

Read The Detection–Extraction Gap: Models Know the Answer Before They Can Say It by Hanyang Wang, Mingxuan Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06613.txt.

Introduction

Wang and Zhu show reasoning models often know the answer long before they stop talking. Across five setups, two model families, and three benchmarks, 52 to 88 percent of chain-of-thought tokens come after the answer is already recoverable. Free continuations from early prefixes recover the answer even at a tenth of the trace, while forced extraction fails in 42 percent of such cases. Their Black-box Adaptive Early Exit method cuts 70 to 78 percent of serial generation while lifting accuracy, using free continuations to spot and pull out the answer.

Catalog record

CREATORHanyang Wang, Mingxuan Zhu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76154
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.06613

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Detection–Extraction Gap: Models Know the Answer Before They Can Say It Hanyang Wang, Mingxuan Zhu Abstract Modern reasoning models continue generating long after the answer is already determined. Across five model configurations, two families, and three benchmarks, we find that 52–88% of chain-of-thought tokens are produced after the answer is recoverable from a partial prefix. This post-commitment generation reveals a structural phenomenon: the detection–extraction gap . Free continuations from early prefixes recover the correct answer even at 10% of the trace, while forced extraction fails on 42% of these cases. The answer is recoverable from the model state, yet prompt-conditioned decoding fails to extract it. We formalize this mismatch via a total-variation bound between free and forced continuation distributions, yielding quantitative estimates of suffix-induced shift. Exploiting this asymmetry, we propose Black-box Adaptive Early Exit ( baee ), which uses free continuations for both detection and extraction, truncating 70–78% of serial generation while improving accuracy by 1–5 pp across all models. For thinking-mode models, early exit prevents post-commitment overwriting, yielding gains of up to 5.8 pp; a cost-optimized variant achieves 68–73% reduction at a median of 9 API calls. Code is available at https://github.com/EdWangLoDaSc/know2say . 1 Introduction Modern reasoning models often generate thousands of tokens after the answer is already determined; this behavior is widespread, not a rare edge case. The majority of chain-of-thought (CoT) tokens are generated after the correct answer is already robustly recoverable from a partial prefix (Figure 1 a). Prior work has established this via internal probes ( 3 ; 25 ; 7 ) , but those approaches require open-weight access. Using only black-box API access (§ 3 ), we confirm the phenomenon and reveal a surprising structure beneath it. Figure 1: Two core findings. (a) Commitment map for 32B-Think: 69% of CoT tokens follow the commitment boundary (75% under PSC threshold; Table 2 ). (b) The detection–extraction gap: psc detects recoverability from 10% prefix, yet efa fails to extract on 42% of these problems. baee exploits this structure for 70–78% serial reduction with 1–5 pp accuracy gains (§ 4.5 ). Our central finding is the detection–extraction gap , a structural mismatch between what the model’s state encodes and what constrained decoding can elicit . The model “knows” the answer but cannot “say” it when forced: free continuations recover the answer, while forced extraction fails on nearly half of the same problems. We relate measured gaps to suffix-induced shift through a TV inequality (Proposition 2 ; § 4.2 ) and confirm three predictions across models, benchmarks, and suffix variants. The gap has immediate practical consequences: any early-exit strategy that forces extraction inherits this failure mode, dropping accuracy by 41–62 pp (§ 4.5 ). psc -triggered Black-box Adaptive Early Exit ( baee ) uses free continuations for both detection and extraction, reducing 70–78% of serial generation while improving accuracy by 1–5 pp on all models, with up to +5.8 pp gains on thinking models via overthinking prevention. Using four black-box probes ( psc , efa , atlt , ed ; § 3 ) that require only sampling or logprob API access, our contributions are: 1. The detection–extraction gap : behavioral recoverability ( psc ) and forced extractability ( efa ) diverge structurally on partial traces; we formalize the gap via a lower bound on suffix-induced distributional shift (Proposition 2 ; Appendix J ) and confirm three quantitative predictions across suffix variants and prefix lengths (§ 4.2 ; Appendix I ). Across two model families, three benchmarks, and five configurations, the gap behaves as a structural property rather than model-specific artifact. 2. Task-topology-dependent commitment structure : psc trajectories are non-monotone on closed-form tasks (MATH-500) but monotone on sustained reasoning tasks (GPQA-Diamond); the Think–NoThink commitment gap collapses on code generation (HumanEval). These patterns show how task structure governs when and how answers become recoverable (§ 4.3 ; Appendices G , Q ). 3. baee : an early-exit policy that exploits the gap by using free continuations for both detection and extraction, achieving 70–78% serial reduction while improving accuracy by 1–5 pp; for thinking-mode models, gains reach 5.8 pp by interrupting post-commitment overthinking (§ 4.5 ). 2 Related Work We organize related work into three categories. White-box probing requires internal model access: 3 detect early commitment via hidden-state probes, 25 find self-verification signals in residual streams, and 7 show answers are encoded before any CoT begins; these methods are limited to open-weight models and cannot observe the detection–extraction gap, which is only visible through generation behavior. CoT faithfulness and self-consistency provide the conceptual foundation: reasoning traces need not faithfully reflect internal decisions ( 18 ; 2 ; 12 ; 9 ) , a decoupling that maps directly onto our gap. However, this literature studies faithfulness at the problem level (does the trace reflect the decision?) without probing when during generation the answer becomes recoverable. psc extends self-consistency decoding ( 20 ) and agreement-as-confidence methods ( 22 ; 13 ; 17 ) by producing a recoverability trajectory across prefix fractions, enabling the gap analysis that prior SC methods cannot perform. Inference-time early exit and overthinking covers layer-level exits ( 6 ; 10 ) , adaptive test-time compute ( 14 ) , and sequence-level truncation ( 15 ; 8 ; 16 ; 11 ; 26 ) ; 24 monitor token-level confidence (semi-white-box) and 21 probe step necessity. These methods optimize when to exit but do not ask why naïve extraction fails : none can observe the detection–extraction gap, which emerges only when comparing free-continuation and forced-extraction probes on the same prefix. This gap is our central structural contribution; baee is its practical consequence (Pareto comparison with DEER in Appendix R ). 3 Method Given a problem p and a full rollout y_{1:T} ( T tokens), we define a checkpoint grid F=\{f_{1},\ldots,f_{m}\}\subset(0,1) with prefix length k_{f}=\lfloor f\cdot T\rfloor . At each checkpoint, we probe the prefix using two core protocols (sampling-only) and two auxiliary diagnostics (logprob-based). Figure 2 illustrates the complete pipeline. Figure 2: Method pipeline. At prefix fraction f{=}0.1 , psc (free continuation) recovers the correct answer 82% of the time, while efa (forced extraction) succeeds on only 34%. baee uses free continuations for both detection and extraction, sidestepping the gap entirely. 3.1 Core Protocols Early Forced Answering ( efa ). efa tests whether the correct answer can be forced out of a prefix by appending an answer-inducing suffix: \textsc{efa}{}(p,\,c_{1:k})=\texttt{greedy\_decode}\!\left(p\oplus c_{1:k}\oplus\texttt{``\textbackslash nTherefore, the final answer is \textbackslash boxed\lx@text@lbrace''}\right) (1) Decoding stops at the first } or after 64 tokens. efa measures forced extractability : can the model produce the correct answer when explicitly asked? Prefix Self-Consistency ( psc ). psc tests whether the answer is naturally recoverable by sampling N=8 independent continuations from prefix c_{1:k} : \textsc{psc}{}(p,\,c_{1:k})=\frac{1}{N}\sum_{i=1}^{N}\mathbbm{1}\!\left[\text{correct}\!\left(\text{sample}_{i}(p\oplus c_{1:k})\right)\right] (2) psc operationalizes recoverability as a Monte Carlo estimator of a well-defined distributional quantity: Proposition 1 (PSC concentration) . Let p_{k}:=P_{\mathrm{free}}(a^{*}\mid c_{1:k}) . Since the N samples are i.i.d., \mathrm{PSC}_{N}(k) is unbiased for p_{k} with P(|\mathrm{PSC}_{N}(k)-p_{k}|\geq\varepsilon)\leq 2e^{-2N\varepsilon^{2}} (Hoeffding). At N{=}8 : within \pm 0.25 of p_{k} with probability \geq 91\% . Unlike efa , psc injects no forced context. Unlike standard SC ( 20 ) , it produces a trajectory \{\textsc{psc}{}(f)\}_{f\in F} revealing when commitment emerges, enabling the detection–extraction gap analysis (§ 4.2 ).

Read the complete text