Detection Without Correction: A Two-Parameter Decomposition of Multi-Stage LLM Pipelines
Prashanti Nilayam, Kiran Ramanna, Prashil Tumbade · 2026
Read Detection Without Correction: A Two-Parameter Decomposition of Multi-Stage LLM Pipelines by Prashanti Nilayam, Kiran Ramanna, Prashil Tumbade (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27559.txt.
Introduction
Prashanti Nilayam, Kiran Ramanna, and Prashil Tumbade split multi-stage language model pipelines into detection and conditional generation. The key failure mode is detection without correction: the pipeline spots bad upstream content but still gives a flawed answer. Across four model families, four benchmarks, and two methods, miscorrection rates run from 53 to 94 percent while detection rates vary widely.
Catalog record
| CREATOR | Prashanti Nilayam, Kiran Ramanna, Prashil Tumbade |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53540 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27559
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Detection Without Correction: A Two-Parameter Decomposition of Multi-Stage LLM Pipelines Prashanti Nilayam, Kiran Ramanna, Prashil Tumbade Abstract Multi-stage LLM pipelines that perform multi-agent debate, intrinsic self-correction, or retrieval-augmented verification exhibit puzzling aggregate behaviors: accuracy plateaus and reversals across rounds, non-replication of debate gains on contemporary frontier models, intrinsic self-correction degradation, and qualitative cross-provider divergence in debate dynamics. Downstream agent response can be operationalized as two coupled decisions: detection (whether to treat upstream content as authoritative) and conditional generation (what to produce if not). This decomposition yields four observable response regimes, of which detection-without-correction is the load-bearing failure mode. Across a nine-cell empirical grid spanning four model families, four benchmarks (GSM8K, MATH-500, GPQA-Diamond, AIME), and two methods (multi-agent debate, intrinsic self-correction), we find that the conditional miscorrection rate is consistently dominant (53–94% across cohorts) while detection rate varies contextually by more than an order of magnitude. The framework unifies the four phenomena above as signatures of a common mechanism and characterizes detection threshold as a stable model/protocol-level regularity that persists across methods at matched benchmark difficulty. 1 Introduction Multi-stage LLM pipelines that perform multi-agent debate, intrinsic self-correction, or retrieval-augmented verification are deployed under an implicit assumption: downstream agents act as independent verifiers of upstream content, and aggregate accuracy improves when verification fires. The literature reports a constellation of phenomena that are surprising relative to this assumption. Multi-agent debate improves aggregate accuracy on math and reasoning tasks ( 5 ) , but gains plateau within a few rounds and may reverse; naive replication on contemporary frontier models reproduces neither, holding within \pm 0.7 pp of R_{0} across rounds for gpt-4.1 and gpt-4.1-mini on GSM8K (Appendix A ). Intrinsic self-correction degrades outputs on a non-trivial fraction of items ( 8 ) with magnitude varying across models and benchmarks in ways no current account predicts. And on identical inputs, different providers exhibit qualitatively distinct debate dynamics: detection rate spans more than an order of magnitude at matched benchmark difficulty (Appendix B ; § 4.2 ). These phenomena are typically described as model-specific or benchmark-specific behavior. We argue they share a common mechanism. Downstream agent response in a multi-stage pipeline can be operationalized as two coupled decisions: detection (whether to treat upstream content as authoritative) and conditional generation (what to produce if not). Conditioning on whether the upstream content was correct, this partitions agent responses into four observable regimes: BOUNDARY (correct upstream, propagated unchanged), IP (inherit-propagate; incorrect upstream, propagated unchanged), DC (detect-correct; incorrect upstream, revised to correct), and DM (detect-miscorrect; incorrect upstream, revised to an incorrect answer). The DM regime, which we term detection without correction , is the load-bearing failure mode: aggregate behaviors such as plateau, reverse, and intervention-induced degradation emerge from accumulation in this cell across rounds and agents. Detection rate is contextual : it varies with model capability, benchmark difficulty, and training-paradigm-conditional thresholds. Conditional miscorrection rate is consistently dominant : when detection fires on a non-trivial problem, the generated alternative is incorrect with probability exceeding 0.5 across the empirical grid (§ 4.1 , Table 3 ). We validate this asymmetry on a nine-cell grid spanning four model families and four benchmarks (§ 3 , Table 2 ): conditional miscorrection falls in 53–94% (Table 3 ); detection rate varies by more than an order of magnitude (Table 4 ). The joint behavior of these two parameters accounts for each puzzle above. Contributions. • We show that conditional miscorrection rate ( P(\text{DM}\mid D{=}1) ) is consistently dominant: its point estimate exceeds 0.5 in every one of 14 primary-analysis cohorts spanning four model families, four benchmarks, and two methods, falling in the 53–94% range, with the Wilson 95% lower bound above 0.5 in 13 of 14 cohorts. • We show that detection rate ( P(D{=}1) ) varies by more than an order of magnitude across the same cohorts, with both a within-model benchmark-difficulty gradient and a cross-paradigm asymmetry that persists across methods. • We introduce a detection-generation decomposition that organizes downstream agent response in multi-stage LLM pipelines into two coupled decisions—detection and conditional generation—yielding four observable regimes (BOUNDARY, IP, DC, DM); the DM regime (detect-miscorrect) is the load-bearing failure mode that the measurements above expose. • We unify four previously-separate observations under a common mechanism: debate plateau and reverse ( 5 ) , its non-replication on contemporary frontier models (which we directly demonstrate in Appendix A ), intrinsic self-correction degradation ( 8 ) , and cross-provider divergence in debate dynamics. 2 Detection-Generation Decomposition A downstream agent receives content \varphi from an upstream stage and produces output \varphi^{\prime} . When \varphi contains a claim with ground truth T(\varphi)\in\{0,1\} , the agent’s response can be operationalized as two coupled decisions: (1) whether to treat \varphi as authoritative, and (2) what to produce if not. This yields four observable regimes whose distribution is governed by two parameters with differential empirical structure. 2.1 Four Regimes from Two Decisions and Ground Truth Let D\in\{0,1\} denote the agent’s detection decision: D=1 iff the agent’s answer differs from the input. D is an observable proxy for the latent decision to treat upstream content as non-authoritative; it cannot distinguish intentional revision from formatting drift, stochasticity, or recomputation. Detection events arise from cross-agent disagreement in debate, from instructed review in self-correction, or from internal inconsistency signals. We treat these triggers as functionally equivalent at the level of conditional generation. The downstream computation conditions on \varphi having been flagged as subject to revision, regardless of source. When D=1 , the agent produces an alternative answer through conditional generation . Let G\in\{\text{correct},\text{incorrect}\} denote whether the generated alternative resolves to ground truth. When D=0 , the output equals the input and G is observationally unavailable; correctness is determined entirely by T(\varphi) . The pair (D,T(\varphi)) partitions agent responses into four observable regimes (Table 1 ; visualized in Figure 1 ). Regime D T(\varphi) G BOUNDARY 0 1 — IP 0 0 — DC 1 0 correct DM 1 0 incorrect Table 1: The four observable regimes of the detection-generation decomposition, defined by detection D , upstream ground truth T(\varphi) , and, where applicable, conditional generation G . D=0 (propagate) D=1 (revise \to G ) T(\varphi)=1 (correct) T(\varphi)=0 (incorrect) BOUNDARY correct, propagated Rare ( <2\% ): folded into DM if revised wrong IP — inherit-propagate (error stays) DC G=\text{correct} (correct revision) DM G=\text{incorrect} (miscorrection) Figure 1: The four regimes of the detection-generation decomposition, partitioned by the D\times T(\varphi) plane. The D=1,T(\varphi)=0 cell further splits by G into DC (correct revision) and DM (miscorrected revision; detection without correction ). The (D=1,T(\varphi)=1) corner is empirically rare and is folded into DM when the revised answer is incorrect. BOUNDARY (D=0,T(\varphi)=1) : the agent correctly treats authoritative upstream content as authoritative and propagates it unchanged. This is the pipeline’s well-functioning baseline; in our empirical grid it accounts for 30–80% of agent responses depending on benchmark difficulty. IP (inherit-propagate) (D=0,T(\varphi)=0) : the agent treats incorrect upstream content as authoritative and propagates the error unchanged. DC (detect-correct) (D=1,T(\varphi)=0,G=\text{correct}) : the agent detects the upstream content as subject to revision and generates a correct alternative. This is the regime in which downstream verification provides genuine value. DM (detect-miscorrect) (D=1,T(\varphi)=0,G=\text{incorrect}) : the agent detects upstream content as subject to revision but generates an alternative that is