More Rounds, More Noise: Why Multi-Turn Review Fails to Improve Cross-Context Verification

Song Tae-Eun · 2026

Read More Rounds, More Noise: Why Multi-Turn Review Fails to Improve Cross-Context Verification by Song Tae-Eun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16244.txt.

Introduction

Song tests whether extra rounds of review improve checking across separate sessions. Cross-Context Review splits writing and review into independent sessions. The dynamic version lets the reviewer ask questions and review again. In a test with 30 artifacts and 150 planted errors, the single pass won. Its F1 score was 0.376, above all multi-turn variants. Extra rounds raised recall but added 62% more false alarms. Reviewers invented findings and drifted to grading the chat itself.

Catalog record

CREATORSong Tae-Eun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31348
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16244

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

More Rounds, More Noise: Why Multi-Turn Review Fails to Improve Cross-Context Verification Song Tae-Eun Abstract Cross-Context Review (CCR) improves LLM verification by separating production and review into independent sessions. A natural extension is multi-turn review: letting the reviewer ask follow-up questions, receive author responses, and review again. We call this Dynamic Cross-Context Review (D-CCR). In a controlled experiment with 30 artifacts and 150 injected errors, we tested four D-CCR variants against the single-pass CCR baseline. Single-pass CCR (F1 = 0.376) significantly outperformed all multi-turn variants, including D-CCR-2b with question-and-answer exchange (F1 = 0.303, p < 0.001 p<0.001 , d = − 0.59 d=-0.59 ). Multi-turn review increased recall (+0.08) but generated 62% more false positives (8.5 vs. 5.2), collapsing precision from 0.30 to 0.20. Two mechanisms drive this degradation: (1) false positive pressure —reviewers in later rounds fabricate findings when the artifact’s real errors have been exhausted, and (2) Review Target Drift —reviewers provided with prior Q&A exchanges shift from reviewing the artifact to critiquing the conversation itself. Independent re-review without prior context (D-CCR-2c) performed worst (F1 = 0.263), confirming that mere repetition degrades rather than helps. The degradation stems from false positive pressure in additional rounds, not from information amount—within multi-turn conditions, more information actually helps (D-CCR-2b > > D-CCR-2a). The problem is not what the reviewer sees, but that reviewing again invites noise. 1 Introduction Cross-Context Review ( 11 , CCR;) demonstrated that LLM verification improves when production and review happen in separate sessions. By removing the production context, the reviewer avoids anchoring, sycophancy, and context degradation—biases that plague same-session self-review. CCR achieved an F1 of 28.6%, significantly outperforming same-session review (24.6%, p=0.008 ) and repeated same-session review (21.7%, p<0.001 ). Can we do better with multiple rounds? Human review processes routinely involve follow-up questions—a code reviewer asks why a particular approach was chosen; a peer reviewer requests clarification on methodology. These exchanges often surface issues that a single read misses. 7 showed that multi-turn interviewer-style LLM evaluation reduces bias and improves robustness compared to single-pass assessment, though without context separation. We tested whether combining CCR’s context separation with multi-turn interaction yields further gains. In Dynamic Cross-Context Review (D-CCR), the reviewer conducts an initial review, generates follow-up questions, receives the author’s answers in a separate session preserving context separation, and reviews again with this additional information. The results are negative. Every multi-turn variant produced lower F1 than the single-pass baseline, with three of four comparisons highly significant ( p<0.001 ). Additional rounds generate false positives faster than they discover true errors. This paper makes four contributions: 1. We demonstrate empirically that the optimal number of CCR review rounds is one. Multi-turn review significantly degrades F1 ( -0.073 , p<0.001 , d=-0.59 ) despite modestly improving recall (+0.08). 2. We identify false positive pressure —a systematic tendency for reviewers to fabricate findings in later rounds when the artifact’s real errors have been largely exhausted in round one. 3. We document Review Target Drift —a failure mode where reviewers provided with Q&A exchanges shift their attention from the artifact to the conversation, generating findings about the author’s answers rather than the artifact itself. 4. We establish a round optimization principle : within multi-turn conditions, more information helps (D-CCR-2b > D-CCR-2a), but any second round degrades performance relative to a single pass. The problem is not what the reviewer sees, but that reviewing again invites noise. 2 Related Work 2.1 Multi-Round LLM Verification Several lines of work have explored iterative LLM verification. 4 showed that temporal consistency checking improves error identification in mathematical reasoning, but within a single context. 1 proposed MAgICoRe, a multi-agent iterative refinement framework where Solver, Reviewer, and Refiner agents collaborate in repeated loops, achieving gains over self-consistency and self-refinement baselines. The critical difference: MAgICoRe’s agents share context, while D-CCR maintains strict context separation. 9 developed Socratic Self-Refine (SSR), decomposing reasoning into verifiable sub-question/sub-answer pairs and iteratively re-solving unstable steps. The Socratic probing approach parallels D-CCR’s follow-up question mechanism, but SSR operates within a single session. 2 showed that progressive thought refinement across multiple passes improves reasoning, though via fine-tuning rather than inference-time intervention. These works establish that multi-round verification can help within shared or continuous contexts. We show that when context separation is maintained, the dynamics change fundamentally. 2.2 Self-Correction Limitations The self-correction literature explains why additional rounds might fail. 8 demonstrated that prompting-based self-correction is fundamentally limited—reinforcement learning is needed for genuine improvement. Giving a CCR reviewer another chance, even with additional information, does not overcome these limitations. 5 and 6 established that LLMs cannot reliably correct their own reasoning without external feedback. 15 found that self-correction can flip correct answers to incorrect ones. 12 identified the self-correction blind spot: LLMs fail to correct errors in their own outputs while succeeding on identical errors presented as external input. CCR exploits this asymmetry; our results suggest that additional rounds erode the advantage. 2.3 Multi-Agent Debate Multi-agent debate (MAD) research illuminates why more interaction does not always help. 14 evaluated five MAD methods across nine benchmarks and found that MAD does not reliably outperform single-agent baselines. The only consistent improvement factor was model heterogeneity —using different models, not different prompts. D-CCR uses a single model, which may explain why additional rounds fail to introduce genuine diversity. 13 identified majority pressure as a key failure mode: when agents interact, the majority view suppresses independent correction. This parallels our Review Target Drift—D-CCR reviewers who see prior Q&A exchanges shift toward evaluating the discussion rather than independently examining the artifact. 10 confirmed that MAD does not reliably beat simpler methods like self-consistency or ensembling. 3 showed that external tools (calculators, code execution) enable genuine self-correction in ways that purely verbal feedback cannot—suggesting that D-CCR’s verbal Q&A exchange is insufficient as “external feedback.” 2.4 CCR Foundation 11 established that context separation is the operative mechanism in CCR: reviewing in a fresh session (F1 = 28.6%) outperforms same-session review (24.6%, p=0.008 ), and repeated same-session review provides no benefit (SR2 \approx SR, p=0.11 ). We extend this by testing whether the number of separated review rounds matters. That one round is optimal strengthens the original claim: it is the separation itself, not the amount of review, that drives improvement. 3 Method: Dynamic Cross-Context Review 3.1 D-CCR Protocol D-CCR extends CCR by adding structured interaction between reviewer and author across separated sessions: CCR (single-pass): A -> Artifact -> B -> Report D-CCR (multi-turn): A -> Artifact -> B1 -> Review + Questions | A’ -> Answers | B2 -> Final Report Each arrow represents a separate session with no shared context. B 1 and B 2 are independent reviewer sessions. A ′ is a new author session that sees only the artifact and the questions—not the original production context. 3.2 Experimental Conditions We tested four conditions, varying what information the reviewer receives in round two: Condition Round 1 Round 2 Purpose CCR-1 Artifact only — Baseline D-CCR-2a Artifact only Artifact + questions Question-only D-CCR-2b Artifact only Artifact + Q&A Full D-CCR D-CCR-2c Artifact only Artifact only (fresh) Independence D-CCR-2a isolates the effect of the reviewer seeing their own prior questions. D-CCR-2b is the full D-CCR protocol with author answers. D-CCR-2c controls for the “two

Read the complete text