Self-Correction Bench: Revealing and Addressing the Self-Correction Blind Spot in LLMs

Ken Tsui · 2025

Read Self-Correction Bench: Revealing and Addressing the Self-Correction Blind Spot in LLMs by Ken Tsui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02778.txt.

Introduction

Ken Tsui shows, in a 2025 preprint, that language models often fail to fix their own mistakes even when they can. Telling apart cannot from does not is the hard part of studying self-correction. His benchmark, Self-Correction Bench, plants the same error in two frames. In one, the error is blamed on the user. In the other, the model supposedly wrote it. Fourteen open models were tested. They fixed the outside error far more often than the identical inside one.

The gap, about sixty-five percent, is named the self-correction blind spot. Training data explains much of it: fine-tuning sets rarely show anyone correcting a model. Adding a few thousand correction examples cut the gap by three quarters. Appending the word Wait helped even more, with no training. Tsui finds a direction inside the model tied to speaker role that switches correction on or off.

Catalog record

CREATORKen Tsui
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-02778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Self-Correction Bench: Revealing and Addressing the Self-Correction Blind Spot in LLMs Ken Tsui Abstract Although large language models (LLMs) have become transformative, they still make mistakes and can explore unproductive reasoning paths. Self-correction is an important capability for a trustworthy LLM, particularly an autoregressive LLM. While LLMs can identify error in user input, they exhibit a systematic ’Self-Correction Blind Spot’ - failing to correct identical error in their own outputs. To systematically study this phenomenon, we introduce Self-Correction Bench , a systematic framework to measure this phenomenon through controlled error injection at three complexity levels. Testing 14 models, we find an average 64.5% blind spot rate. We find multiple evidences that this limitation relates to training data composition: human training demonstrations predominantly show error-free responses rather than error-correction sequences, unlike RL-trained models that learn error correction through outcome feedback. Remarkably, simply appending “ Wait ” reduces blind spots by 89.3%, suggesting that the capability exists but requires activation. Our work highlights a critical limitation in current LLMs and offers potential avenues for improving their reliability and trustworthiness. “I have not failed. I’ve just found 10,000 ways that won’t work.” — Thomas A. Edison 1 Introduction Large Language Models (LLMs) have rapidly advanced natural language processing, achieving state-of-the-art results on a diverse range of tasks ( OpenAI et al. 2024 ; Anthropic 2024 ; Gemini Team 2025 ; Yang et al. 2025 ; Meta 2025 ; DeepSeek-AI et al. 2025a ) . However, despite their impressive capabilities, LLMs are known to exhibit unpredictable failures and generate inaccurate information ( Huang et al. 2025 ; Bang et al. 2023 ; Shi et al. 2023 ; Nezhurina et al. 2025 ) . A particularly concerning issue is the tendency of LLMs to make seemingly random errors even on simple tasks, despite possessing the underlying knowledge required for correct solutions. This raises fundamental questions about their reliability and trustworthiness, hindering their deployment in critical applications. Observing LLM self-correction behavior in natural settings is challenging due to their inherent accuracy; the rarity of naturally occurring errors makes systematic evaluation challenging. To address this limitation, we construct Self-Correction Bench by systematically injecting error into the LLM reasoning traces. This allows us to create controlled environments for testing self-correction and reliably quantifying performance using dedicated benchmarks. This approach also allows us to simulate real-world imperfections and assess the robustness of LLMs in realistic scenarios. Our results reveal that LLMs are not good at self-correction, not because of knowledge. We refer to the phenomenon as “Self-Correction Blind Spot” . We further demonstrate that appending a simple “ Wait ” and other correction markers can induce self-correction performance without finetuning, suggesting that the core issue is not knowledge deficiency, but rather a lack of activation for self-correction. We provide a behavioral explanation for why “ Wait ” works, supported by systematic analysis of correction marker patterns and post training data. We also analyze why the RL trained reasoning model does not have the blind spot. Our contributions are as follows. • Discover and quantify the Self-Correction Blind Spot - LLMs systematically fail to correct their own error while succeeding on identical external error (64.5% average across 14 models) • Establish systematic evaluation methodology - Self-Correction Bench with controlled error injection across three complexity levels, enabling fair cross-model comparison • Human demonstrations rarely include self-correction sequences, unlike RL models that learn error-correction through outcome feedback • Demonstrate simple yet effective intervention - Appending “ Wait ” reduces blind spots by 89.3%, with behavioral explanation supported by correction marker analysis 2 Background and Related Works Intrinsic Self-correction in LLMs : Recent work has shown that intrinsic self-correction improves performance by prompting the same LLM to generate feedback on their own responses ( Kim et al. 2023 ; Shinn et al. 2023 ; Madaan et al. 2023 ; Kamoi et al. 2024 ) . In particular, it indicates that LLMs struggle to rectify mistakes because the quality of the model’s self-feedback is bounded by existing knowledge. ( Kim et al. 2023 ) and ( Shinn et al. 2023 ) use an oracle label to guide feedback. However, without access to the oracle label Huang et al. 2024 has identified limitations in the LLMs’ ability to self-correct error, while Tyen et al. 2024 demonstrates that poor self-correction performance is due to the inability to localize rather than correct an error. Most works require multiple-step prompting, while our focus is on single-pass inference, in which LLM is expected to self-correct in one completion. We further study self-correction from a cognitive perspective rather than the limitation due to model knowledge. Recent work understands why some LLMs thrive and some do not in outcome-based reinforcement learning (RL) from a cognitive point of view ( Gandhi et al. 2025 ) . The study uses supervised finetuning (SFT) to elicit backtracking behavior, while our focus is on self-correction, including backtracking, and we use correction markers to elicit such cognitive behavior without finetuning. Kumar et al. 2024 tackles self-correction with RL, leads to significantly positive intrinsic self-correction, while DeepSeek-AI et al. 2025a ’s training does not explicitly single out self-correction but instead rely on ground truth to provide signal. They observe that the aha moment when LLM learns to allocate more time to re-evaluate its initial approach (i.e. self correction). Prompt Injection for Evaluation : Traditional prompt injection technique focuses on adversarial scenarios in which attackers inject malicious instruction or prefix to manipulate LLM output ( Wei et al. 2023 ; Liu et al. 2024 ) . However, controlled error injection has not been systematically explored to test the self-correction capability. Lanham et al. 2023 injects mistakes into reasoning chains to evaluate the faithfulness of chain-of-thought reasoning. However, their focus is on measuring consistency between reasoning and conclusion, not self-correction capabilities. Our controlled error injection methodology injects errors to evaluate self-correction across multiple task complexity. The approach enables us to reveal systematic blind spot in LLM self-correction that has not been previously characterized. Hallucination Snowballing : Zhang et al. 2023 has demonstrated that once LLM hallucinates, subsequent tokens tend to be consistent with the error, suggesting the lack of self-correction mechanism. This phenomenon suggests systematic limitations in self-correction during generation. Our work provides an explanation by revealing that LLMs suffer from self-correction blind spot: they can correct errors in external inputs but not in their own outputs. Test-time interventions : Recently, compute has been shifted from training time ( Kaplan et al. 2020 ) to test time, which can lead to a better ”compute-optimal” result ( Snell et al. 2024 ) . Simple test-time scaling ( Muennighoff et al. 2025 ) finetuned with 1,000 curated questions with reasoning traces and forcing compute budget by appending “ Wait ” have demonstrated a scaling performance on reasoning benchmarks with thinking tokens. We provide a behavior explanation for why it works by conducting an intervention experiment on an unfinetuned model. Cognitive Bias in LLM : Koo et al. 2024 ; Echterhoff et al. 2024 ; Jones and Steinhardt 2022 show that LLMs exhibit different cognitive biases given their training in human data. We study how the bias blind spot ( Pronin et al. 2002 ) affects self-correction. Our work contributes a systematic

Read the complete text