Corrective In-Context Learning: Evaluating Self-Correction in Large Language Models
Mario Sanz-Guerrero, Katharina von der Wense · 2025
Read Corrective In-Context Learning: Evaluating Self-Correction in Large Language Models by Mario Sanz-Guerrero, Katharina von der Wense (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16022.txt.
Introduction
Sanz-Guerrero and von der Wense test a tempting idea for teaching language models by example: show the model its own mistakes next to the right answers, and let it learn to self-correct. Their method, corrective in-context learning, adds wrong predictions paired with ground-truth fixes into the prompt. Standard in-context learning shows only correct labeled examples. The pair ran wide experiments on text classification tasks.
The corrective version lost, every time. Worse, the more corrections the prompt carried, the more accuracy fell. The authors argue the mixed signals confuse the model's grasp of the task instead of refining its answers. Showing harder examples in the standard setup did not help either, which warns against using difficulty alone to pick teaching examples. As a clean negative result, the paper saves other researchers from a plausible dead end.
Catalog record
| CREATOR | Mario Sanz-Guerrero, Katharina von der Wense |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-16022
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Corrective In-Context Learning: Evaluating Self-Correction in Large Language Models Mario Sanz-Guerrero, Katharina von der Wense Abstract In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors, especially for challenging examples. With the goal of improving the performance of ICL, we propose corrective in-context learning (CICL), an approach that incorporates a model’s incorrect predictions alongside ground truth corrections into the prompt, aiming to enhance classification accuracy through self-correction. However, contrary to our hypothesis, extensive experiments on text classification tasks demonstrate that CICL consistently underperforms standard ICL, with performance degrading as the proportion of corrections in the prompt increases. Our findings indicate that CICL introduces confusion by disrupting the model’s task understanding, rather than refining its predictions. Additionally, we observe that presenting harder examples in standard ICL does not improve performance, suggesting that example difficulty alone may not be a reliable criterion for effective selection. By presenting these negative results, we provide important insights into the limitations of self-corrective mechanisms in LLMs and offer directions for future research. 1 1 1 Code and data are available at https://github.com/mario-sanz/CICL . 1 Introduction In-context learning ( Brown et al., 2020 , ICL;) has emerged as a powerful paradigm for leveraging large language models (LLMs) for various NLP tasks, including text classification. Unlike traditional approaches that require finetuning on task-specific data, ICL allows models to make predictions based on a small number of examples presented in the prompt, effectively transforming LLMs into flexible tools for few-shot learning. This paradigm has demonstrated remarkable performance in numerous scenarios, often approaching or surpassing finetuned models on specific tasks ( Brown et al., 2020 ) . Although effective, ICL is susceptible to errors, particularly with difficult examples. We set out to further improve ICL by introducing a novel extension of it, which we term corrective in-context learning (CICL). Our approach is based on the idea that providing the model with its initial predictions alongside the correct ground truth labels can serve as a feedback mechanism, enabling the model to refine its understanding and improve subsequent predictions. Figure 1: CICL prompt example. The model is tasked with predicting the correct label based on its own prediction, using examples that include both the prediction and its correction. CICL builds on the intuition that LLMs, when exposed to their own errors in conjunction with the correct answers, might learn from these mistakes within the confines of a single interaction. For instance, if a model predicts “positive” for a sentence that is actually “negative,” presenting this prediction–error pair could prompt the model to recalibrate its internal representations and make better-informed predictions for similar inputs. However, our empirical evaluation reveals a different story. While the approach is theoretically promising, our experiments show that CICL fails to deliver the anticipated improvements. In some cases, performance even deteriorates compared to standard ICL. This underscores the complexity of self-correction in LLMs and the importance of rigorously evaluating intuitive extensions to ICL. In this paper, we present a detailed investigation of CICL for text classification tasks. We outline our methodology, describe the experimental setup, and analyze the results, focusing on understanding why this approach falls short of expectations. By sharing these negative results, we aim to contribute to the growing discourse on the limitations of LLMs and to inspire future research to develop more effective self-correction mechanisms. 2 Related Work In-Context Learning Introduced by Brown et al. (2020) , ICL enables LLMs to perform tasks via few-shot prompting without parameter updates. Subsequent work has explored factors influencing ICL performance, including example selection ( Liu et al., 2022 ) and ordering ( Lu et al., 2022 ) , raising questions about its robustness to errors or ambiguous examples. To enhance ICL, prompt tuning methods ( Lester et al., 2021 ; Li and Liang, 2021 ) optimize soft prompts, improving adaptation while maintaining frozen model parameters, bridging the gap between ICL and finetuning. Self-Correction in LLMs Prior work explores self-correction through iterative refinement ( Madaan et al., 2023 ) , finetuning on self-generated data ( Huang et al., 2023 ) , or reinforcement learning ( Kumar et al., 2024 ) . These approaches, however, require multi-step processes, parameter updates, or external rewards. In contrast, we investigate whether LLMs can self-correct in-context by directly incorporating corrections into the prompt. Closest to our setting, Monea et al. (2024) show that LLMs struggle to improve from binary reward signals (correct/incorrect) in ICL scenarios. While their feedback is implicit, we extend this observation to explicit ground truth corrections and similarly find degraded performance. 3 Methodology Figure 2: Diagram of the CICL methodology. For each test instance x , k few-shot examples (x_{1},y_{1}),\dots,(x_{k},y_{k}) are selected. Standard ICL generates predictions \hat{y}_{1},\dots,\hat{y}_{k} for these examples, which are used to build the CICL prompt. This, combined with the initial ICL prediction \hat{y} for x , allows the model to predict the corrected label \tilde{y} . 3.1 Standard In-Context Learning ICL leverages the few-shot capabilities of LLMs by conditioning predictions on a prompt constructed from a small set of labeled examples. Formally, given a dataset of examples \{x_{i},y_{i}\} , where x_{i} represents a text input and y_{i} is a class label verbalized as one of the possible labels in the set \mathcal{L} , the model M predicts the label for a query x using a context prompt C_{k} of k examples: \hat{y}=\mathop{\arg\max}\limits_{y\in\mathcal{L}}P_{M}(y\mid C_{k},x) (1) ICL operates under the assumption that the few-shot examples encapsulate task-relevant patterns, allowing the model to generalize to unseen queries. This paradigm has demonstrated remarkable versatility and competitive performance across numerous tasks and datasets ( Brown et al., 2020 ) . However, its effectiveness is heavily dependent on the quality and representativeness of the examples in the prompt ( Liu et al., 2022 ) . Furthermore, biases in the selection or ordering of examples, as well as the inherent biases of the model, can significantly influence predictions, posing challenges for consistent and reliable performance ( Zhao et al., 2021 ) . In this study, standard ICL is the baseline against which we compare the proposed CICL approach, providing insights into whether iterative feedback mechanisms can address some of these challenges. The structure of the ICL prompt, along with an example, is provided in Appendix B.1 . 3.2 Corrective In-Context Learning CICL extends the standard ICL paradigm by introducing a second round of predictions informed by feedback from the first round. The algorithm is as follows: 1. Initial prediction : A prompt is constructed from k randomly selected examples from the training data, each consisting of an input–output pair (x_{i},y_{i}) , for i\in{1,...,k} . This prompt is used to generate prediction \hat{y} for the test input x via standard ICL. 2. Feedback incorporation : We perform ICL for the k examples selected in Step 1, getting the model’s predictions \hat{y}_{i} for each example (x_{i},y_{i}) , with the remaining k-1 examples acting as few-shot examples. Using these predictions, a feedback-augmented prompt (CICL) is constructed from triplets of the form (x_{i},\hat{y}_{i},y_{i}) , where x_{i} is the input text, \hat{y}_{i} is the predicted label, and y_{i} is the true label. These triplets explicitly highlight the model’s