Mask-to-Correct + : Leveraging Retriever Diversity for Masking-guided Faithful Fact Correction
Payel Santra, Lavisha Sharma, Madhusudan Ghosh, Partha Basuchowdhuri, [email protected] · 2026
Read Mask-to-Correct + : Leveraging Retriever Diversity for Masking-guided Faithful Fact Correction by Payel Santra, Lavisha Sharma, Madhusudan Ghosh, Partha Basuchowdhuri, [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18776.txt.
Introduction
Payel Santra and three co-authors propose Mask-to-Correct, a 2026 training-free framework for faithful fact correction. Misinformation spreads fast, but existing methods need scarce annotated pairs and overlook faithfulness. Their method masks to spot erroneous claim spans and judges faithfulness against retrieved evidence. Since retrieval quality varies by retriever, they add M2C-Plus, an ensemble combining corrections across rankers to cut bias and lift robustness. Across benchmarks, the frameworks beat all baselines, gaining up to fourteen percent in SARI scores without gold evidence.
Catalog record
| CREATOR | Payel Santra, Lavisha Sharma, Madhusudan Ghosh, Partha Basuchowdhuri, [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33272 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18776
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mask-to-Correct + : Leveraging Retriever Diversity for Masking-guided Faithful Fact Correction Payel Santra, Lavisha Sharma, Madhusudan Ghosh, Partha Basuchowdhuri, [email protected] Abstract The rapid spread of misinformation on social media highlights the need for robust, automated fact correction frameworks. However, existing works rely on supervised learning from manually annotated claim-evidence pairs, which are scarce and prone to biases, limiting their generalization across domains. Moreover, these methods overlook semantic faithfulness in their correction process. To address these challenges, we propose Mask-to-Correct (M 2 C) , a training-free, inference-only Retrieval Augmented Generation (RAG) based framework that leverages diversity-aware masking to identify erroneous spans of claims and evaluate the faithfulness of corrections using retrieved evidence. However, the effectiveness of RAG heavily depends on the choice of retriever, which may vary across queries. To mitigate this, we further introduce M 2 C + , an ensemble-based framework that combines corrections across multiple rankers to reduce retrieval bias and improve robustness. Extensive experiments on the benchmark datasets demonstrate that our proposed frameworks consistently outperform all baselines, achieving up to 14% improvement in SARI scores, without using gold evidence. 1 Introduction Large language models (LLMs) have made a significant impact across a wide range of tasks 32 ; 7 ; 46 . However, LLMs 35 ; 39 have intensified the generation of misinformation with the help of suitably crafted adversarial prompts 47 . The topically coherent and fluent nature of LLM-generated text 24 potentially makes it even harder to detect any injected misinformation 27 . On the other hand, the inherent susceptibility of language models towards hallucinations 15 often results in factually inconsistent outputs. In this paper, we primarily address the task of factual error correction, which involves editing a given input sentence (or claim) to make it factually consistent with the supporting evidence. Unlike the fact verification task, which involves classifying a claim’s veracity class (“TRUE”, “FALSE”, etc.) 30 ; 29 ; 16 based on supporting or refuting evidence ( 2 ) , fact correction extends this task by revising incorrect claims into correct ones while preserving their semantics. Most standard approaches of this task focus on preserving grammar and fluency using fully or distantly supervised approaches 31 ; 34 ; 11 , but ignore faithfulness 1 1 1 Semantic faithfulness refers to preserving a claim’s core meaning, its proposition, structure, and intent while modifying only factually incorrect spans based on external evidence. Unlike grammaticality or fluency, which focus on surface form, semantic faithfulness ensures the integrity of meaning with respect to both the original claim and the supporting evidence. to the supporting evidence. Moreover, these methods require annotated evidence of each claim, which is resource-intensive and time-consuming and also susceptible to pooling and exposure biases ( 43 ) (see Appendix C ). Inspired by 12 , we address these challenges by introducing training-free approaches, such as zero-shot prompting followed by a Retrieval-Augmented Generation (RAG)-based framework 20 ; 14 , which enhances an LLM’s response generation by integrating external knowledge from large-scale corpora, thereby eliminating the need for manually annotated ground-truth evidence. However, such prompting approaches face some challenges: Ensuring minimal change: The corrected claim should preserve the original semantics. Identifying potentially false or weakly supported spans within a claim may help us address it convincingly. Retriever quality dependency: As illustrated in Figure , the effectiveness of RAG-based correction depends heavily on the quality of the retrieved evidence. A single retriever may fail to capture diverse or ambiguous contexts and accumulating complementary evidence from multiple retrievers leads to more reliable corrections. To overcome these challenges, we propose a novel masking aware, three-stage framework M 2 C ( M ask- to - C orrect) that identifies and masks erroneous spans in a claim, generates corrected candidates using retrieved evidence, and selects the most faithful revision through a semantic–factual scoring function. We further introduce M 2 C + , an ensemble-based extension that aggregates multiple retrieval generation pathways for improved robustness. Importantly, to our knowledge, our work is the first to integrate RAG with a diversity-aware masking strategy that ensures broader coverage of plausible error regions while minimizing unnecessary edits, hallucinations, thereby increasing faithfulness. Thus, the novelty of this approach lies in a task-specific, lightweight aggregation across different retrievers that enhances correction stability without additional training overhead. Furthermore, to strengthen our study, we conducted extensive analyses in multiple dimensions, including the impact of different masking strategies, retriever combinations, computational efficiency, and correction scoring schemes, along with detailed sensitivity and ablation studies. Our contributions are summarized as follows: 1) We introduce a training-free fact correction framework, M 2 C, that does not require gold evidence. 2) We propose a diversity-aware masking strategy to identify high-impact erroneous spans more effectively than traditional methods. 3) To the best of our knowledge, we are the first to introduce majority voting-based ensembling approach for the downstream task through our framework M 2 C + . 2 Related Work 3 Methodology In this paper, we address the task of faithful fact correction, which involves rectifying an incorrect claim using contextual evidence. Formally, given an input claim \mathbf{x} (correct, incorrect or ambiguous), our goal is to design an automated system \phi that identifies and rectifies factual errors (if they exist) to generate a revised claim \hat{\mathbf{x}} that is consistent with the associated evidence \mathcal{E}(\mathbf{x}) . More formally, \phi:(\mathbf{x},\mathcal{E}(\mathbf{x}))\mapsto\hat{\mathbf{x}} . We hypothesize that the predicted claim \hat{\mathbf{x}} should be grammatically correct and minimally altered to preserve the original semantics of \mathbf{x} . Furthermore, our method is designed to maintain factual consistency if the \mathbf{x} is already correct. We propose a novel three-stage masking-guided, training-free, and annotation-free framework, M 2 C, that leverages the reasoning capabilities of LLMs. The key components are described as follows: 3.1 Masker The objective of this module is to identify salient and diverse spans within a claim that are most likely to require factual revision, while preserving the overall structure and semantics of the input without explicitly verifying correctness. Formally, given an input claim \mathbf{x}=\{x_{i}\}_{i=1}^{n} , where x_{i} denotes the i^{th} token, the module first extracts a set of candidate entities or spans E_{s}(\mathbf{x})=\{e_{i}\}_{i=1}^{s} , with s<n . Each entity e_{j} is then independently masked to produce a set of perturbed claims \{\tilde{\mathbf{x}}_{j}\}_{j=1}^{s} , where \tilde{\mathbf{x}}_{j} is obtained by replacing e_{j} with a [MASK] token. However, standard masking strategies such as random masking 34 or purely entity based masking 12 either lack in semantic focus or rely solely on syntactic boundaries, often missing contextually important spans and leading to suboptimal corrections. To address this limitation, we propose a Maximal Marginal Relevance (MMR) 4 based diversity-aware masking paradigm to iteratively re-rank candidate entities. This yields a prioritized subset \mathcal{R}_{m}=\{r_{i}\}_{i=1}^{m} , where m\leq s , ensuring that the selected spans collectively capture diverse and informative aspects of the claim for our downstream task. As illustrated in Figure , using MMR algorithm, we iteratively add those entities in an incrementally growing list that are both relevant to the claim and diverse with respect to one another. More formally, it is a function of the following: (a) the iteration step i<m , ( m - the number of entities to be selected), (b) the set of entities selected until the (i-1)^{th} step, S_{i-1}\subseteq\mathcal{R}_{m} , and (c)