CECOR: Correction-oriented synthetic data construction for factual error correction Journal: Knowledge-Based Systems
Lei Zhu, Xiaobao Wang, Jianbiao Yang, Chenyang Wang, Dongxiao He, Longbiao Wang, Jianwu Dang · 2026
Read CECOR: Correction-oriented synthetic data construction for factual error correction Journal: Knowledge-Based Systems by Lei Zhu, Xiaobao Wang, Jianbiao Yang, Chenyang Wang, Dongxiao He, Longbiao Wang, Jianwu Dang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02277.txt.
Introduction
Lei Zhu and colleagues present CECOR, a system for correcting factual errors in text that need multi-step reasoning. Factual error correction revises a claim so it matches external evidence. Past methods do well on single-hop claims but treat claims as single units, so they struggle when a fix needs evidence from several sources. Paired training data are also scarce.
CECOR breaks a multi-hop claim into clear reasoning steps and injects controlled errors to synthesise training pairs, a decomposition and injection scheme. A two-stage learning plan joins supervised fine-tuning with reinforcement learning to raise accuracy and robustness. Evaluations reported in the paper show gains on compositional correction, where locating a semantic error inside a reasoning chain is the hard part.
Catalog record
| CREATOR | Lei Zhu, Xiaobao Wang, Jianbiao Yang, Chenyang Wang, Dongxiao He, Longbiao Wang, Jianwu Dang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.02277
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CECOR: Correction-oriented synthetic data construction for factual error correction Journal: Knowledge-Based Systems Lei Zhu, Xiaobao Wang, Jianbiao Yang, Chenyang Wang, Dongxiao He, Longbiao Wang, Jianwu Dang Abstract Factual Error Correction (FEC) aims to revise inaccurate text into statements that are factually consistent with external evidence. Although recent methods perform well on single-hop correction, they often treat claims as atomic units and struggle with multi-hop cases that require compositional reasoning across multiple evidence sources. This challenge is further amplified by limited paired data and difficulties in locating semantic errors within complex reasoning chains. We present CECoR (Compositional Error Correction via Reasoning-aware Synthesis), a reasoning-aware framework that introduces a Decomposition and Injection paradigm for compositional error correction. CECoR decomposes multi-hop claims into interpretable reasoning steps and injects controlled perturbations to synthesize high-quality training pairs. A two-stage learning strategy combining supervised fine-tuning and reinforcement learning improves factual accuracy and robustness. Comprehensive evaluations show that CECoR achieves strong performance on multi-hop benchmarks, outperforming both distantly supervised methods and few-shot LLM baselines. It also generalizes effectively to single-hop correction and remains stable under noisy evidence, demonstrating its versatility for real-world factual correction. 1 Introduction Factual Error Correction (FEC) has become an increasingly vital task in natural language processing, particularly as large language models demonstrate impressive generative abilities across various domains 15 . Yet, their tendency to hallucinate, producing fluent but factually incorrect content, undermines their trustworthiness in real-world deployments. FEC aims to revise such inaccurate claims into factually consistent alternatives grounded in supporting evidence, serving as a key safeguard for reliable AI systems. Figure 1: Comparison of factual error correction paradigms. Top: Mask-then-Correct relies on explicit error masking followed by conditional correction. Middle: Mask-then-Corrupt generates data by corrupting masked spans but can only handle localized, maskable errors. Bottom: CECoR enables more diverse and compositional corruptions beyond single-entity substitutions. One widely studied paradigm for FEC is the Mask-then-Correct pipeline 14 , 2 , illustrated at the top of Figure 1 . This approach decomposes the task into two sequential steps: identifying potential factual errors via masking, and correcting the masked portions conditioned on evidence. While intuitive, it heavily depends on the accuracy of the masking module, which is typically trained under distant supervision due to the lack of large-scale annotated datasets. As a result, failure in the error localization stage often leads to irreparable breakdowns in the entire correction process. To circumvent this bottleneck, recent methods adopt a reversed formulation known as the Mask-then-Corrupt paradigm 6 , 5 , depicted in the middle of Figure 1 . These methods begin with verified claims, mask factual spans, and then corrupt the masked content to create incorrect variants. This paradigm enables scalable data generation without requiring gold-standard annotations. However, its core limitation lies in its reliance on localized error injection, typically involving the corruption of a single named entity or short span. Such corruption is still predominantly span-local (often limited to a single entity or short phrase), leaving a gap for multi-hop settings where inconsistencies are coupled across multiple reasoning steps and cannot be captured by independent masking operations. As shown in the bottom portion of Figure 1 , real-world factual errors often exhibit non-local and structurally complex characteristics. The left example illustrates a claim corrupted through syntactic rephrasing that subtly alters temporal logic, while the right example introduces error by jointly replacing multiple entities, affecting relational consistency. These types of factual errors cannot be easily captured by simple masking operations and are common in multi-hop claims, where truth conditions are distributed across reasoning chains involving multiple evidence pieces 7 , 1 , 17 . More broadly, both Mask-then-Correct and Mask-then-Corrupt rely on an implicit Atomic Fact Assumption , which suggests that factual claims are flat, undecomposed units, and that errors are independently correctable. This assumption is not well suited for multi-hop claims that encode compositional truths, where correctness depends on integrating multiple reasoning steps supported by diverse evidence 11 , 3 . Effective correction in such cases requires structure-aware representations and step-wise manipulation of logic, which these paradigms do not provide. Yet, meeting these requirements remains highly non-trivial in practice. To address these limitations, we propose CECoR ( C ompositional E rror Co rrection via R easoning-aware Synthesis), a decomposition-and-injection framework for multi-hop factual error correction. The key idea is to explicitly expose the latent reasoning behind a multi-hop claim by decomposing a verified claim into an interpretable, step-wise reasoning program, and then injecting controlled factual perturbations into one reasoning step at a time before recomposing the corrupted program back into a fluent natural-language claim. This step-level manipulation enables CECoR to synthesize non-local and coupled inconsistencies, such as coordinated entity substitutions or violations of temporal/relational constraints, that are difficult to express with surface-span masking, while keeping the overall claim coherent. As a result, CECoR converts abundant unpaired correct multi-hop claims into pseudo-parallel (incorrect, correct) pairs, alleviating the scarcity of supervised correction data. To ensure reliability of the synthesized supervision, we further introduce a filtering pipeline that retains only examples that are fluent, structurally multi-hop, and verifiably inconsistent with the evidence, yielding high-fidelity training pairs for correction. On top of the synthesized data, we adopt a two-stage learning strategy: (i) supervised fine-tuning on the filtered synthetic pairs to initialize a correction model with compositional error patterns, and (ii) reinforcement learning on naturally occurring incorrect claims to improve robustness and better align corrections with real-world error distributions and editing preferences. We also revisit evaluation for factual error correction. Existing reference-based, surface-form metrics can over-reward conservative outputs (e.g., leaving the input unchanged) and penalize valid edits, especially when factual discrepancies are subtle. We therefore complement rule-based metrics with an LLM-based evaluation that better reflects semantic correctness and evidence support, following recent findings on LLMs as reliable judges. Under full evaluation protocol, experiments on multi-hop benchmarks demonstrate strong performance over competitive baselines, with additional generalization to single-hop correction and robustness under noisy retrieved evidence. Our contributions are summarized as follows: 1. Limitation: We analyze why prior FEC paradigms that operate on undecomposed claims (the atomic fact assumption) are insufficient for multi-hop, compositional inconsistencies. 2. Method: We introduce CECoR, which decomposes multi-hop claims into reasoning programs and performs step-level error injection to synthesize high-fidelity training pairs. 3. Learning & Evaluation: We propose a two-stage SFT+RL training pipeline and a confidence-oriented evaluation protocol with LLM-based judging, showing strong performance on multi-hop benchmarks and robust transfer to single-hop and noisy evidence settings. 2 Related Work Factual Error Correction (FEC). FEC aims to revise an input claim into a factually supported statement given external evidence, and is closely related to fact verification, grounded generation, and text editing. A major obstacle in FEC is the scarcity of large-scale paired supervision (incorrect–correct claim pairs) grounded in evidence. As a result, prior work on complex claims has largely relied on distant supervision and synthetic data construction to scale training. Early approaches commonly adopt a “mask-then-correct” pipeline, where entities or spans are first masked and a correction model is trained to fill in evidence-consistent content 14 , 2 . This formulation decomposes correction into error localization followed by conditional generation, but its effectiveness is highly dependent on the masking component, which is often trained with weak signals and may