Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTS

Shijia Xu, Zhou Wu, Xiaolong Jia, Yu Wang, Kai Liu, April Xiaowen Dong · 2026

Read Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTS by Shijia Xu, Zhou Wu, Xiaolong Jia, Yu Wang, Kai Liu, April Xiaowen Dong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10734.txt.

Introduction

Xu and five colleagues propose Self-Correcting RAG, a design tackling low context use and frequent hallucinations in retrieval-augmented generation for hard questions. Context choice becomes a multi-dimensional knapsack problem, maximizing information density and cutting redundancy under a strict token budget. On the output side, language-inference-guided Monte Carlo tree search explores thought paths and checks answer faithfulness using test-time compute. Tests on six multi-hop question-answering and fact-checking sets show stronger thought accuracy and fewer hallucinations than strong baselines.

Catalog record

CREATORShijia Xu, Zhou Wu, Xiaolong Jia, Yu Wang, Kai Liu, April Xiaowen Dong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67711
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10734

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTS Shijia Xu, Zhou Wu, Xiaolong Jia, Yu Wang, Kai Liu, April Xiaowen Dong Abstract Retrieval-augmented generation (RAG) substantially extends the knowledge boundary of large language models. However, it still faces two major challenges when handling complex reasoning tasks: low context utilization and frequent hallucinations. To address these issues, we propose Self-Correcting RAG, a unified framework that reformulates retrieval and generation as constrained optimization and path planning. On the input side, we move beyond traditional greedy retrieval and, for the first time, formalize context selection as a multi-dimensional multiple-choice knapsack problem (MMKP), thereby maximizing information density and removing redundancy under a strict token budget. On the output side, we introduce a natural language inference (NLI)-guided Monte Carlo Tree Search (MCTS) mechanism, which leverages test-time compute to dynamically explore reasoning trajectories and validate the faithfulness of generated answers. Experiments on six multi-hop question answering and fact-checking datasets demonstrate that our method significantly improves reasoning accuracy on complex queries while effectively reducing hallucinations, outperforming strong existing baselines.Our code is available at https://github.com/xjiacs/Self-Correcting-RAG . 1 Introduction Large Language Models (LLMs) have shown significant capabilities in reasoning, planning, and tool utilization ( Bubeck et al. 2023 ; OpenAI et al. 2024 ; Touvron et al. 2023 ) . Advanced prompting strategies, such as Chain-of-Thought (CoT) ( Wei et al. 2022 ; Kojima et al. 2022 ) , Least-to-Most prompting ( Zhou et al. 2023 ) , and Self-Consistency ( Wang et al. 2023a ) , allow models to decompose complex tasks into intermediate steps. Furthermore, recent developments in tool-augmented agents enable models to interact with external environments ( Mialon et al. 2023 ; Schick et al. 2023 ; Qin et al. 2023 ; Shen et al. 2023 ; Patil et al. 2024 ; Ruan et al. 2023 ; Li et al. 2023b ) . These advancements suggest a potential for applying LLMs to sophisticated decision-making domains. Figure 1: Comparison of document retrieval and selection workflows between the Baseline (Top-k) and the proposed Self-Correcting RAG Framework. To support complex reasoning, Retrieval-Augmented Generation (RAG) has emerged as a key strategy. RAG grounds generation in external corpora to mitigate knowledge deficits ( Lewis et al. 2020 ; Guu et al. 2020 ; Borgeaud et al. 2022 ; Izacard et al. 2023 ; Ram et al. 2023 ) . Research in this area has expanded rapidly. Innovations include query rewriting ( Ma et al. 2023a ; Jagerman et al. 2023 ) , dense retrieval with pseudo-documents ( Gao et al. 2023 ) , and hierarchical indexing ( Sarthi et al. 2024 ) . Additionally, self-reflective frameworks have been developed to enhance robustness ( Asai et al. 2023 ; Yan et al. 2024 ; Jiang et al. 2023 ) . Simultaneously, retrieval components have evolved through advanced embedding models ( Wang et al. 2024 ; Muennighoff et al. 2023 ; Xiao et al. 2024 ) and LLM-based reranking ( Sun et al. 2024 ; Ma et al. 2023b ; Pradeep et al. 2023 ) . These methods provide the necessary evidence to support logical chains. As shown in Figure 1 , applying these capabilities to strictly constrained combinatorial optimization, such as the Multidimensional Multi-choice Knapsack Problem (MMKP), presents distinct challenges. First, LLMs are prone to hallucinations. They may generate plausible but factually incorrect constraints, as noted in recent evaluations ( Zhang et al. 2025 ; Huang et al. 2025 ; Ji et al. 2023 ; Li et al. 2023a ; Min et al. 2023 ; Manakul et al. 2023 ) . Second, optimization problems involve an exponentially large search space. Greedy token generation cannot guarantee feasibility or global optimality. Errors in early decision steps propagate rapidly, and standard LLMs lack the inherent lookahead mechanisms required for NP-hard problems. To address the limitations of linear generation, test-time search paradigms organize reasoning into tree or graph structures ( Yao et al. 2023a ; Besta et al. 2024 ; Shinn et al. 2023 ; Zelikman et al. 2022 ; Long 2023 ) . Approaches such as Language Agent Tree Search (LATS) integrate Monte Carlo Tree Search (MCTS) with language agents ( Zhou et al. 2024 ; He et al. 2024 ; Hao et al. 2023 ) . Concurrently, LLMs are increasingly utilized as heuristics or optimizers for combinatorial tasks ( Yang et al. 2024 ; Ye et al. 2024 ; Romera-Paredes et al. 2024 ; Guo et al. 2025 ; Liu et al. 2023 ) . These works indicate that a robust solver must combine retrieval-based evidence with structured exploration. In this paper, we propose a unified framework that synergizes RAG with MCTS to address the MMKP. Our approach grounds local feasibility checks in traceable evidence while organizing the decision process into a backtrackable tree. The main contributions of this work are summarized as follows: • We introduce a MMKP-based Context Selector that models document selection as a constrained knapsack problem. This method maximizes information density under token budgets while minimizing redundancy, outperforming greedy ranking strategies. • We develop an NLI-Guided MCTS Generator that utilizes test-time compute to explore reasoning paths. By using Natural Language Inference as a reward model, we penalize contradictions and ensure the generated answers are faithful to the retrieved context. • We achieve strong performance across six diverse datasets, including multi-hop QA and fact verification benchmarks. Our framework significantly reduces hallucinations and improves reasoning accuracy compared to strong agentic baselines. 2 Related Work 2.1 Retrieval-Augmented Generation and Reasoning Prompting strategies have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). Chain-of-Thought (CoT) ( Wei et al. 2022 ; Kojima et al. 2022 ) and ensemble methods like Self-Consistency ( Wang et al. 2023a ) established baselines for intermediate reasoning. Beyond static generation, agentic frameworks such as ReAct ( Yao et al. 2023b ) and Toolformer ( Schick et al. 2023 ) empower models to execute actions and utilizing APIs ( Qin et al. 2023 ; Patil et al. 2024 ) . However, these agents primarily operate in open-ended environments rather than strictly constrained decision spaces. A critical challenge in these reasoning tasks is hallucination, where models generate fact-conflicting content ( Ji et al. 2023 ; Zhang et al. 2025 ) . Retrieval-Augmented Generation (RAG) addresses this by grounding outputs in external corpora ( Lewis et al. 2020 ; Guu et al. 2020 ) . Recent advancements focus on robustness, utilizing hierarchical indexing ( Sarthi et al. 2024 ) and corrective mechanisms like Self-RAG ( Asai et al. 2023 ) and CRAG ( Yan et al. 2024 ) . Concurrently, retrieval components have improved via instruction-tuned embeddings ( Wang et al. 2024 ; Muennighoff et al. 2023 ) and listwise reranking ( Sun et al. 2024 ; Pradeep et al. 2023 ) , ensuring relevant context is prioritized to mitigate knowledge deficits. 2.2 LLMs for Combinatorial Optimization Research increasingly explores LLMs as optimizers or heuristics for hard problems. OPRO ( Yang et al. 2024 ) demonstrates that LLMs can iteratively improve solutions via natural language prompts, while ReEvo ( Ye et al. 2024 ) leverages models to evolve heuristics. FunSearch ( Romera-Paredes et al. 2024 ) further illustrates the potential of pairing LLMs with evolutionary strategies to discover

Read the complete text