EvoRAG: Making Knowledge Graph-based RAG Automatically Evolve through Feedback-driven Backpropagation
Zhenbo Fu 1 , Yuanzhe Zhang 1 , Qiange Wang 1 , Hao Yuan 1 , Yuehao Xu 1 , Enze Yi 2 , Yanfeng Zhang 1 , Ge Yu 1 · 2026
Read EvoRAG: Making Knowledge Graph-based RAG Automatically Evolve through Feedback-driven Backpropagation by Zhenbo Fu 1 , Yuanzhe Zhang 1 , Qiange Wang 1 , Hao Yuan 1 , Yuehao Xu 1 , Enze Yi 2 , Yanfeng Zhang 1 , Ge Yu 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15676.txt.
Introduction
Fu and seven colleagues build EvoRAG, a graph search tool that learns from its own hits and misses. Scores for answers point back to the paths that gave them, and each fact link gains or loses weight from that score, so the graph gets sharper with each round. Tests show right answers up 7.34 percent over the best past graph search tools.
Catalog record
| CREATOR | Zhenbo Fu 1 , Yuanzhe Zhang 1 , Qiange Wang 1 , Hao Yuan 1 , Yuehao Xu 1 , Enze Yi 2 , Yanfeng Zhang 1 , Ge Yu 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67922 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15676
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EvoRAG: Making Knowledge Graph-based RAG Automatically Evolve through Feedback-driven Backpropagation Zhenbo Fu 1 , Yuanzhe Zhang 1 , Qiange Wang 1 , Hao Yuan 1 , Yuehao Xu 1 , Enze Yi 2 , Yanfeng Zhang 1 , Ge Yu 1 Abstract . Knowledge Graph-based Retrieval-Augmented Generation (KG-RAG) has emerged as a promising paradigm for enhancing LLM reasoning by retrieving multi-hop paths from KGs. However, existing KG-RAG frameworks often underperform in real-world scenarios because the pre-captured knowledge dependencies are not tailored to the downstream task or its evolving requirements. These frameworks struggle to adapt to task-specific requirements and lack mechanisms to filter low-contribution knowledge during generation. We observe that feedback on generated responses offers effective supervision for improving KG quality, as it directly reflects user expectations and provides insights into the correctness and usefulness of the output. However, a key challenge lies in effectively linking response-level feedback to triplet-level contribution evaluation and knowledge updates in the KG. In this work, we propose EvoRAG, a self-evolving KG-RAG framework that leverages the feedback over generated responses to continuously refine the KG and enhance reasoning accuracy. EvoRAG introduces a feedback-driven backpropagation mechanism that attributes feedback to retrieved paths by measuring their utility for response and propagates this utility back to individual triplets, supporting fine-grained KG refinements towards more adaptive and accurate reasoning. Through EvoRAG, we establish a closed loop that couples feedback, LLM, and graph data, continuously enhancing the performance and robustness in real-world scenarios. Experimental results show that EvoRAG improves reasoning accuracy by 7.34 % 7.34\% over state-of-the-art KG-RAG frameworks. The source code has been made available at https://github.com/iDC-NEU/EvoRAG . 1. Introduction Figure 1 . Comparison of conventional KG-RAG and EvoRAG. EvoRAG introduces a backpropagation mechanism that propagates response-level feedback to individual triplets, enabling continuous KG refinements. Retrieval-Augmented Generation (RAG) ( 17 ; 35 ; 101 ) empowers Large Language Models (LLMs) to improve response quality by leveraging external knowledge, and has been widely adopted in various domains ( 80 ; 83 ; 94 ) . Among RAG paradigms, Knowledge Graph-based RAG (KG-RAG) ( 97 ; 60 ; 104 ) has gained increasing attention for its ability to transform the textual corpus into structured knowledge graphs (KGs) ( 104 ) , capturing rich semantic information and entity-level relations. Given a query q , the core idea of KG-RAG is to retrieve a relevant knowledge subgraph (KSG) from the KG and feed it together with q to the LLM for response generation. The retrieved KSG is typically organized into a sequence of reasoning paths, ordered chains of triplets that capture multi-hop semantic connections, where each triplet follows the form \textlangle head\ entity,relation,tail\ entity\textrangle . Although KG-RAG frameworks have demonstrated promising results by leveraging the structural information, they often underperform in real-world scenarios due to a mismatch between the pre-captured dependencies in KG and the task-specific requirements ( 97 ; 104 ) . This mismatch primarily stems from two structural limitations of KG-RAG frameworks: insufficient adaptability to downstream reasoning tasks and limited dynamicity in handling knowledge freshness and reliability. These factors are overlooked in recent KG refinement studies ( 58 ; 68 ) , which mainly focus on detecting factual errors and semantic inconsistencies. Firstly, adaptability refers to the ability to organize and retrieve knowledge in a manner that supports real-time queries. Naively applying RAG with existing KG frameworks often retrieves information that is semantically correct but contributes little to the query. For example, they may retrieve irrelevant triplets or overlook long-range dependencies required for complex reasoning ( 10 ; 98 ; 24 ) . This leads to ineffective reasoning and poor knowledge utilization. Secondly, dynamicity refers to the ability to detect and eliminate outdated or erroneous information. Existing KG-RAG frameworks are generally built on static KGs. They lack mechanisms for continuously detecting and eliminating invalid knowledge, such as outdated relations or KSGs that are no longer required by the downstream applications ( 27 ; 95 ) , leading to degraded reasoning performance. These limitations reveal a data management problem: how to continuously refine KG to improve adaptability and support dynamic evolution. We observe that feedback derived from generated contexts, such as signals on correctness, consistency, and user satisfaction, provides a valuable data source for continuously improving the KG. In LLM-based systems, such feedback is commonly obtained by leveraging LLMs to evaluate generated responses ( 50 ; 63 ; 32 ; 47 ; 86 ; 75 ; 59 ; 34 ) . Similar feedback may also come from human judgments ( 84 ; 90 ; 70 ; 76 ; 2 ) or comparisons with available ground truth ( 100 ; 23 ; 78 ) . Such feedback directly reflects reasoning effectiveness and can serve as a guidance signal for continuously refining the KG to improve task performance. However, a mismatch in granularity between feedback and KG refinement makes such integration difficult: feedback assesses overall response quality over multiple retrieved paths, whereas KG refinement operates at the level of individual triplets, leading to a mismatch as feedback reflects the combined effect of multiple interacting triplets rather than localized signals for each discrete and reusable knowledge units. As a result, feedback needs to be correctly attributed to reusable triplets across multiple reasoning paths and queries. Unlike traditional machine learning systems that explicitly construct a computation graph during the forward pass and rely on backpropagation to propagate gradients to model parameters, feedback-driven KG refinement lacks an inherent mechanism to propagate feedback to underlying triplets, requiring carefully designed algorithms to establish this association. In this work, we present EvoRAG, a self-evolving KG-RAG framework that utilizes feedback to continuously refine the KG, enhancing the accuracy and relevance of the reasoning process, as illustrated in Figure 1 . To realize this, EvoRAG introduces a feedback-driven backpropagation mechanism that establishes a connection between response-level feedback and triplet-level knowledge updates through two key stages. Firstly, EvoRAG attributes the feedback to individual reasoning paths by measuring their utility, i.e., how much each path contributes to the response reflected in the feedback. Reasoning paths are used as intermediates because they directly guide the LLM in generating the response, while also providing a natural bridge to the underlying triplets from which they are constructed. Secondly, EvoRAG propagates the path utility to update the contribution score of each involved triplet. These scores are maintained as learnable parameters and continuously updated across interactions, allowing EvoRAG to prioritize task-relevant knowledge. Through EvoRAG, we construct a closed-loop mechanism that tightly couples feedback, LLM reasoning, and triplet-level KG updates, continuously improving its accuracy in real-world queries. In summary, our primary contributions are as follows: • We propose a feedback-driven backpropagation mechanism that utilizes feedback to drive the evolution of the KG-RAG framework, enhancing adaptability and improving overall accuracy. • We introduce an effective mechanism that resolves the challenge of mapping response-level feedback to triplet-level updates, enabling fine-grained KG refinement and retrieval improvement. • We develop EvoRAG, a self-evolving KG-RAG framework that adapts to dynamic tasks and requirements. Experimental results demonstrate that EvoRAG improves accuracy by 7.34\% compared to the state-of-the-art KG-RAG frameworks. 2. Preliminary 2.1. KG-RAG RAG. Large language models (LLMs) ( 1 ; 56 ; 74 ; 73 ; 92 ) have recently demonstrated remarkable potential in handling complex