How to Mitigate Information Loss in Knowledge Graphs for GraphRAG: Leveraging Triple Context Restoration and Query-Driven Feedback

Manzong Huang, Chenyang Bu, Yi He, Xindong Wu · 2025

Read How to Mitigate Information Loss in Knowledge Graphs for GraphRAG: Leveraging Triple Context Restoration and Query-Driven Feedback by Manzong Huang, Chenyang Bu, Yi He, Xindong Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15378.txt.

Introduction

Manzong Huang and co-authors patch a leak in how language models use knowledge graphs. Turning text into tidy triples drops the context that gives facts their sense. Their framework rebuilds the lost wording behind each triple. It also lets each user question feed back, pulling missing facts into the graph on the fly.

Across five question answering benchmarks, the method beat rival graph aided systems by wide margins on exact answers and overlap scores. The gains held across varied datasets. The authors argue no real graph is ever complete, so retrieval systems should repair loss as they go.

Catalog record

CREATORManzong Huang, Chenyang Bu, Yi He, Xindong Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-15378

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

How to Mitigate Information Loss in Knowledge Graphs for GraphRAG: Leveraging Triple Context Restoration and Query-Driven Feedback Manzong Huang, Chenyang Bu, Yi He, Xindong Wu Abstract Knowledge Graph (KG)-augmented Large Language Models (LLMs) have recently propelled significant advances in complex reasoning tasks, thanks to their broad domain knowledge and contextual awareness. Unfortunately, current methods often assume KGs to be complete, which is impractical given the inherent limitations of KG construction and the potential loss of contextual cues when converting unstructured text into entity-relation triples. In response, this paper proposes the Triple Context Restoration and Query-driven Feedback (TCR-QF) framework, which reconstructs the textual context underlying each triple to mitigate information loss, while dynamically refining the KG structure by iteratively incorporating query-relevant missing knowledge. Experiments on five benchmark question-answering datasets substantiate the effectiveness of TCR-QF in KG and LLM integration, where it achieves a 29.1% improvement in Exact Match and a 15.5% improvement in F1 over its state-of-the-art GraphRAG competitors. The code is publicly available at https://github.com/HFUT-DMiC-Lab/TCR-QF.git. 1 Introduction Large Language Models (LLMs) augmented with Knowledge Graphs (KGs) have achieved remarkable successes across diverse domains, from social sciences to biomedicine Pan et al. (2024) ; Peng et al. (2024) ; Yang et al. (2024) ; Soman et al. (2024) . By harmonizing the structured information in KGs and the sophisticated language understanding and processing capabilities of LLMs, such hybrid systems enable more accurate and context-aware reasoning for complex tasks. Figure 1: Illustration of two main factors of information loss in KGs: information sparsity and context loss . These issues hinder LLMs from accurately answering questions based on KGs. Despite these advances, the performance of current KG–LLM integration methods is often hindered by the underlying assumption that the KG is complete. Typical integration strategy involves retrieving relational data from a constructed KG and feed it into LLMs via prompt augmentation Peng et al. (2024) ; Sun et al. (2023) ; Edge et al. (2024) ; Zhang et al. (2025b) ; Dehghan et al. (2024) , assuming that critical entities and relationships relevant to the query are already captured within the KG. In practice, however, KG construction itself is beset by inherent constraints, where vital contextual information can be discarded in the process of converting unstructured text into structured triples, leading to missing or incomplete relations Zhu et al. (2024) ; Zhong et al. (2024) . Such missing information in KGs can significantly degrade the LLM reasoning capabilities. To wit, Figure 1 illustrates two primary sources of information loss. First, information sparsity arises when information extraction falls short, omitting potentially important triples and thus failing to provide sufficient coverage for specific queries Biswas et al. (2024) ; Xu et al. (2024b) ; Li et al. (2023) ; Zhang and Soh (2024) ; Chen et al. (2024a) ; Sun et al. (2024) ; Cohen et al. (2023) . This sparsity can be exacerbated by data noise, long-tail entities, and complex relationships, where extraction algorithms often falter. Second, context loss occurs when transforming rich yet unstructured text into discrete triples, sacrificing crucial semantic nuances and relational dependencies Trisedya et al. (2019) ; Paulheim (2017) ; Xu et al. (2024a) . While prior studies attempt to mitigate this issue by refining graph structures or retrieval algorithms Liang et al. (2024) ; Chen et al. (2024b) ; Panda et al. (2024) ; Munikoti et al. (2023) ; Cohen et al. (2023) , their subgraphs still lack the broader contextual information that is vital for robust reasoning, resulting in suboptimal performance in downstream tasks. To address these challenges, we propose the T riple C ontext R estoration and Q uestion-driven F eedback (TCR-QF) framework, which aims to restore the missing contextual information and dynamically enrich the KG during the reasoning process. Specifically, our TCR-QF approach presents a triple context restoration component that retrieves the original text passages associated with each triple, thereby recapturing the semantic details often lost during KG construction. We further enhance KG coverage through a query-driven feedback mechanism, which iteratively identifies missing information relevant to the query and enriches the KG accordingly. These two components together form a synergistic cycle in which contextual fidelity and KG completeness are continuously reinforced, resulting in more accurate and context-aware responses from the LLM. Empirical study on five benchmark question-answering datasets substantiates that TCR-QF significantly outperforms the state-of-the-art GraphRAG methods in both response accuracy and completeness, demonstrating its effectiveness. Specific Contributions of this paper are as follows: 1) We provide a systematic analysis of the key challenges in KG–LLM integration, highlighting the loss of contextual information and incomplete information extraction during KG construction, both of which hinder an advanced LLM reasoning performance. 2) We propose the TCR-QF framework, which restores the semantic context associated with triples and employs a query-driven feedback mechanism to iteratively enrich the KG, thereby significantly enhancing the LLM reasoning capabilities. 3) Extensive experiments on five benchmark question-answering datasets are carried out, showing that TCR-QF achieves an average 29.1% improvement in Exact Match and a 15.5% improvement in F1 over its GraphRAG competitors. These results validate the merit of restoring contextual information and dynamically updating KGs for effective KG–LLM integration. 2 Related Work GraphRAG has emerged as a powerful paradigm for integrating knowledge graphs (KGs) with large language models (LLMs) to advance complex reasoning tasks Pan et al. (2024) ; Peng et al. (2024) ; Yang et al. (2024) ; Zhang et al. (2024) ; Zhang et al. (2025a) . A widely adopted strategy involves retrieving relevant subgraphs from preconstructed KGs to augment LLMs during inference Yasunaga et al. (2021) ; Taunk et al. (2023) , with techniques such as extracting hop- k paths around topic entities Yasunaga et al. (2021) or focusing on the shortest paths relevant to query entities Delile et al. (2024) . More sophisticated methods optimize subgraph retrieval by assigning edge costs He et al. (2024) or leverage LLMs themselves to generate new relations or invoke function calls Kim et al. (2023) ; Jiang et al. (2023) . While these approaches have demonstrated effectiveness, most remain limited by their dependence on the initial completeness of the KG and often overlook the contextual information lost during KG construction. In reality, KGs are frequently incomplete due to information loss during construction and the difficulties in extracting all relevant triples, especially in noisy or complex scenarios Biswas et al. (2024) ; Cohen et al. (2023) . These constraints can hinder the ability of LLMs to formulate coherent and context-rich reasoning paths. Addressing these gaps calls for a more dynamic strategy that restores missing contextual details and continuously refines the KG, ensuring that the retrieved and generated knowledge is both accurate and semantically complete. However, the lack of essential data negatively impacts the inference results of LLMs. To address this, efforts have been made to enhance KG comprehensiveness through refined indexing methods and innovative graph structures for retrieving both triples and texts Chen et al. (2024b) ; Munikoti et al. (2023) ; Liang et al. (2024) ; Cohen et al. (2023) , as well as using LLMs to improve automated KG construction Zhang and Soh (2024) ; Xu et al. (2024b) ; Li et al. (2023) . These methods may retrieve texts related to the query without

Read the complete text