KET-RAG : A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAG

Yiqian Huang, Shiqi Zhang, Xiaokui Xiao · 2025

Read KET-RAG : A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAG by Yiqian Huang, Shiqi Zhang, Xiaokui Xiao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09304.txt.

Introduction

Yiqian Huang, Shiqi Zhang, and Xiaokui Xiao present KET-RAG, a cheaper way to build the knowledge graphs that power graph-based question answering, in a 2025 paper. Such systems answer multi-step questions over private documents by linking facts into a graph. Extracting every entity and relation with a large model gives quality but costs a fortune on big collections.

KET-RAG instead picks a few key chunks and has the model build a graph skeleton from those alone. All chunks also join a light bipartite graph of texts and keywords, which stands in for the full graph. Retrieval searches both structures together. Against thirteen rivals on three datasets, the method won on cost, retrieval, and answer quality, matching a leading system at far lower indexing cost.

Catalog record

CREATORYiqian Huang, Shiqi Zhang, Xiaokui Xiao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09304

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

KET-RAG : A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAG Yiqian Huang, Shiqi Zhang, Xiaokui Xiao Abstract . Graph-RAG constructs a knowledge graph from text chunks to improve retrieval in Large Language Model (LLM)-based question answering. It is particularly useful in domains such as biomedicine, law, and political science, where retrieval often requires multi-hop reasoning over proprietary documents. Some existing Graph-RAG systems construct KNN graphs based on text chunk relevance, but this coarse-grained approach fails to capture entity relationships within texts, leading to sub-par retrieval and generation quality. To address this, recent solutions leverage LLMs to extract entities and relationships from text chunks, constructing triplet-based knowledge graphs. However, this approach incurs significant indexing costs, especially for large document collections. To ensure a good result accuracy while reducing the indexing cost, we propose KET-RAG , a multi-granular indexing framework. KET-RAG first identifies a small set of key text chunks and leverages an LLM to construct a knowledge graph skeleton. It then builds a text-keyword bipartite graph from all text chunks, serving as a lightweight alternative to a full knowledge graph. During retrieval, KET-RAG searches both structures: it follows the local search strategy of existing Graph-RAG systems on the skeleton while mimicking this search on the bipartite graph to improve retrieval quality. We evaluate 13 solutions on three real-world datasets, demonstrating that KET-RAG outperforms all competitors in indexing cost, retrieval effectiveness, and generation quality. Notably, it achieves comparable or superior retrieval quality to Microsoft’s Graph-RAG while reducing indexing costs by over an order of magnitude. Additionally, it improves the generation quality by up to 32.4% while lowering indexing costs by around 20%. Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’25), August 3–7, 2025, Toronto, ON, Canada DOI: 10.1145/3711896.3737012 ISBN: 979-8-4007-1454-2/2025/08 CCS: Information systems Retrieval models and ranking CCS: Computing methodologies Information extraction CCS: Computing methodologies Knowledge representation and reasoning 1. Introduction Given a set of text chunks \mathcal{T} , Graph-based Retrieval-Augmented Generation ( Graph-RAG ) ( NebulaGraph, 2023 ; Edge et al., 2024 ) enhances generative model inference by structuring \mathcal{T} into a Text-Attributed Graph (TAG) \mathcal{G} and retrieving relevant information from it. Compared to Text-RAG ( Lewis et al., 2020 ) , which retrieves independent text chunks from \mathcal{T} , Graph-RAG captures relationships within and across text snippets to enhance multi-hop reasoning ( Peng et al., 2024 ; Delile et al., 2024 ; Jin et al., 2024 ) . Graph-RAG has gained widespread adoption across domains such as e-commerce ( Wang et al., 2022 ; Xu et al., 2024 ) , biomedical research ( Delile et al., 2024 ; Li et al., 2024b ) , healthcare ( Chen et al., 2024 ) , political science ( Mou et al., 2024 ) , legal applications ( Colombo, 2024 ; Kalra et al., 2024 ) , and many others ( Alhanahnah et al., 2024 ; Peng and Yang, 2024 ) . Some studies ( Li et al., 2024a ; Wang et al., 2024 ) instantiate TAG \mathcal{G} as a K-nearest-neighbor (KNN) graph, where nodes represent text chunks in \mathcal{T} , and edges encode semantic similarity or relevance. This approach maintains a low graph construction cost comparable to Text-RAG . However, it fails to capture entities and their relationships within text chunks, limiting retrieval effectiveness and degrading the quality of generated answers. To address this limitation, recent studies ( Li et al., 2024b ; Delile et al., 2024 ; Edge et al., 2024 ; Gutierrez et al., 2024 ) have turned to triplet-based knowledge graphs, leveraging Large Language Models (LLMs) to extract structured (entity, relation, entity) triplets from text. This approach, known as KG-RAG , enbales the LLM to filter out noise in raw documents and construct a more structured and interpretable knowledge base, significantly improving retrieval and generation quality. As a result, it has gained significant traction by major companies, including Microsoft ( Edge et al., 2024 ) , Ant Group ( Group and OpenKG, 2023 ) , Neo4j ( Neo4j, 2023 ) , and NebulaGraph ( NebulaGraph, 2023 ) . However, KG-RAG comes with a high indexing cost, particularly for large datasets. Even with the cost-efficient GPT-4o-mini API, processing a 3.2MB sample of the HotpotQA dataset ( Yang et al., 2018 ) costs $21. In real-world applications, textual data often spans gigabytes to terabytes, making indexing costs prohibitively expensive. For instance, processing a single 5GB legal case ( Arnold and Romero, 2022 ) incurs an estimated $33K, posing a significant challenge for large-scale adoption. To improve retrieval and generation quality while lowering indexing costs, we propose KET-RAG , a cost-efficient multi-granular indexing framework for Graph-RAG . It comprises two key components: a knowledge graph skeleton and a text-keyword bipartite graph. Instead of fully materializing the knowledge graph, KET-RAG first identifies a set of core text chunks from \mathcal{T} based on their PageRank centralities ( Page et al., 1999 ) in an intermediate KNN graph. It then constructs a skeleton of the complete knowledge graph using KG-RAG described above. To prevent information loss from relying solely on this skeleton, KET-RAG also builds a text-keyword bipartite from \mathcal{T} , serving as a lightweight alternative to KG-RAG . By linking keywords to the text chunks in which they appear, keywords and their neighboring text chunks can be regarded as candidate entities and corresponding relations in the knowledge graph. During retrieval, KET-RAG adopts the local search strategy of existing solutions but, unlike previous methods, extracts ego networks from both entity and keyword channels to facilitate LLM-based generation. In experiments, we evaluate 13 solutions on three datasets across three key aspects: indexing cost, retrieval quality, and generation quality. Notably, KET-RAG achieves retrieval quality comparable to or better than Microsoft’s Graph-RAG ( Edge et al., 2024 ) , the state-of-the-art KG-RAG solution, while reducing indexing costs by over an order of magnitude. At the same time, it improves generation quality by up to 32.4% while lowering indexing costs by approximately 20%. Furthermore, the core components of KET-RAG , Skeleton-RAG and Keyword-RAG , also function as effective stand-alone RAG solutions, balancing efficiency and quality. In particular, Skeleton-RAG reduces indexing costs by 20% while maintaining retrieval quality, showing only minor performance drops in low-cost settings and achieving parity or even slight improvements in high-accuracy configurations. Meanwhile, Keyword-RAG consistently outperforms the vanilla Text-RAG in both retrieval and generation quality, achieving up to 92.4%, 133.3%, 118.5%, and 12.9% relative improvements in Coverage, EM, F1 scores, and BERTScore, respectively, while exhibiting no compromise in retrieval latency. To summarize, we make the following contributions in this work: • We propose KET-RAG , a cost-efficient multi-granular indexing framework for Graph-RAG , integrating two complementary components to balance indexing cost and result quality. • We introduce Skeleton-RAG , which constructs a knowledge graph skeleton by selecting core text chunks and leveraging LLMs to extract structured knowledge. • We develop Keyword-RAG , a lightweight text-keyword bipartite graph that mimics the retrieval paradigm of KG-RAG while significantly reducing indexing costs. • We conduct extensive experiments demonstrating the improvements of our proposed solutions. 2. Preliminaries We first define the key terminologies

Read the complete text