Graphs RAG at Scale: Beyond Retrieval-Augmented Generation with Labeled Property Graphs and Resource Description Framework for Complex and Unknown Search Spaces
Manie Tadayon, Mayank Gupta · 2026
Read Graphs RAG at Scale: Beyond Retrieval-Augmented Generation with Labeled Property Graphs and Resource Description Framework for Complex and Unknown Search Spaces by Manie Tadayon, Mayank Gupta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22340.txt.
Introduction
Tadayon and Gupta build a Graph RAG system for unknown or structured search spaces. Classic retrieval-augmented generation struggles there, since it leans on flat document chunks. Their system stores knowledge as labeled property graphs and as RDF data. Documents become RDF triplets built from JSON key-value pairs. That lets semi-structured data join the graph cleanly. A text-to-Cypher tool turns user questions into graph queries with over 90 percent accuracy. Tests show the graph system beats embedding-based RAG on accuracy and reasoning.
Catalog record
| CREATOR | Manie Tadayon, Mayank Gupta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49328 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22340
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Graphs RAG at Scale: Beyond Retrieval-Augmented Generation with Labeled Property Graphs and Resource Description Framework for Complex and Unknown Search Spaces Manie Tadayon, Mayank Gupta Abstract Recent advances in Retrieval-Augmented Generation (RAG) have revolutionized knowledge-intensive tasks, yet traditional RAG methods struggle when the search space is unknown or when documents are semi-structured or structured. We introduce a novel end-to-end Graph RAG framework that leverages both Labeled Property Graph (LPG) and Resource Description Framework (RDF) architectures to overcome these limitations. Our approach enables dynamic document retrieval without the need to pre-specify the number of documents and eliminates inefficient reranking. We propose an innovative method for converting documents into RDF triplets using JSON key-value pairs, facilitating seamless integration of semi-structured data. Additionally, we present a text to Cypher framework for LPG, achieving over 90% accuracy in real-time translation of text queries to Cypher, enabling fast and reliable query generation suitable for online applications. Our empirical evaluation demonstrates that Graph RAG significantly outperforms traditional embedding-based RAG in accuracy, response quality, and reasoning, especially for complex, semi-structured tasks. These findings establish Graph RAG as a transformative solution for next-generation retrieval-augmented systems. Keywords Graph RAG, RAG, LPG, RDF, Knowledge Graph, SPARQL, Open-Cypher, Amazon Neptune, NetworkX 1 Introduction Large Language Models (LLMs) have rapidly transformed the landscape of machine learning and artificial intelligence, enabling breakthroughs in natural language understanding, question answering, summarization, and creative text generation. Their remarkable ability to synthesize information and generate coherent, contextually relevant responses has unlocked new possibilities across domains such as healthcare, finance, law and technology [ 7 , 8 , 9 ] . However, despite their impressive capabilities, LLMs are fundamentally limited by the static nature of their training data, often leading to outdated knowledge and, more critically, the phenomenon of hallucination—where the model generates plausible-sounding but factually incorrect or unverifiable information. Hence it is crucial to augment LLMs with dynamic, reliable sources of information to improve accuracy and reduce hallucinations. One approach to mitigate the limitations of static LLMs is continual pretraining and supervised fine-tuning, where the model is further trained on new or specialized data to incorporate recent knowledge or adapt to particular tasks. While this strategy can enhance model relevance and performance in targeted domains, it is often prohibitively time-consuming and computationally expensive. Continual fine-tuning requires access to large-scale, high-quality datasets and significant hardware resources, Moreover, fine-tuning may risk catastrophic forgetting of previously acquired knowledge and can introduce new biases or inconsistencies. These challenges make continual fine-tuning impractical for many real-world applications that demand timely, cost-effective, and reliable access to up-to-date information. To address these challenges, Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm, combining the generative prowess of LLMs with dynamic access to external knowledge sources [ 20 , 19 , 13 , 3 ] . By retrieving relevant documents or facts at inference time, RAG systems can ground their responses in up-to-date, authoritative information, significantly reducing hallucinations and improving factual accuracy. This approach has proven invaluable for applications requiring real-time knowledge, such as customer support, legal research, and scientific discovery. Yet, traditional RAG frameworks are not without their own limitations. Most existing RAG systems rely on dense vector embeddings and similarity search over unstructured text corpora. This design assumes a well-defined search space and often requires the number of documents to retrieve to be specified in advance. Such constraints become problematic in scenarios where the search space is unknown, the data is semi-structured or structured (e.g., key-value pairs JSON, tables), or when relationships between entities are complex and multi-faceted. Moreover, traditional RAG pipelines heavily depend on embedding and reranking models to select the most relevant documents, introducing inefficiencies and potential bottlenecks [ 31 , 24 ] . Graphs offer a compelling alternative for representing and querying complex, interconnected data. By modeling information as nodes and edges, graphs naturally capture relationships, hierarchies, and multi-modal connections that are difficult to express in flat text. Graphs have achieved remarkable success across a wide range of domains, including healthcare, education, recommender systems, and etc. For example, in education, graph-based representations such as knowledge graphs, Bayesian networks and causal graphs facilitate personalized learning pathways and knowledge tracing by capturing dependencies between concepts and student progress [ 1 , 10 , 33 , 29 ] . Recommender systems leverage graph machine learning to model user-item interactions and uncover latent preferences, leading to more accurate and diverse recommendations [ 30 , 22 , 15 ] . By representing domain knowledge as directed graphs, these approaches enable powerful reasoning, efficient inference, and the integration of heterogeneous data sources, driving advances in both predictive performance and interpretability. Graph-based Retrieval-Augmented Generation (Graph RAG) leverages this expressive power, enabling more flexible, context-aware retrieval and reasoning. In [ 12 ] , The authors propose a framework where an LLM constructs a knowledge graph from source documents, detects hierarchical communities within the graph, and generates summaries for each community in a bottom-up manner. For query answering, the system combines relevant community summaries using a map-reduce approach to produce comprehensive answers. In [ 35 ] , The authors present a unified framework for Graph RAG, identifying a multiple modular operators that underpin retrieval pipelines. They systematically compare existing Graph RAG methods across diverse QA datasets, introduce new variants that achieve state-of-the-art results, and demonstrate that explicit knowledge graph modeling enhances reasoning, factuality, and interpretability. In [ 32 ] , The authors present MedGraphRAG, a graph-based Retrieval-Augmented Generation framework tailored for the medical domain to enhance LLM safety and reliability. In [ 28 ] , the authors provide a survey of approaches that integrate KGs with LLM-based RAG to advance reliable, focused retrieval for specialized applications. The contributions of this paper are threefold. First, we propose a novel end-to-end Graph RAG framework that constructs RDF-based knowledge graphs from semi-structured JSON data, enabling dynamic and scalable retrieval-augmented generation. Second, we develop a LPG framework by first constructing a text-to-Cypher query generation module, leveraging LLMs to translate user questions into executable Cypher queries in real time by augmenting prompts with graph schema, structure, and metadata. Third, we conduct a comprehensive empirical comparison between our RDF and LPG-based Graph RAG architectures and traditional embedding-based RAG, demonstrating that both graph-based approaches consistently outperform standard RAG in accuracy, reasoning, and response quality. The remainder of this paper is organized as follows: Section 2 reviews background; Section 3 describes the data and experimental setup; Section 4 details our methodology; Section 5 presents results and discussion; Section 6 outlines potential avenues for future research and Section 7 concludes the paper. 2 Background In this section, we provide an overview of some of the key concepts relevant to the rest of paper. 2.1 Retrieval-Augmented Generation (RAG) Retrieval-Augmented Generation (RAG) is a paradigm that enhances large language models (LLMs) by integrating external knowledge sources into the generation process. Unlike standard LLMs, which rely solely on their training data and may produce outdated or hallucinated information, RAG systems dynamically retrieve relevant documents or facts at inference time. This retrieval step grounds the model’s responses in up-to-date, authoritative information, significantly improving factual accuracy and reducing hallucinations. RAG primarily consists of two components: a retriever, which searches a large corpus for passages relevant to the input query, and a generator, which