SRAG: RAG with Structured Data Improves Vector Retrieval
Shalin Shah, Srikanth Ryali, Ramasubbu Venkatesh · 2026
Read SRAG: RAG with Structured Data Improves Vector Retrieval by Shalin Shah, Srikanth Ryali, Ramasubbu Venkatesh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26670.txt.
Introduction
Shah, Ryali, and Venkatesh propose Structured RAG, which enriches both queries and chunks with structured tags before vector search. Plain RAG ranks chunks by embedding closeness alone, which can miss the right evidence. Their tags add topics, sentiment, item types, knowledge graph triples, and semantic labels. A GPT-5 judge scores the answers produced under each setup. Answer scores rise by 30% with the structured tags, with the largest gains on comparative, analytical, and predictive questions. Losses, when they occur, stay small.
Catalog record
| CREATOR | Shalin Shah, Srikanth Ryali, Ramasubbu Venkatesh |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19494 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.26670
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SRAG: RAG with Structured Data Improves Vector Retrieval Shalin Shah, Srikanth Ryali, Ramasubbu Venkatesh Abstract Retrieval Augmented Generation (RAG) provides the necessary informational grounding to LLMs in the form of chunks retrieved from a vector database or through web search. RAG could also use knowledge graph triples as a means of providing factual information to an LLM. However, the retrieval is only based on representational similarity between a question and the contents. The performance of RAG depends on the numeric vector representations of the query and the chunks. To improve these representations, we propose Structured RAG (SRAG), which adds structured information to a query as well as the chunks in the form of topics, sentiments, query and chunk types (e.g., informational, quantitative), knowledge graph triples and semantic tags. Experiments indicate that this method significantly improves the retrieval process. Using GPT-5 as an LLM-as-a-judge, results show that the method improves the score given to answers in a question answering system by 30% (p-value = 2e-13) (with tighter bounds). The strongest improvement is in comparative, analytical and predictive questions. The results suggest that our method enables broader, more diverse, and episodic-style retrieval. Tail risk analysis shows that SRAG attains very large gains more often, with losses remaining minor in magnitude. Keywords : Retrieval Augmented Generation (RAG), Structured RAG, Structured Metadata, Semantic Tags, Knowledge Graph Triples, Sentiments, Topics, Query Decomposition, Chunk and Query Classes, Financial Question Answering, Representation Learning and Embeddings, SRAG 1 Introduction Retrieval augmented generation (RAG) [ 1 ] is a widely known method which retrieves information through retrieval from external sources and passes in that information to an LLM [ 2 ] [ 3 ] through prompting. RAG uses vector databases to store the external information, and retrieves the information through vector search. This provides informational grounding, though not epistemic grounding [ 4 ] . We propose a method that uses tagging without requiring changes to the underlying system architecture. The only thing that needs a change is in the way chunks are added to a vector database. We conjecture that SRAG supports episodic-style retrieval and may facilitate latent generalization. Our method does not induce learning in the parametric sense, nor does it alter the model’s internal knowledge representations. Instead, we position Structured RAG as supporting in-context generalization by enabling episodic-style retrieval that makes previously encountered information available in context, where it can be flexibly reused. Recent work in [ 5 ] argues that many generalization failures in large language models arise not because the necessary information is absent, but because it is latent-encoded in prior experiences yet inaccessible without reinstating those experiences into context. Episodic retrieval complements parametric learning by converting such latent information into usable in-context evidence, allowing models to apply reasoning procedures they already possess in novel task settings. Our results are consistent with this perspective: by augmenting both queries and chunks with structured metadata, we systematically alter retrieval behavior in a way that promotes broader, more diverse, and semantically aligned retrieval. The resulting improvements on analytical, comparative, and predictive queries suggest that Structured RAG facilitates flexible reuse of information that would otherwise remain inaccessible under similarity-only retrieval. Broad and diverse retrieval supports episodic retrieval by increasing the chance that a system reinstates the right past experience, rather than only the most surface-level similar chunk. Generalization failures arise when information learned under one task or format cannot be reused for a different future task because the relevant experience is absent from context. Our method promotes broad and diverse retrieval by augmenting both queries and chunks with structured metadata, such as topics, query types, semantic tags, and knowledge graph triples, which shifts retrieval from purely embedding similarity toward structural, relational, and task-level alignment. This reduces over-filtering by lexical similarity and surfaces experiences that are relevant in how they can be used, not just what they say. By reinstating these latent-bearing experiences into context, the model’s in-context reasoning mechanisms can flexibly recombine prior knowledge, approximating episodic retrieval and mitigating generalization failures that parametric learning alone cannot resolve. There have been attempts at adding structured data to standard RAG. The recent work in [ 6 ] adds metadata to the chunks and finds similar results, but we add many more types of structured data to the chunks. Furthermore, our claim is stronger through significance testing and tail risk analysis. The work in [ 7 ] uses tagging but only at inference time i.e., the tags are passed to an LLM in the prompt, without any need for re-chunking. The methods in [ 8 ] create a structured representation of the corpus and at inference time, it creates structured queries to query the knowledge base. The methods in [ 9 ] use a knowledge graph for structured RAG, and they use a knowledge graph for structured retrieval, resulting in a significant infrastructural effort. [ 10 ] describes a method that uses knowledge graphs as a separate component to retrieve triples through a database and pass them to an LLM through a prompt. Our method differs from these, in that, our method does not require architectural changes i.e., the vector database component does not need any modifications. Our method requires re-chunking, but no other infrastructure change is required. Our proposed method uses tagging of both queries and chunks. The chunks are augmented with these tags in the form of semantic metadata. At inference time, the question is also tagged. Rest of the system remains unaltered i.e., the tagged query retrieves the tagged chunks. The tagged chunks are added to the prompt and the LLM synthesizes the answer. We tag the queries and chunks with sentiments, topics, semantic tags, knowledge graph triples and the query and chunk classes. The classes are things such as quantitative, comparative, analytical, information lookup, informational etc., which help semantic separation of the chunks. Moreover, we add KG triples to the chunks as well as the query which helps needle in a haystack problems, as well as reasoning problems (e.g., the analytical and comparative query classes) [ 11 ] . Our methods improve comparative, analytical and predictive queries by a large magnitude, indicating that it could be helping LLMs reason better. By tagging the query as well as the chunks, we add metadata (key value pairs as tags) which improves retrieval though better representations. Our method might also improve search and information retrieval based on LLMs [ 12 ] . Here are example queries for which our method is significantly superior (with a GPT-5.2 classification of the episodic retrieval impact ): • How does Apple’s AI and on-device intelligence strategy compare to peers such as Microsoft, Google, and Amazon? ( Impact: High ) • How does Apple’s free cash flow conversion compare to large-cap technology peers? ( Impact: High ) • How does Apple’s valuation multiple compare to its historical average? ( Impact: High ) • How does Apple’s exposure to discretionary consumer spending affect revenue growth volatility? ( Impact: High ) • What are the key risks to achieving the upper end of Apple’s FY2025 guidance? ( Impact: High ) • How does Apple’s valuation sensitivity change with USD movements against major currencies? ( Impact: Medium ) • How do productivity and automation improvements affect Apple’s hiring plans