UnWeaving the knots of GraphRAG - turns out VectorRAG is almost enough

Ryszard Tuora, Mateusz GalińskiMichał GodziszewskiMichał KarpowiczMateusz CzyżnikiewiczAdam KozakiewiczTomasz Ziętkiewicz[2ex] Samsung AI Center Warsaw · 2026

Read UnWeaving the knots of GraphRAG - turns out VectorRAG is almost enough by Ryszard Tuora, Mateusz GalińskiMichał GodziszewskiMichał KarpowiczMateusz CzyżnikiewiczAdam KozakiewiczTomasz Ziętkiewicz[2ex] Samsung AI Center Warsaw (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29875.txt.

Introduction

Tuora and co-authors argue that plain vector search nearly matches graph-based retrieval systems. Chunk vectors mix a chunk's facts into one blob and ignore links between chunks. Graph systems fix that but add huge indexing cost and heuristic search. Their UnWeaver splits documents into entities that recur across chunks. Retrieval then uses entities to recover the original text. On end-to-end QA, VectorRAG beats standard GraphRAG. It nearly matches top graph systems at a fraction of the cost.

Catalog record

CREATORRyszard Tuora, Mateusz GalińskiMichał GodziszewskiMichał KarpowiczMateusz CzyżnikiewiczAdam KozakiewiczTomasz Ziętkiewicz[2ex] Samsung AI Center Warsaw
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37917
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29875

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UnWeaving the knots of GraphRAG - turns out VectorRAG is almost enough Ryszard Tuora, Mateusz GalińskiMichał GodziszewskiMichał KarpowiczMateusz CzyżnikiewiczAdam KozakiewiczTomasz Ziętkiewicz[2ex] Samsung AI Center Warsaw Abstract One of the key problems in Retrieval-augmented generation (RAG) systems is that chunk-based retrieval pipelines represent the source chunks as atomic objects, mixing the information contained within such a chunk into a single vector. These vector representations are then fundamentally treated as isolated, independent and self-sufficient, with no attempt to represent possible relations between them. Such an approach has no dedicated mechanisms for handling multi-hop questions. Graph-based RAG systems aimed to ameliorate this problem by modeling information as knowledge-graphs, with entities represented by nodes being connected by robust relations, and forming hierarchical communities. This approach however suffers from its own issues with some of them being: orders of magnitude increased componential complexity in order to create graph-based indices, and reliance on heuristics for performing retrieval. We propose UnWeaver, a novel RAG framework simplifying the idea of GraphRAG. UnWeaver disentangles the contents of the documents into entities which can occur across multiple chunks using an LLM. In the retrieval process entities are used as an intermediate way of recovering original text chunks hence preserving fidelity to the source material. We argue that entity-based decomposition yields a more distilled representation of original information, and additionally serves to reduce noise in the indexing, and generation process. 1 1 1 We’ll open source our code shortly 1 Introduction In this paper, we propose UnWeaver , a novel RAG framework that achieves better than graph-like retrieval precision without explicitly building a graph. The core idea is to provide to an LLM a query-relevant context based on vector similarity of an incoming query to the embeddings formed from the concatenated descriptions of equivalent entities (or, ideas) extracted from each document chunk. Based on that similarity of the query and the distilled entity-related content, distributed over all text chunks, query-relevant chunks are easily identified with a simple index (linear mapping). Then, the retriever produces relevant context from those chunks for LLM to perform well-grounded reasoning and accurate question answering. The core novelty here is the concatenation of chunk-based (local) descriptions of equivalent entities extracted from each chunk separately. When transformed into embeddings, these aggregated entity descriptions filter out what is irrelevant while amplifying pertinent information in relevant chunks. The results of experimental studies support that claim by showing how facts and evidence in the produced context guide LLM towards good answers and support simple reasoning. Related work: VectorRAG vs GraphRAG Large language models (LLMs) augmented with retrieval have become a cornerstone for knowledge-intensive tasks, from question answering to fact-checking. In a Retrieval-Augmented Generation (RAG) framework, LLM is supplied with relevant external documents (or document fragments) as context, which helps ground its output in factual information. This approach has been shown to significantly reduce open-domain hallucinations by allowing the model to draw on up-to-date or domain-specific knowledge instead of relying solely on parametric memory [ 15 ] . The original RAG system by Lewis et al. [ 14 ] demonstrated improved accuracy on knowledge-intensive NLP tasks by retrieving supporting passages. The effectiveness of a RAG-based system hinges on the quality of retrieval. Irrelevant or poorly chosen context can inject false or unrelated facts, increasing probability of factual errors or flawed reasoning in responses generated by LLM. One of key limitations of standard RAG pipelines is their reliance on coarse-grained text chunks. Documents are typically broken into fixed-length chunks that form the units of retrieval. While this helps the retrieved (hopefully) query-related context fit within LLM input limits, in practice these retrieved parts of available text may still contain superfluous or unrelated information. Consequently, RAG may amplify factual inaccuracies and hallucinations in generated responses, contrary to expectations [ 3 ] . Without external verification, LLMs generating response based on such a noisy context may follow off-topic details and incorporate them into their answers. Indeed, recent analyses confirm that filtering context yields noticeably more correct and concise answers [ 8 ] . 2 2 2 In fact, as demonstrated by Karpowicz [ 12 ] , since there is no way to eliminate LLM hallucinations, we can only manage the related tradeoffs. Designing RAG systems is one of the most reasonable ways to do that, provided we have a good way of retrieving relevant knowledge (in a way aligned with our preferences). A promising way to address that problem is to incorporate structured knowledge graph (KG) into the RAG pipeline (see the survey [ 7 ] ). The motivation for graph-based RAG (GraphRAG for short) is that a knowledge graph can represent information at a finer granularity. Knowledge graph essentially unweaves the source text into a graph of connected entities (e.g., people, places, concepts), with labeled edges representing discovered relationships (their strength, nature or description). Such graph-structured data can make it easier to reason over relevant facts without interference from unrelated context. In principle, the structured nature of a KG promises deeper and more contextual retrieval than flat text similarity search. Despite their well-known advantages, GraphRAG solutions come with significant practical challenges. Constructing and maintaining a graph index of a large text corpus is a non-trivial endeavor. Unlike vector index in VectorRAG systems built directly on text embeddings, a graph index requires multiple complex steps. These include, e.g., running named entity recognition, extracting relational triples or entity links, and possibly performing clustering or ontology alignment to organize the graph. This added componential complexity means high development and computation costs. For instance, the MSGraphRAG pipeline [ 4 ] involves building an entire knowledge graph from the corpus, then performing hierarchical community detection on the graph and generating summaries for each cluster—an elaborate process with many moving parts. Furthermore, graph retrieval itself is less straightforward than vector similarity search. One cannot simply embed a query and do k -NN search over nodes. Instead, tailored algorithms or heuristics are needed to traverse or query the graph structure. Prior work has explored techniques like translating natural language questions into structured graph queries (in SPARQL or Cypher), performing multi-hop subgraph searches. But these often require dedicated graph database and careful hand-tuning of query logic. As a result, GraphRAG typically demands orders of magnitude more engineering effort and can suffer from scalability issues when dealing with millions of nodes or edges. All that raises an intriguing question. Is it possible to obtain the benefits of graph-based retrieval—improved relevance and reduced noise—without the heavy machinery of full-scale knowledge graphs? Contributions Figure 1 : Architecture of UnWeaver The approach we propose in this paper leverages entity-centric retrieval inspired by knowledge graphs, yet it maintains the simplicity and speed of a standard vector-based pipelines (operating on refined text embeddings). That suggests there is really no need for complex and costly graph traversal or maintaining separate graph databases when documents contain separable ideas that can be named and described without much ambiguity. Our experimental results show that UnWeaver yields higher answer accuracy and faithfulness compared to conventional chunk retrieval baselines, demonstrating a clear reduction in hallucinated or off-target details. Moreover, this is achieved with negligible additional latency, since the entity-indexing step is done offline and query-time retrieval remains a fast embedding lookup. UnWeaver remains firmly

Read the complete text