MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation

Xingchen Xiao, Heyan Huang, Runheng Liu, Jincheng Xie · 2026

Read MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation by Xingchen Xiao, Heyan Huang, Runheng Liu, Jincheng Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18509.txt.

Introduction

Xiao, Huang, Liu, and Xie propose MASS-RAG, a multi-agent approach to retrieval-boosted generation for noisy, gappy evidence. A single pass struggles to square spread-out contexts, so distinct agents condense evidence, extract evidence, and reason over files. A special merging stage combines those middle views into the final answer. Tests on four benchmarks show steady gains over strong RAG rivals, largest where key evidence spreads across pulled contexts.

Catalog record

CREATORXingchen Xiao, Heyan Huang, Runheng Liu, Jincheng Xie
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37982
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18509

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation Xingchen Xiao, Heyan Huang, Runheng Liu, Jincheng Xie Abstract Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) to incorporate external knowledge at inference time. However, when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process often struggles to reconcile evidence effectively. We propose MASS-RAG , a multi-agent synthesis approach to retrieval-augmented generation that structures evidence processing into multiple role-specialized agents. MASS-RAG applies distinct agents for evidence summarization, evidence extraction, and reasoning over retrieved documents, and combines their outputs through a dedicated synthesis stage to produce the final answer. This design exposes multiple intermediate evidence views, allowing the model to compare and integrate complementary information before answer generation. Experiments on four benchmarks show that MASS-RAG consistently improves performance over strong RAG baselines, particularly in settings where relevant evidence is distributed across retrieved contexts. Figure 1: A conceptual illustration of the key idea behind MASS-RAG, contrasting the multi-agent evidence filtering and synthesis with the previous single-filter agent method. 1 Introduction Large Language Models (LLMs) have demonstrated remarkable scalability and emergent capabilities ( 5 ; 37 ; 34 ; 29 ) . However, they remain susceptible to generating unreliable or hallucinatory outputs due to limited factual grounding and static knowledge. To address these limitations, Retrieval-Augmented Generation (RAG) has emerged as an effective paradigm to enhance factual reliability and broaden the knowledge scope of LLMs ( 16 ; 40 ; 2 ) . Updating the parametric knowledge of LLMs through fine-tuning or continual pre-training is both computationally intensive and costly ( 27 ) , making RAG integration a practical alternative for maintaining up-to-date knowledge at a lower cost ( 3 ) . Previous efforts on the RAG system have explored either pre-training models from scratch ( 4 ) or continually pre-training existing models to incorporate external knowledge ( 19 ; 35 ) . However, such approaches are computationally expensive and resource-intensive, which limits their scalability in real-world RAG applications ( 13 ) . As a result, recent RAG research has largely focused on combining retrievers for document selection with large language models (LLMs) for generation ( 30 ; 23 ; 32 ) . By leveraging external non-parametric knowledge sources, these systems enable knowledge updates without retraining the underlying LLMs. Nevertheless, LLMs remain susceptible to irrelevant or redundant retrieved information ( 24 ; 10 ) , which can degrade generation quality. Consequently, a key challenge is to ensure that RAG systems produce robust and factually accurate outputs when retrieved contexts are noisy or incomplete due to the inherent nature of the retrieval models ( 13 ; 2 ) . While recent multi-agent RAG framework proposed by 7 introduce agent-based context filtering, they typically rely on a single judge agent operating from a monolithic perspective, which limits the system’s ability to capture complementary or heterogeneous forms of factually relevant evidence. To address this challenge, we introduce MASS-RAG , a Multi-Agent Synthesis framework for retrieval-augmented generation. It operates in a training-free manner and employs multiple agents with specialized roles for context filtering, response generation, and answer synthesis. MASS-RAG integrates multiple specialized agents to capture complementary evidence in the retrieved context, thereby improving robustness and factual accuracy through structured multi-agent evidence filtering and synthesis. Figure 2: The overall architecture of MASS-RAG, illustrating multi-agent filtering and answer synthesis when the Answer Agent is enabled. Our contributions are as follows: • Multi-Agent Evidence Filtering: We introduce a set of specialized LLM-based filter agents that process retrieved documents from complementary perspectives, distilling denoised and query-relevant evidence in a training-free manner. • Multi-Agent Answering and Synthesis: We propose a synthesis mechanism that integrates structured outputs from multiple filter agents, optionally via intermediate candidate answers, to produce a unified final prediction. This design enables explicit comparison across heterogeneous evidence views and supports task-adaptive configurations. • Empirical Validation: We evaluate MASS-RAG across multiple benchmarks and analysis settings, demonstrating consistent improvements over strong RAG baselines, especially in scenarios requiring the aggregation of complementary evidence. 2 Related Work Evidence Refinement in RAG A variety of methods have been proposed to optimize the input context for retrieval-augmented generation (RAG). One intuitive line of work focuses on reranking retrieved documents 14 , which has been widely adopted and extended in subsequent studies 30 ; 1 ; 17 ; 39 . Other approaches aim to refine the input context through query rewriting 25 ; 6 , context filtering 36 ; 42 , or content compression and summarization 38 ; 17 . These methods primarily operate by improving the relevance or compactness of the retrieved context prior to generation. Our work follows the line of training-free methods but differs in that we introduce Multi-Agent Synthesis (MASS) , MASS-RAG adopts a multi-perspective filtering approach, employing multiple specialized agents to distill complementary and denoised evidence from retrieved documents while preserving query-relevant information. Multi-Agent RAG Recent studies have explored the use of multiple agents to enhance retrieval-augmented generation. Instead of relying on a single retriever–generator pipeline, multi-agent RAG frameworks distribute different sub-processes among specialized agents, such as query reformulation 9 , query decomposition 28 , and document filtering 7 . These approaches have demonstrated improved robustness and performance over traditional single-pipeline RAG systems. Our work follows the training-free setting of prior multi-agent RAG methods, but differs in its focus on evidence-centric synthesis. Specifically, MASS-RAG introduces a multi-agent synthesis framework in which distinct agents filter retrieved documents from complementary perspectives and generate denoised evidence representations that are subsequently integrated to produce a robust final answer. 3 Multi-Agent Synthesis RAG (MASS-RAG) 3.1 Definition of LLM Agents in MASS-RAG MASS-RAG decomposes retrieval-augmented generation into three stages: evidence distillation, candidate answer generation, and final answer synthesis. Accordingly, it consists of several specialized LLM agents, including a Summarizer, an Extractor, a Reasoner, a Synthesis Agent, and an optional Answer Agent. Among them, the Summarizer, Extractor, and Reasoner serve as filter agents that distill query-relevant evidence from retrieved documents, each emphasizing a distinct perspective on evidence processing. Summarizer Agent Prior work has shown that compressing retrieved documents can significantly improve RAG performance 38 ; 17 . Building on this insight, the Summarizer agent condenses the retrieved documents into a concise representation that preserves semantic consistency while highlighting salient, query-relevant information. Formally, the summarization process is defined as: R_{i}^{(s)}=\mathcal{A}_{\text{sum}}(q_{i},D), (1) where R_{i}^{(s)} denotes the summary-based filtered response. Extractor Agent The Extractor agent identifies fine-grained factual spans or sentences that explicitly support the answer to q_{i} without paraphrasing. Unlike the Summarizer, this agent strictly operates in an extractive manner, copying evidence verbatim from the retrieved documents, motivated by previous work on extractive QA 8 ; 22 . It is particularly suited for questions whose answers can be directly grounded in explicit textual evidence. This process is expressed as: R_{i}^{(e)}=\mathcal{A}_{\text{ext}}(q_{i},D), (2) where R_{i}^{(e)} consists of explicit evidence fragments aligned with the query semantics. Reasoner Agent The Reasoner agent performs reasoning over the retrieved content to infer implicit connections or cross-document evidence that may not be explicitly stated in any single sentence, as motivated by prior work on reasoning and relevance judgment in retrieval-augmented generation 1 ; 7 . The Reasoner Agent leverages the backbone language model to analyze the retrieved documents and explicitly articulate how the evidence supports the query, as well

Read the complete text