Federated Retrieval-Augmented Generation: A Systematic Mapping Study
Abhijit Chakraborty, Chahana Dahal, Vivek Gupta · 2025
Read Federated Retrieval-Augmented Generation: A Systematic Mapping Study by Abhijit Chakraborty, Chahana Dahal, Vivek Gupta (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18906.txt.
Introduction
Abhijit Chakraborty, Chahana Dahal and Vivek Gupta map the young field of federated retrieval-augmented generation, in work from 2025. The approach joins federated learning, which trains across sites without pooling raw data, with retrieval that grounds language model answers in outside knowledge. Privacy-sensitive fields such as health and finance are the natural market.
Following standard mapping guidelines, the study sorts papers from 2020 to 2025 by focus, contribution and domain. Recurring designs are drawn out, along with hard spots: private retrieval, uneven clients and weak evaluation habits. The authors close with open questions meant to ground the next wave of work.
Catalog record
| CREATOR | Abhijit Chakraborty, Chahana Dahal, Vivek Gupta |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18906
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Federated Retrieval-Augmented Generation: A Systematic Mapping Study Abhijit Chakraborty, Chahana Dahal, Vivek Gupta Abstract Federated Retrieval-Augmented Generation (Federated RAG) combines Federated Learning (FL),which enables distributed model training without exposing raw data, with Retrieval-Augmented Generation (RAG), which improves the factual accuracy of language models by grounding outputs in external knowledge. As large language models are increasingly deployed in privacy-sensitive domains such as healthcare, finance, and personalized assistance, Federated RAG offers a promising framework for secure, knowledge-intensive natural language processing (NLP). To the best of our knowledge, this paper presents the first systematic mapping study of Federated RAG, covering literature published between 2020 and 2025. Following Kitchenham’s guidelines for evidence-based software engineering, we develop a structured classification of research focuses, contribution types, and application domains. We analyze architectural patterns, temporal trends, and key challenges, including privacy-preserving retrieval, cross-client heterogeneity, and evaluation limitations. Our findings synthesize a rapidly evolving body of research, identify recurring design patterns, and surface open questions, providing a foundation for future work at the intersection of RAG and federated systems. 1 Introduction Large language models (LLMs) are increasingly deployed in domains such as healthcare, finance, and personalized assistance, raising concerns about data privacy, ownership, and regulatory compliance. In response, Federated Learning (FL) has emerged as a compelling paradigm for training models across distributed clients without exchanging raw data ( Kairouz et al. 2021 ) . In parallel, Retrieval-Augmented Generation (RAG) ( Lewis et al. 2020a ) enhances LLMs by grounding their outputs in dynamically retrieved external knowledge, reducing hallucinations and improving the accuracy of facts ( Lewis et al. 2020b ) . FL enables distributed model training across devices or institutions. Each client trains a model locally and only shares model updates (e.g., gradients), not raw data with each other. Common techniques like Federated Averaging (FedAvg) ( McMahan et al. 2017 ) and secure aggregation ( Bonawitz et al. 2017 ) help combine these updates safely. FL has been applied in healthcare, edge devices (e.g., smartphones), and finance, where data privacy is critical ( Kairouz et al. 2021 ) . RAG is a hybrid method that combines a text retriever with a generator. Before producing a response, the model first retrieves relevant text from an external knowledge base or document store. This process helps reduce hallucinations and improves factual consistency in the generated output. Popular implementations include the original RAG model ( Lewis et al. 2020b ) and Fusion-in-Decoder (FiD) ( Izacard and Grave 2020 ) , which demonstrate how integrating retrieval can enhance open-domain question answering. At the intersection of these paradigms lies Federated RAG , a hybrid approach that enables LLMs to access distributed knowledge sources in a privacy-preserving manner. It combines the strengths of data localization, personalized retrieval, and context-aware generation. Conceptually, Federated RAG builds on earlier federated search methods ( Shokouhi and Si 2011 ) , which aggregated results from siloed sources without centralized indexing, and extends them to support complex generative tasks. As LLMs have grown in capability, driven by innovations such as the Transformer architecture ( Vaswani et al. 2017 ) , pre-training methods ( Devlin et al. 2019 ; Radford et al. 2019 ; Brown et al. 2020 ) , and prompting strategies ( Schick and Schütze 2021 ; Liu et al. 2021 ; Debnath et al. 2025 ) , so has the demand for integrating them with heterogeneous private data contexts. Since 2019, the parallel evolution of LLMs, RAG, and FL has laid the groundwork for Federated RAG to emerge as both a viable and increasingly necessary framework. In this paper, we present the first systematic mapping study of Federated RAG, following the methodology of evidence-based software engineering proposed by Kitchenham ( Kitchenham et al. 2011 ) . Our objective is to map how retrieval-augmented generation is being adapted and deployed across federated architectures, and to surface recurring trends, gaps, and design patterns in the literature. To this end, we address the following research questions: • RQ1: What are the dominant architectural patterns used to integrate Retrieval-Augmented Generation (RAG) into federated systems? • RQ2: What are the primary research focuses and contribution types in the literature on federated RAG systems? • RQ3: In which application domains (e.g., healthcare, finance, education) has federated RAG been explored, and what problems are these systems designed to solve? • RQ4: What key challenges, open issues, and underexplored areas emerge from current research at the intersection of RAG and federated systems? These questions structure our analysis of the literature published between 2020 and 2025, allowing us to classify prior work, identify underexplored areas, and provide a foundation for future research at the intersection of privacy, retrieval, and generation. {forest} Figure 1: Classification Scheme: Summarizes the scheme with example categories and the distribution of studies (one study may fall into multiple categories). 2 Methodology We conducted a systematic literature search to map the research landscape at the intersection of federated systems and retrieval-augmented generation (RAG). Our search spanned top venues in natural language processing (e.g., ACL, EMNLP), machine learning (e.g., NeurIPS, ICLR), security and privacy (e.g., IEEE TIFS), as well as preprint servers like arXiv and relevant industry publications. We used combinations of keywords such as “federated learning” , “retrieval-augmented generation” , and “federated search” , and applied backward reference tracing to ensure inclusion of pivotal works cited in foundational papers (e.g., FedRetriever ( Wang et al. 2024a ) , FLERAG ( Mao et al. 2025 ) ). The search was restricted to works published between 2020 and 2025, reflecting the emergence and evolution of RAG in recent years. Out of an initial set of approximately 50 candidates, we identified 18 primary studies that explicitly addressed the integration of retrieval-based generation into federated or distributed settings. We excluded papers that focused solely on FL or RAG in isolation, without considering their combined architecture, training mechanisms, or deployment context. Each selected work was systematically categorized along three dimensions, following Kitchenham’s guidelines for systematic mapping studies ( Kitchenham et al. 2011 ) : (a) Research Focus: The core technical challenge or system-level objective, such as privacy and security (e.g., secure retrieval, encrypted indexing), retrieval efficiency (e.g., resource selection and latency optimization), model/architecture integration (e.g., coupling RAG with FL pipelines), or domain-specific adaptation (e.g., tailoring systems for healthcare or QA). (b) Contribution Type: The nature of the technical contribution, such as a new model or framework, benchmark dataset, evaluation study, or conceptual survey. (c) Application Domain: The target deployment environment or intended use case, including clinical question answering, legal/financial reasoning, recommender systems, and multi-lingual enterprise settings. We also recorded the publication year of each study to observe temporal trends and emerging research fronts. Based on this categorization, we developed the unified classification scheme (Figure 1 ) to summarize the distribution of studies across focus areas and contribution types. Furthermore, this schema informed the design of our architectural taxonomy (Figure 2 ), which visually organizes the Federated RAG landscape by contribution, application, and system goals. {forest} Figure 2: Taxonomy of Federated RAG Architectures. A conceptual map to classify the diverse system designs in the literature. 3 Analysis of Recent Studies Figure 2 categorizes Federated RAG architectures across retrieval strategies, generation mechanisms, and privacy/security enhancements. Retrieval strategies vary from simple naïve aggregation,