Diverse And Private Synthetic Datasets Generation for RAG evaluation: A multi-agent framework
Ilias DRIOUICH, Hongliu CAO, Eoin THOMAS · 2025
Read Diverse And Private Synthetic Datasets Generation for RAG evaluation: A multi-agent framework by Ilias DRIOUICH, Hongliu CAO, Eoin THOMAS (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18929.txt.
Introduction
Systems that answer questions from a private document store need test sets, yet real questions may expose secrets. Ilias Driouich, Hongliu Cao, and Eoin Thomas build fake test data for such systems in this 2025 paper. The systems are called RAG systems: they fetch relevant text and then write an answer. Judging them takes question and answer sets that cover many topics without leaking private content.
Their framework uses several cooperating software agents. One agent clusters topics to spread coverage widely and keep the set diverse. Other agents guard privacy as the fake questions are written. Earlier judging work focused on scoring rules and gave the test data itself little care. The authors argue data design decides whether scores can be trusted. Their method aims for sets that are both broad and safe.
Catalog record
| CREATOR | Ilias DRIOUICH, Hongliu CAO, Eoin THOMAS |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-18929
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Diverse And Private Synthetic Datasets Generation for RAG evaluation: A multi-agent framework Ilias DRIOUICH, Hongliu CAO, Eoin THOMAS Abstract Retrieval-augmented generation (RAG) systems improve large language model outputs by incorporating external knowledge, enabling more informed and context-aware responses. However, the effectiveness and trustworthiness of these systems critically depends on how they are evaluated, particularly on whether the evaluation process captures real-world constraints like protecting sensitive information. While current evaluation efforts for RAG systems have primarily focused on the development of performance metrics, far less attention has been given to the design and quality of the underlying evaluation datasets, despite their pivotal role in enabling meaningful, reliable assessments. In this work, we introduce a novel multi-agent framework for generating synthetic QA datasets for RAG evaluation that prioritize semantic diversity and privacy preservation. Our approach involves: (1) a Diversity agent leveraging clustering techniques to maximize topical coverage and semantic variability, (2) a Privacy Agent that detects and mask sensitive information across multiple domains and (3) a QA curation agent that synthesizes private and diverse QA pairs suitable as ground truth for RAG evaluation. Extensive experiments demonstrate that our evaluation sets outperform baseline methods in diversity and achieve robust privacy masking on domain-specific datasets. This work offers a practical and ethically aligned pathway toward safer, more comprehensive RAG system evaluation, laying the foundation for future enhancements aligned with evolving AI regulations and compliance standards. [[email protected]] keywords Multi-Agent system ,Privacy-preserving ,Evaluation system,Synthetic Dataset Generation, † † copyrightyear: 2025 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: TRUST-AI: The European Workshop on Trustworthy AI. Organized as part of the European Conference of Artificial Intelligence - ECAI 2025. October 2025, Bologna, Italy. † † address: AMADEUS France † † corresp: Corresponding author. 1 Introduction Retrieval-augmented generation (RAG) aims to improve large language models (LLM) output by incorporating relevant information retrieved from external knowledge sources. It has been effectively applied in various scenarios, such as domain-specific chatbots ( Siriwardhana et al. 2023 ; Cao 2024 ) and email/code completion ( Parvez et al. 2021 ) . A typical RAG system often operates in two stages: retrieval and generation. First, the system retrieves the relevant knowledge from an external database based on the user query. Then, the retrieved information is integrated with the query to form an input for the LLM in charge of the generation stage. The LLM uses its pre-trained knowledge and the retrieval data to generate a response, enhancing the overall quality of the output. As RAG sees wider adoption, ensuring robust performance evaluation becomes critical. While numerous automated methods, ranging from classic n-gram metrics (BLEU, ROUGE) and embedding-based measures (BERTScore) ( Chen et al. 2019 ) to the “LLM-as-a-judge” approach leveraging GPT have been explored, an equally vital element is having the “golden” evaluation set with sufficiently diverse and representative samples that will serve as a complete benchmark to evaluate both the retrieval and generation processes ( Cao et al. 2025 ) . Furthermore, despite the emergence of multiple RAG benchmarks ( Joshi et al. 2017 ; Chen et al. 2024 ; Lyu et al. 2024 ) that span general-purpose and specialized domains, many still fall short of reflecting the complexity and variability of real-world use cases. In particular, traditional benchmarks often lack coverage of novel or underrepresented topics, limiting their ability to generalize ( Cao 2024 ; Cao 2025 ) . This gap poses a significant challenge for reliable evaluation, especially in domains requiring deep expertise and factual precision ( Bruckhaus 2024 ) . To address these challenges, a new line of work consisting in generating synthetic evaluation sets ( Es et al. 2024 ) has emerged and is very promising. Indeed, these methods offer a practical solution for generating datasets that mimic real human interactions by leveraging advanced LLM reasoning capabilities. Such synthetic datasets can include a broad range of scenarios, from straightforward factual questions to more nuanced domain-specific ones enabling robust and comprehensive evaluation of RAG systems. Additionally, synthetic data generation methods are increasingly recognized as vital components for the safe, transparent, and compliant evaluation of AI systems. In fact, regulatory frameworks, such as the European Union’s AI Act ( Commission 2024 ) , explicitly promote the use of synthetic datasets within AI compliance and auditing processes. However, maintaining both a high efficiency of privacy-preserving mechanisms in retrieval systems and adherence to privacy regulations remains essential to building reliable and ethical evaluation frameworks. In fact, according to the existing literature ( Zeng et al. 2024 ; Ding et al. 2024 ) , retrieval systems may face serious privacy issues when the retrieval process involves sensitive data. For example, the authors in ( Zeng et al. 2024 ) observe that carefully designed user prompts are able to extract original sentences from the retrieval data or can also extract specific pieces of private information, potentially leading to the leakage of considerable amounts of retrieval data. The potential risk of information leakage can significantly limit the applications of retrieval systems. For example, a medical chatbot ( Yunxiang et al. 2023 ) using patient history diagnosis cases as a source of knowledge can improve response quality but raises concerns about exposing sensitive patient information. In this work, we take the first step toward exploring the generation of diverse and privacy-aware synthetic QA datasets designed specifically to serve as evaluation ground truth for assessing RAG systems. Our main contributions can be summarized as follows: • We introduce a modular and extensible multi-agent pipeline for synthetic QA dataset generation, designed specifically for evaluating RAG systems while ensuring a balance between diversity, privacy, and utility. • We develop and perform a comprehensive twofold evaluation strategy: (1) diversity assessment combining qualitative judgments from LLM-based evaluators and quantitative diversity metrics, and (2) privacy assessment focused on the accuracy and effectiveness of entity masking across three specialized datasets. 2 Related works 2.1 Retrieval-augmented generation and privacy issues Retrieval-Augmented Generation , introduced by ( Lewis et al. 2020 ) , has gained substantial traction for enhancing LLM responses through external context. By retrieving relevant documents or passages and incorporating them into the prompt, RAG often yields output with improved accuracy and factual grounding ( Gao et al. 2023 ) , mitigating the well-documented “hallucination” problem in LLMs ( Shuster et al. 2021 ) . In addition to higher-quality outputs, RAG offers architectural flexibility by allowing independent upgrades to any of its components (e.g., data storage, retriever, or the core LLM) without requiring full model retraining ( Shao et al. 2023 ; Cheng et al. 2023 ) . These advantages have led to the adoption of RAG in diverse settings, from personal chatbots to highly specialized expert systems ( Panagoulias et al. 2024 ) . Despite its clear benefits, the retrieval process introduces privacy risks, particularly in domains handling sensitive user data. For instance, ( Huang et al. 2023 ) highlight privacy implications of retrieval-based language models, showing how training data and user inputs can be unintentionally exposed through retrieved passages. Other works have demonstrated that RAG models are susceptible to extraction attacks ( Zeng et al. 2024 ) , including membership inference and reconstruction attacks,