You need to MIMIC to get FAME: Solving Meeting Transcript Scarcity with Multi-Agent Conversations

Frederic Kirstein, Muneeb Khan, Jan Philip Wahle, Terry Ruas, Bela Gipp · 2025

Read You need to MIMIC to get FAME: Solving Meeting Transcript Scarcity with Multi-Agent Conversations by Frederic Kirstein, Muneeb Khan, Jan Philip Wahle, Terry Ruas, Bela Gipp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13001.txt.

Introduction

Frederic Kirstein and four co-authors tackle a data shortage in meeting research in a 2025 study. Tools that summarize meetings need many real transcripts, but privacy rules and cost keep real ones scarce. The team built a system, MIMIC, where AI agents with set personality profiles act out a meeting from a source text. A cleanup step then trims repeats and stiff phrasing to keep the talk lifelike.

The system made a data set called FAME: five hundred meetings in English and three hundred in German. Human judges rated the fake meetings close to real ones for natural feel. They also kept the hard traits of real speech and added rich topic depth. The authors offer FAME as a stand-in test bed for summary tools and other talk-based research.

Catalog record

CREATORFrederic Kirstein, Muneeb Khan, Jan Philip Wahle, Terry Ruas, Bela Gipp
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE117 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-13001

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

You need to MIMIC to get FAME: Solving Meeting Transcript Scarcity with Multi-Agent Conversations Frederic Kirstein, Muneeb Khan, Jan Philip Wahle, Terry Ruas, Bela Gipp Abstract Meeting summarization suffers from limited high-quality data, mainly due to privacy restrictions and expensive collection processes. We address this gap with FAME, a dataset of 500 meetings in English and 300 in German produced by MIMIC, our new multi-agent meeting synthesis framework that generates meeting transcripts on a given knowledge source by defining psychologically grounded participant profiles, outlining the conversation, and orchestrating a large language model (LLM) debate. A modular post-processing step refines these outputs, mitigating potential repetitiveness and overly formal tones, ensuring coherent, credible dialogues at scale. We also propose a psychologically grounded evaluation framework assessing naturalness, social behavior authenticity, and transcript difficulties. Human assessments show that FAME approximates real-meeting spontaneity (4.5/5 in naturalness), preserves speaker-centric challenges (3/5 in spoken language), and introduces richer information-oriented difficulty (4/5 in difficulty). These findings highlight that FAME is a good and scalable proxy for real-world meeting conditions. It enables new test scenarios for meeting summarization research and other conversation-centric applications in tasks requiring conversation data or simulating social scenarios under behavioral constraints 1 1 1 Resources are available as per Appendix A on GitHub . . Figure 1: Architecture of our meeting generation framework MIMIC. Stages 1 to 3 are realized as a linear pipeline of LLM instances. Stage 4 is an agent orchestrating participants played by agents, who can decide on the length of the meeting through voting. Stage 5 checks and optionally provides feedback for refinement to stage 4 agent. The remaining stages, 6 and 7, polish the generated conversation. 1 Introduction Meetings underlie collaboration and decision-making in corporations, academia, and government. Meeting summaries help record key discussion points, update absentees, and capture to-dos Zhong et al. (2021) ; Hu et al. (2023) ; Laskar et al. (2023) . While AI-based summaries are available on platforms such as Zoom 2 2 2 https://www.zoom.com/en/ai-assistant , Microsoft Teams 3 3 3 https://copilot.cloud.microsoft , they typically build on limited English data that does not represent the diversity of real meetings, e.g., multilingual sessions, specialized discussions Kirstein et al. (2025a) . Data scarcity for training and testing meeting summarization systems persists due to privacy and intellectual property concerns, along with expensive manual annotation Ben Abacha et al. (2023) . Existing corpora, such as AMI Mccowan et al. (2005) , ICSI Janin et al. (2003) , and MeetingBank Hu et al. (2023) , offer only a narrow range of scenarios, which primarily revolve around staged business, academic, or parliamentary meetings. Non-English resources like FREDSum Rennard et al. (2023) , containing manually transcribed and annotated political debates, remain sporadic and underscore the lack of linguistic diversity. Researchers have explored synthetic transcripts to address this scarcity, but many methods are sub-optimal in scalability and realism. Single-model, omniscient continuation Qiu and Pan (2024) ; Zhou et al. (2024a) can produce dialogues lacking actual knowledge and speaker interplay, while crowdsourced role-plays are expensive Mccowan et al. (2005) ; Thulke et al. (2024) . Automated heuristics (e.g., noising, swapping) often yield disjointed conversations Chen and Yang (2021) ; Park et al. (2022) ; Liu et al. (2022) . These approaches struggle to balance large-scale generation with authentic group dynamics and credible topic evolution, even though they can process and generate thousands of tokens. We introduce MIMIC ( M ulti-agent IMI tation of C onversations, see Figure 1 ), a movie-production-inspired framework based on multi-agent debate Liang et al. (2024) ; Du et al. (2024) . MIMIC summarizes a knowledge source, expands the summary into an agenda, and orchestrates psychologically grounded agents debating turn-by-turn, allowing interruptions (e.g., phone calls). A modular refinement step mitigates repetitions or overly formal speech, ensuring plausible and coherent discourse at scale. With MIMIC, we generate FAME ( FA ke ME etings), a corpus of 800 meetings (500 English, 300 German parallel in input) covering 14 meeting types (e.g., project updates, brainstorming) and 300 Wikipedia articles as a knowledge source. We evaluate the synthetic meetings on quality criteria, e.g., naturalness, coherence, Chen et al. (2023) , and transcript difficulties, e.g., scattered information Kirstein et al. (2024b) , and propose a new psychology-based measure of behavioral authenticity Choi et al. (2020) . Human ratings confirm that FAME achieves near-real spontaneity (4.5/5 in naturalness), preserves speaker-related challenges (3/5 in spoken language), and intensifies low-information-density difficulties (4/5). Comparisons with real transcripts and 100 crowdsourced meeting experiences show a similar behavioral pattern. Evaluations of GPT-4o OpenAI (2024) , Gemini 1.5 pro Team et al. (2024) , DeepSeek-R1 Distill Llama 70B DeepSeek-AI and Zhang (2025) , Llama 3.3 70B 4 4 4 We will refer to these as GPT, Gemini, DeepSeek, and Llama throughout the paper. Llama Team (2024) reveal persistent context-handling issues. Ablation studies show that MIMIC reliably generates good transcripts using different inputs or LLMs. Contributions. • MIMIC : A multi-agent simulation method that captures realistic group dynamics. • FAME : A corpus of 800 meetings in English (500) and German (300) on diverse topics and meeting formats, including quality annotations. • A psychology-based evaluation framework for behavioral authenticity, addressing a gap in measuring agent interactions. 2 Related Works Meeting summarization datasets. Most meeting summarization research relies on a few standard English-only corpora Kirstein et al. (2025a) , notably AMI Mccowan et al. (2005) , i.e., staged business, and ICSI Janin et al. (2003) , i.e., academic. While QMSum Zhong et al. (2021) and MeetingBank Hu et al. (2023) broaden coverage to parliamentary sessions and city councils, non-English data remains sparse (e.g., FREDSum Rennard et al. (2023) for French and ELITR Nedoluzhko et al. (2022) for Czech). We address this gaps by releasing FAME, a corpus of 800 synthetic English and German meetings spanning diverse topics, meeting formats, and speaking styles. Synthetic dialogue generation. Existing synthetic meeting data generation approaches often rely on relatively simple text continuation by LLMs Qiu and Pan (2024) or heuristics, e.g., noising, swapping Chen and Yang (2021) ; Park et al. (2022) ; Liu et al. (2022) , risking superficial turn-taking and unrealistic participant behavior Kirstein et al. (2025a) . Small-scale manual simulations Thulke et al. (2024) offer greater realism but are costly and hard to scale. Recent tools like Google’s NotebookLM Google (2024) and Nvidia’s PDF-to-Podcast Nvidia (2025) transform documents into two-speaker podcasts but lack multi-participant group dynamics. In contrast, MIMIC simulates turn-by-turn interactions among psychology-based agents with their own memory, allowing spontaneous debates and evolving stances. A post-processing module addresses common LLM flaws (e.g., repetition, vocabulary), ensuring high-quality, naturally flowing conversations. 3 The MIMIC Methodology We propose MIMIC, a multi-agent framework inspired by movie production to generate synthetic meeting transcripts from a knowledge source through multi-agent debate (see Figure 1 ). The basic idea is to summarize the knowledge source to distill its key highlights to be discussed in a multi-agent-LLM setup. This setup emulates a discussion among participants with distinct personas and their private memory of the knowledge source, including real-world dynamics such as turn-taking, disagreements, clarifications, and topic continuity. MIMIC operates in three phases, i.e., pre-production , production , and post-production , with seven stages overall (splitted 3/2/2 between each phase). We explain here the

Read the complete text