Multi-Agent Taskforce Collaboration: Self-Correction of Compounding Errors in Long-Form Literature Review Generation
Zhi Zhang, Yan Liu, Zhejing Hu, Gong Chen, Sheng-hua Zhong, Jiannong Cao · 2025
Read Multi-Agent Taskforce Collaboration: Self-Correction of Compounding Errors in Long-Form Literature Review Generation by Zhi Zhang, Yan Liu, Zhejing Hu, Gong Chen, Sheng-hua Zhong, Jiannong Cao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04306.txt.
Introduction
Automatic literature reviews fail by accumulation: one wrong citation early poisons every later stage. Zhi Zhang and co-authors counter that cascade in a 2025 paper with a memory system that consolidates verified facts as the review is built. One part organizes sources in a tree that shapes the outline; another gathers evidence around hub papers and refines the text.
A third part loops back over its own history to catch errors before they spread. On public benchmarks and a new large data set, the system led on citation accuracy and content quality. The design treats memory, not just generation, as the cure for compounding mistakes.
Catalog record
| CREATOR | Zhi Zhang, Yan Liu, Zhejing Hu, Gong Chen, Sheng-hua Zhong, Jiannong Cao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-04306
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Agent Taskforce Collaboration: Self-Correction of Compounding Errors in Long-Form Literature Review Generation Zhi Zhang, Yan Liu, Zhejing Hu, Gong Chen, Sheng-hua Zhong, Jiannong Cao Abstract Literature reviews play an important role in scientific research. Recent advances in large language models (LLMs) have boosted the development of automated systems for the entire literature review workflow, from retrieval to manuscript drafting. However, a key challenge is that mistakes made in early stages can propagate and amplify in subsequent steps, leading to compounding errors that undermine the faithfulness of the final review. To tackle this issue, we propose the Multi-Agent Taskforce Collaboration (MATC) framework, which consists of a manager agent and four executor agents for literature searching, outline generation, fact localization, and manuscript drafting. We propose three novel collaboration paradigms, forming exploration, exploitation, and experience taskforces, to effectively organize agents and mitigate compounding errors both between and within executor agents. Experimental results show that MATC achieves state-of-the-art performance on existing benchmarks. We further propose a new benchmark dataset featuring more diverse topics for faithful literature review generation. Introduction Literature reviews play an important role in scientific research by synthesizing existing knowledge to identify research gaps, establish theoretical frameworks, and guide future studies ( Ermel et al. 2021 ; Liu et al. 2023 ) . Over recent decades, the rapid growth in the number of scientific publications has made it increasingly challenging for researchers to efficiently retrieve, organize, and synthesize relevant information in their fields ( Wang et al. 2024b ) . In response, automatic literature review systems that leverage advances in artificial intelligence have become increasingly valuable, as they help reduce manual workload, provide timely coverage of new research, and facilitate the identification of key trends and research gaps within the extensive literature ( Zhang et al. 2025b ; Wang et al. 2024b ; Liu et al. 2023 ) . Early approaches primarily leverage multi-document summarization techniques to generate summaries from a set of reference papers ( Hoang and Kan 2010 ; Hu and Wan 2014 ; Erera et al. 2019 ) , enabling the automatic creation of related work sections given a set of references as input. In recent years, large language models (LLMs) demonstrate impressive planning and reasoning abilities ( Wang et al. 2024a ; Zhao et al. 2024 ; Zhong and Wang 2024 ; Nandy and Bandyopadhyay 2025 ; Zhang et al. 2025b ) . This leads to a growing research area that employs LLMs as controllers to construct autonomous agents capable of effectively performing complex tasks ( Wang et al. 2024a ) . Building on these advances, recent state-of-the-art research, e.g., AutoSurvey ( Wang et al. 2024b ) and SurveyX ( Liang et al. 2025 ) , achieves remarkable success by designing LLM-based autonomous agents to automate the entire pipeline of literature review and generate long-form manuscripts. Although these advances enable the automatic generation of human-like literature reviews with reduced manual effort, previous studies on multi-step models show that the inherent long-horizon workflow of such systems inevitably introduces the risk of compounding errors. In the workflow, small mistakes made at earlier steps can accumulate and propagate through subsequent steps, as errors that occur at a certain step will affect the next state ( Wang et al. 2025a ) . Without effective self-correction mechanisms, these deviations will further expand the error in later steps ( Han and Zhang 2023 ; Venkatraman, Hebert, and Bagnell 2015 ; Hejna, Abbeel, and Pinto 2023 ) . Figure 1: Illustration of the error accumulation phenomenon. This paper investigates the phenomenon of error accumulation in automatic literature review generation. As a demonstration, we employ the state-of-the-art large language model GPT-4.1 ( OpenAI 2025 ) to conduct a literature review generation workflow on the topic of EEG (electroencephalogram)-based emotion recognition , with a target length of 4,000 words. As shown in Fig. 1 , when the retrieval stage fails to identify relevant literature, the resulting errors can mislead the outlining process. An irrelevant outline may further cause the drafted manuscript to deviate from the intended topic. In long-form text generation, the increased complexity and the introduction of more dependent steps further exacerbate the compounding errors. To tackle this challenge, we propose the Multi-Agent Taskforce Collaboration (MATC) framework. MATC consists of two types of autonomous agents: the manager agent and the executor agents. The manager agent orchestrates the workflow, while the executor agents each specialize in a distinct step of the process, such as literature searching, outline generation, fact localization, or manuscript drafting. Inspired by practices in organizational quality management ( Hackman and Wageman 1995 ) , the MATC framework introduces the first multi-agent collaboration algorithm that orchestrates agents organized as taskforces. A taskforce refers to a temporary group of specialized agents focused on specific subtasks ( Altier 1987 ; Aikin 1949 ; de Waard and Kramer 2008 ) . Given a user’s instruction, a manager agent oversees the entire workflow and initiates the formation of different taskforces. To explore the research field, the senior manager organizes an exploration taskforce. Since compounding errors may accumulate during exploration between the searching and outlining agents, we design a self-correcting tree that begins with a broad, low-barrier overview and incrementally refines both the literature selection and outline in a hierarchical manner. To exploit the retrieved literature for manuscript generation, the locating and drafting agents form an exploitation taskforce. As compounding errors may also accumulate during exploitation between the locating and drafting agents, we design a self-correcting cycle. In this cycle, draft sections and extracted fact snippets are iteratively refined through alternating optimization, effectively bridging the draft to the underlying literature. To mitigate compounding errors that may occur within each functional step due to unpredictable agent-environment interactions, the senior manager agent creates experience taskforces for each agent type. These taskforces maintain the historical experience of agents and implement a dynamic checklist to guide self-correction and revision. Finally, the senior manager integrates the outputs of all taskforces to produce the final manuscript. Related Work Automating the summarization of research papers has long attracted interest. Early work mainly used multi-document summarization techniques. In 2010, Hoang et al. introduced automatic related work summarization, extracting sentences from multiple articles to form an extractive summary tailored to the target paper ( Hoang and Kan 2010 ) . Lu et al. constructed Multi-XScience, a large-scale dataset for generating related work sections based on a paper’s abstract and cited articles, serving as a benchmark for later studies ( Lu, Dong, and Charlin 2020 ) . Chen et al. proposed a relation-aware multi-document encoder and a relation graph to capture cross-document dependencies for abstractive related work generation ( Chen et al. 2021 ) . Xiao et al. developed PRIMERA, a pre-trained encoder-decoder model with novel objectives for linking and aggregating information across documents ( Xiao et al. 2022 ) . Liu et al. proposed aligning sentences by category and using sparse transformers to organize information from many references ( Liu et al. 2023 ) . Zhang et al. identified relations between concepts from literature and automatically built knowledge minigraphs to organize concepts and generate logical multi-document summaries ( Zhang et al. 2025b ) . These methods advance paragraph-level generation given reference sets. However, fully automated literature review paper generation