Creativity in LLM-based Multi-Agent Systems: A Survey
Yi-Cheng Lin, Kang-Chieh Chen *, Zhe-Yan Li *, Tzu-Heng Wu *, [email protected] · 2025
Read Creativity in LLM-based Multi-Agent Systems: A Survey by Yi-Cheng Lin, Kang-Chieh Chen *, Zhe-Yan Li *, Tzu-Heng Wu *, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21116.txt.
Introduction
Yi-Cheng Lin and co-authors survey how teams of AI agents can be creative, in a 2025 paper. Pairs and groups of language model agents now make text and images together with people. Past surveys covered the basic setup of such systems. They largely skipped the question of how new and good ideas arise.
The survey sorts agent traits and roles into a clear map. It reviews ways to make new work, from wide searching to step-by-step polish to group blending. Data sets and scoring methods for creative output are covered too. The authors flag open problems such as uneven scoring, weak bias fixes, and clashes in group work. They offer a road map for building and judging creative agent teams. The goal is shared standards for the field.
Catalog record
| CREATOR | Yi-Cheng Lin, Kang-Chieh Chen *, Zhe-Yan Li *, Tzu-Heng Wu *, [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-21116
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Creativity in LLM-based Multi-Agent Systems: A Survey Yi-Cheng Lin, Kang-Chieh Chen *, Zhe-Yan Li *, Tzu-Heng Wu *, [email protected] Abstract Large language model (LLM)-driven multi-agent systems (MAS) are transforming how humans and AIs collaboratively generate ideas and artifacts. While existing surveys provide comprehensive overviews of MAS infrastructures, they largely overlook the dimension of creativity , including how novel outputs are generated and evaluated, how creativity informs agent personas, and how creative workflows are coordinated. This is the first survey dedicated to creativity in MAS. We focus on text and image generation tasks, and present: (1) a taxonomy of agent proactivity and persona design; (2) an overview of generation techniques, including divergent exploration, iterative refinement, and collaborative synthesis, as well as relevant datasets and evaluation metrics; and (3) a discussion of key challenges, such as inconsistent evaluation standards, insufficient bias mitigation, coordination conflicts, and the lack of unified benchmarks. This survey offers a structured framework and roadmap for advancing the development, evaluation, and standardization of creative MAS. 1 1 1 https://github.com/MiuLab/MultiAgent-Survey 1 Introduction Advances in LLMs and deep learning have fueled rapid growth in MAS research Guo et al. (2024a) ; Tran et al. (2025) . Single-agent pipelines, such as one-shot or simple iterative LLM prompting Grattafiori et al. (2024) ; Wang et al. (2022) , execute in isolation and often converge on familiar patterns, struggling to explore vast open-ended spaces. Unlike monolithic systems, a MAS comprises multiple autonomous entities: software agents, robots, or human-AI hybrids. This structure enables emergent collaboration and richer exploration of open-ended creative spaces Park et al. (2023) . Here, computational creativity denotes the production of artifacts—ideas, behaviors, or solutions—that are both novel and valuable, showing meaningful utility or appeal rather than randomness Wiggins (2006) ; Veale and Cardoso (2019) . In MAS, creativity emerges through various dynamics—critique loops, competitive incentives, or coalition-forming. Together, these processes can yield outcomes designers never anticipated. For example, conversational agents can automate screenwriting: one agent as Writer drafting character profiles and outlines, another as Editor offering revision suggestions, and multiple Actors engaging in role-playing to improvise dialogues Chen et al. (2024) . Although recent surveys examine LLM-based MAS architectures Li et al. (2024) ; Han et al. (2024b) , collaboration mechanisms Tran et al. (2025) ; Zhang et al. (2024c) ; Mu et al. (2024) , autonomy and alignment Händler (2023) , communication protocols Yan et al. (2025) , and environment/simulation platforms Guo et al. (2024a) ; Gao et al. (2024) , they concentrate on infrastructure. However, they overlook evaluating creative outputs, the impact of agent personas and workflow integration on creativity, and the specific techniques that drive ideation. We present the first survey on creativity in LLM-based MAS to bridge this gap. Our paper systematically maps techniques, datasets, evaluation metrics, and remaining challenges, offering researchers a unified framework to assess and amplify creativity across multi-agent pipelines. This survey focuses on systems whose inputs and outputs span text and images, and whose participants range from LLM-based chatbots to human agents, as in Fig. 1 . We aim to map the current landscape of techniques, datasets, evaluations, and challenges to foster and measure creativity in such multimodal and heterogeneous systems. By analyzing how different agents interact, we reveal how collaborative structures can unlock creative potentials that exceed what isolated LLMs or individuals can achieve. Figure 1: Overview of multi - agent creativity systems. Given user inputs in text or image form, agents engage in a three - stage process: Planning, Process, and Decision Making, using a variety of techniques (Sec. 3 ) and persona (Sec. 4 ), with outputs evaluated both subjectively by humans and objectively by automated metrics (Sec. 5 ). 2 MAS Workflow and Proactivity 2.1 MAS Workflow Recent work shows that LLMs can generate novel content, yet a clear creativity gap exists between human designers and agents based on LLM He et al. (2024) . Therefore, most existing creativity support systems keep humans “in the loop”, asking users to critique or complement machine-generated ideas Shaer et al. (2024) ; Radensky (2024) ; Lin et al. (2022) ; Lataifeh et al. (2024) ; Zhang et al. (2022) . This also reflects on a focus that utilizes agents to imitate human behavior and replace their role in MAS Xu et al. (2024) ; Sun et al. (2024) . As human-agent collaboration becomes more sophisticated, it becomes increasingly important to consider when and how agents should be involved within the system’s workflow. To reason about this question, we decompose the creative workflow of MAS into three key phases: Planning , Process , and Decision Making Xie and Zou (2024) ; Mukobi et al. (2023) . • Planning : where Agents formulate objectives and structure task execution. • Process : where Agents implement tasks and coordinate through interaction. • Decision Making : where Agents evaluate options and determine outcome Real-world LLM-based MAS often interleave these steps. For instance, StoryVerse combines author-defined outlines with emergent character simulations through iterative narrative planning loops Wang et al. (2024b) , while Generative Agents integrate observation, planning, and reflection in overlapping processes Park et al. (2023) . In contrast, we keep these steps distinct to ensure our framework remains clear and easy to follow. 2.2 Spectrum of Agent Proactivity We define an LLM agent’s proactivity as the degree to which it initiates, guides, and owns creative actions within a MAS. Proactivity combines two facets— initiative (who starts or extends an action) and control (who judges whether the action is satisfactory)—and lies on a continuum from reactive agents, which wait for explicit prompts and follow specified instructions, to proactive agents, which formulate sub-goals, dispatch subtasks, and self-evaluate without human cues. Planning In the Planning phase, the system defines what needs to be done before any content is generated. This typically involves (1) setting high-level objectives, (2) decomposing the overall goal into subtasks, and (3) configuring the downstream generation pipeline. To ensure predictability, most MAS frameworks delegate these responsibilities to humans, who specify task allocation strategies, role hierarchies, and execution protocols However, a few studies have set about addressing Planning subtasks through agents to alleviate the burden on human users Venkadesh et al. (2024) ; Zhai et al. (2025) ; Venkatesh et al. (2025) . For example, Co-Scientist Gottweis et al. (2025) embeds a supervisory agent that evaluates determined planning configuration from users, assigns weighted priorities and resources across specialist agents, and schedules them as parallel workers. Likewise, VirSci Su et al. (2025) uses an autonomous “team leader” agent to select collaborators, define research topics, and orchestrate task distribution based on a researcher database. These agent-driven planning frameworks lean toward the proactive end of our spectrum, empowering agents to autonomously formulate and allocate tasks while humans retain only the overarching goal-setting. Figure 2: MAS frameworks positioned along a two-dimensional spectrum reflecting levels of proactivity in Process and Decision-Making . The Planning phase is omitted here due to consistently low agent proactivity in existing literature. Details of proactivity categorization criteria are shown in Appendix A . Process In the Process phase, agents execute the generation pipeline by creating intermediate artifacts, utilizing methods such as peer sharing or refining them in response to feedback. Highly proactive systems instantiate multiple agents that drive