MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning

Yimeng Wang, Jiaxing Zhao, Hongbin Xie, Hexing Ma, Yuzhen Lei, Shuangxue Liu, Xuan Song, Zichen Zhang, Haoran Zhang · 2026

Read MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning by Yimeng Wang, Jiaxing Zhao, Hongbin Xie, Hexing Ma, Yuzhen Lei, Shuangxue Liu, Xuan Song, Zichen Zhang, Haoran Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19290.txt.

Introduction

Yimeng Wang and nine co-authors let teams of language model agents rewrite their own roles and wiring. Multi agent systems split a hard job among specialists that talk and work together. Fixed roles, though, may fit the first task and miss the next one.

Their system, MetaGen, evolves both the roles and the topology, the pattern of who talks to whom. The team shapes itself as it learns what the work demands. Self shaping teams could beat hand designed ones on jobs too varied for a single fixed org chart.

Catalog record

CREATORYimeng Wang, Jiaxing Zhao, Hongbin Xie, Hexing Ma, Yuzhen Lei, Shuangxue Liu, Xuan Song, Zichen Zhang, Haoran Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19290

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning Yimeng Wang, Jiaxing Zhao, Hongbin Xie, Hexing Ma, Yuzhen Lei, Shuangxue Liu, Xuan Song, Zichen Zhang, Haoran Zhang Abstract Large language models are increasingly deployed as multi-agent systems, where specialized roles communicate and collaborate through structured interactions to solve complex tasks that often exceed the capacity of a single agent. However, most existing systems still rely on a fixed role library and an execution-frozen interaction topology, a rigid design choice that frequently leads to task mismatch, prevents timely adaptation when new evidence emerges during reasoning, and further inflates inference cost. We introduce MetaGen , a training-free framework that adapts both the role space and the collaboration topology at inference time, without updating base model weights. MetaGen generates and rewrites query-conditioned role specifications to maintain a controllable dynamic role pool, then instantiates a constrained execution graph around a minimal backbone. During execution, it iteratively updates role prompts and adjusts structural decisions using lightweight feedback signals. Experiments on code generation and multi-step reasoning benchmarks show that MetaGen improves the accuracy and cost tradeoff over strong multi-agent baselines. * * footnotetext: Equal contribution. † † footnotetext: Corresponding author. 1 Introduction Large language models (LLMs) are rapidly evolving from single-turn conversational responders into general-purpose problem solvers that can plan, critique, write code, and interact with external tools 7 ; 22 . A natural next step is to organize multiple LLM instances into Multi-Agent Systems (MAS) 13 ; 28 ; 23 ; 3 ; 17 , where specialized roles collaborate to decompose complex tasks and cross-check intermediate conclusions. Recent systems have shown that role-playing and structured collaboration can substantially outperform single-agent prompting on reasoning, tool use, and software engineering workflows 5 ; 11 . At the same time, prompting paradigms such as debate, reflection, and search-based reasoning point to a broader lesson: the interaction structure—who speaks, what is produced, and how signals are aggregated—can be as influential as the base model itself 7 ; 30 ; 2 . Figure 1: Overview and positioning of MetaGen. Unlike fixed-role/fixed-topology multi-agent systems and training-based topology designers with execution-frozen graphs, MetaGen enables training-free, query-conditioned role generation and self-evolving topology adjustment entirely at inference time. Despite this progress, many deployed MAS still follow a rigid preset design. Developers typically maintain a fixed role pool (e.g., planner/solver/verifier) and hard-code an execution-frozen message-passing protocol 20 (e.g., chain, star, or fully connected chat). Such rigidity leads to three recurring issues. First, task mismatch arises because task granularity, tool preferences, and error modes vary widely, while a fixed role set is often brittle under distribution shift. Second, structural closure occurs when a topology determined once cannot be revised mid-run in response to new evidence or contradictions. Third, cost suffers because tailoring prompts and interaction structures to each task requires manual engineering. An increasing line of work treats collaboration topology as a key lever and seeks to automate it 31 ; 33 . Graph-based views model agents as nodes and communications as directed edges, enabling orchestration search, pruning, and topology optimization 41 ; 18 ; 34 . Recent topology designers learn or generate task-adaptive graphs, for example by predicting edges with graph models 35 or autoregressively generating a team and its links from a query 14 . While these approaches reduce manual engineering, two assumptions remain common at inference time: roles are drawn from a pre-defined library, and the instance-specific graph is typically frozen once execution begins. These observations motivate a central question: can an MAS generate the roles it needs and update its collaboration structure during inference, while keeping cost bounded? We present MetaGen , a training-free framework that adapts both the role space and the collaboration topology at test time (Figure 1 ). MetaGen introduces an Architect that synthesizes and revises query-conditioned role specifications to form a controllable dynamic role pool. It then constructs an initial execution graph around a minimal backbone and iteratively updates role prompts and structural decisions using lightweight feedback signals, without modifying backbone weights. To prevent unrestricted chatter, MetaGen enforces explicit controls, including schema/validity checks for generated roles, constrained graph construction, selective activation and edge gating, and cost-aware stopping. MetaGen is designed to be effective and inspectable. It logs generated roles, selected participants, structural edits, and the feedback that triggers each update, supporting reproducibility and diagnosis beyond ad hoc orchestration. This combination of dynamic roles, inference-time evolution, and structured control targets the core limitations of rigid MAS while retaining the engineering advantages of graph-based collaboration. In summary, our contributions are: • We propose MetaGen , a training-free framework that improves multi-agent collaboration by adapting role specifications and communication topology during inference. • We introduce query-conditioned role generation and revision with lightweight validity constraints, yielding a controllable dynamic role pool. • We develop an inference-time evolution loop that updates prompts and structural decisions under explicit constraints to bound cost and maintain auditability. • Extensive experiments demonstrate that MetaGen consistently improves the accuracy–cost trade-off over competitive multi-agent baselines, and ablations confirm the complementary benefits of dynamic roles, within-instance refinement, and cross-instance accumulation. Figure 2: MetaGen framework overview. Given a query, an Architect generates and filters candidate roles, then performs novelty-driven role selection and hybrid graph initialization to form an initial DAG G_{\text{init}} . MetaGen supports intra-task evolution by updating role prompts and structure using execution feedback, and inter-task evolution by accumulating cross-instance priors and solidifying verified roles for future reuse. 2 Related Work 2.1 Multi-agent collaboration with LLMs. A growing body of work solves complex tasks via LLM-based multi-agent collaboration 1 ; 8 ; 39 ; 9 , where multiple agents exchange intermediate results to reduce single-agent blind spots and improve reliability. Common paradigms include discussion-style coordination that aggregates diverse perspectives and iteratively refines candidate solutions 21 , and debate-style protocols that surface contradictions and encourage self-correction through adversarial critique 29 . Another line of work emphasizes specialization by assigning distinct roles (e.g., planner, executor, verifier) and organizing them into hierarchical pipelines for decomposition and verification 32 . Beyond pipelines, structured collaboration patterns such as chain and star orchestration 11 ; 19 ; 40 and richer tree/graph-structured interaction 37 ; 39 ; 12 ; 20 ; 41 ; 38 have been adopted to better capture information dependencies and multi-step reasoning. Despite these advances, most systems assume a pre-defined role pool and adopt an interaction topology that is fixed or drawn from a small set of templates, remaining largely execution-frozen once inference begins. As a result, the collaboration strategy often cannot be tailored to instance-specific needs, and mismatched roles or redundant interactions can waste computation and hinder robustness under distribution shift. 2.2 Multi-Agents as Graphs Graph-structured formulations are a natural fit for multi-agent collaboration, as they explicitly model information dependencies and interaction constraints among agents 33 . Representative systems such as MacNet 20 and GPTSwarm 41 treat agent interaction as an optimizable graph. Recent work further moves toward dynamic topology construction. DyLAN 18 selects and routes agents by filtering an initially large set based on instance-level importance signals, G-Designer 35 synthesizes communication graphs with a learned generator to adapt connectivity patterns, and ARG-Designer 14 autoregressively constructs agent groups together with their links under task conditioning. Unlike topology-centric designers that primarily generate interaction graphs

Read the complete text