How to Steer Your Multi-Agent System: Human-LLM Collaborative Planning Conference: ACM Conference on AI and Agentic Systems; May 26–29, 2026; San Jose, CA, USA ACM Conference on AI and Agentic Systems (ACM CAIS ’26), May 26–29, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813144 ISBN: 979-8-4007-2415-2/26/05 CCS: Computing methodologies Multi-agent planning CCS: Human-centered computing Interactive systems and tools
Zeyu He, Hannah Kim, Dan Zhang, Estevam Hruschka · 2026
Read How to Steer Your Multi-Agent System: Human-LLM Collaborative Planning Conference: ACM Conference on AI and Agentic Systems; May 26–29, 2026; San Jose, CA, USA ACM Conference on AI and Agentic Systems (ACM CAIS ’26), May 26–29, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813144 ISBN: 979-8-4007-2415-2/26/05 CCS: Computing methodologies Multi-agent planning CCS: Human-centered computing Interactive systems and tools by Zeyu He, Hannah Kim, Dan Zhang, Estevam Hruschka (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23023.txt.
Introduction
He and three coauthors formalize human-LLM co-planning along three axes: mode, scope, and level of edits. In orchestrated multi-agent systems, people struggle to manage plans they cannot see into, and current tools supervise only final outputs. Their prototype AMBIPOM supports process-level supervision through semantic and structural interactions. A user study reveals mixed workflows and effort-control-risk trade-offs. A controlled benchmark shows how language models adjust plans under varying scope and revision strategies. Code and data are released.
Catalog record
| CREATOR | Zeyu He, Hannah Kim, Dan Zhang, Estevam Hruschka |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 96211 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.23023
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
How to Steer Your Multi-Agent System: Human-LLM Collaborative Planning Conference: ACM Conference on AI and Agentic Systems; May 26–29, 2026; San Jose, CA, USA ACM Conference on AI and Agentic Systems (ACM CAIS ’26), May 26–29, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813144 ISBN: 979-8-4007-2415-2/26/05 CCS: Computing methodologies Multi-agent planning CCS: Human-centered computing Interactive systems and tools Zeyu He, Hannah Kim, Dan Zhang, Estevam Hruschka Abstract . In orchestrated multi-agent systems, humans often struggle to manage plans due to their complexity and limited transparency. Existing approaches rely on outcome-level supervision, where users verify only final outputs without visibility into intermediate reasoning. We formalize a design space for human-LLM co-planning interactions along three axes: mode (semantic vs. structural), scope (global vs. targeted), and level (low- vs. high-level edits). We realize it in AMBIPOM , a prototype supporting process-level supervision through both semantic and structural interactions. Through a user study, we characterize how users navigate this space, revealing hybrid workflows and effort-control-risk trade-offs; through a controlled benchmark, we analyze how LLMs revise plans under varying scope and revision strategies. Our findings yield design insights for more transparent, controllable, and effective human-AI co-planning. We release code and data at https://github.com/megagonlabs/ambipom . † † cc-license: by 1. Introduction In recent years, the paradigm of agentic systems has shifted from single, monolithic agents to multi-agent systems (MAS) ( 19 ; 31 ) . Unlike monolithic architectures, MAS consist of multiple specialized agents, each designed with distinct capabilities or domain expertise, for example, mathematical reasoning agents, information extraction agents, or real estate advisory agents ( 34 ; 11 ) . This modularity enables MAS to tackle complex tasks more efficiently, exploit parallelism for faster execution, and maintain robustness through fault tolerance when individual agents fail ( 29 ) . Within the spectrum of MAS architectures, orchestrated MAS, in which a central controller coordinates the agents, offer additional advantages. The controller plays a crucial role in task decomposition, agent assignment, and orchestration of execution, effectively performing high-level planning across the system. This centralized orchestration facilitates global optimization and coherence, clear accountability and control, and more effective allocation of resources and agent capabilities than fully decentralized MAS ( 23 ; 29 ; 4 ) . Recently, large language models (LLMs) have increasingly been employed as planners within orchestrated MAS thanks to their ability to break down high level tasks into manageable subtasks specialized agents ( 14 ) . However, relying solely on LLM planners remains insufficient in practice. Generated plans may misalign with human intent, fail to capture domain-specific constraints, or suffer from hallucinations ( 30 ; 14 ) . Therefore, systematic mechanisms are needed to incorporate user interventions effectively and ensure that generated plans remain both correct and aligned with user goals ( 35 ) . Unfortunately, most existing systems rely on outcome-based supervision : users are presented with a final answer or, at best, a linear high-level plan while intermediate states remain opaque. This lack of transparency makes it difficult to diagnose failures and apply targeted corrections, especially for complex multi-agent plans. These limitations call for process-oriented supervision ( 25 ) in MAS, where humans can observe dependencies among agent subtasks, evaluate individual outputs, and intervene at multiple stages of planning and execution. By making intermediate reasoning and coordination explicit, process supervision fosters trust and improves controllability in complex MAS. To operationalize process-level supervision in orchestrated MAS, we adopt a human-LLM interactive co-planning paradigm ( 12 ) . We represent multi-agent plans explicitly as directed acyclic graphs (DAGs), where nodes correspond to agent-executable subtasks and edges encode data dependencies ( 16 ) . This representation serves as a first-class planning object that can be inspected and modified prior to and during execution. Building on this representation, we formalize a co-planning interaction design space along three axes: mode —structural direct manipulation of the graph vs. semantic natural-language feedback; scope —global feedback affecting the entire plan vs. targeted feedback conditioned on a selected subgraph; and level —low-level graph edits (add/edit/delete) vs. high-level structural operations (merge/split/replan). By making scope and level first-class alongside mode , our framework introduces interaction types beyond those exposed by prior co-planning systems and makes different human-LLM collaboration strategies formally comparable. We realize this design space in AMBIPOM ( A gent-aware M ixed-initiative B lock-level I nteractive P lanning for O rchestrated M ulti-agent systems), a prototype to study user and LLM behavior across this space. Our contributions are threefold. First, we formalize a design space for human-LLM co-planning along three axes ( mode , scope , level ) and instantiate it in AMBIPOM , making different co-planning strategies explicit, operationalizable, and comparable. Second, through a user study, we examine how users combine these interaction types to steer and refine plans. Third, through a controlled benchmark, we analyze the capabilities and limitations of LLMs as co-planning partners across these axes. 2. Related Work 2.1. Multi-Agent Systems Recent progress in large language models (LLMs) has shifted the focus from single-agent architectures toward multi-agent systems (MAS) for solving complex and long-horizon tasks ( 27 ) . Instead of relying on a single agent to perform reasoning, planning, and tool use within one loop, MAS distribute these responsibilities across specialized agents, improving scalability while reducing the burden on individual agents ( 29 ; 10 ; 28 ) . Among coordination strategies, centralized or hierarchical orchestration has emerged as a practical design pattern ( 29 ; 23 ) . In this setting, agents are non-proactive and invoked only when assigned specific subtasks by a central controller. Such systems typically adopt a plan-then-execute paradigm (sometimes referred to as decomposition-first or plan-ahead) ( 21 ; 14 ) : a central planner interprets high-level user intent and decomposes it into a structured plan. This plan is often represented as a directed acyclic graph, where nodes correspond to subtasks and edges encode execution order or data dependencies. Execution follows this predefined plan. Compared to decentralized approaches, centralized orchestration provides explicit data flow, reduced communication overhead, and globally coherent task planning, making it particularly suitable for human-in-the-loop settings, where transparency and controllability are essential. 2.2. Human-LLM Co-Planning Recent advances in LLMs have demonstrated remarkable capabilities in high-level planning and reasoning, making them as promising planners for coordinating MAS without extensive task-specific training ( 33 ; 14 ) . Despite these strengths, fully autonomous LLM planners encounter practical limitations, especially in domain-specific or high-stakes scenarios, due to issues such as hallucination and misalignment with human preferences and expertise ( 15 ; 30 ; 13 ) . These challenges motivate a mixed-initiative human-in-the-loop (HITL) approach, where human guidance is leveraged to refine, validate, or modify generated plans ( 35 ) . In mainstream AI assistants, including GitHub Copilot and Gemini Deep Research, planning typically occurs within a conversational interface. Within this paradigm, humans function as passive consultants ( 7 ) , i.e. , reviewing generated plans and requesting changes via high-level prompts. However, this chat-based approach lacks the transparency and granular control required to manage complex multi-agent plans. Addressing this, recent frameworks ( 24 ; 8 ; 16 ; 26 ) shift the human’s role to an active collaborator ( 7 ; 6 ) through interactive co-planning, co-execution, and debugging. Frameworks like COCOA ( 8 )