Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning
Wenyi Wu, Sibo Zhu, Kun Zhou, Biwei Huang, University of California, San Diego · 2026
Read Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning by Wenyi Wu, Sibo Zhu, Kun Zhou, Biwei Huang, University of California, San Diego (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02168.txt.
Introduction
Wenyi Wu, Sibo Zhu, Kun Zhou, and Biwei Huang split long-horizon agent work into three roles and ask which role deserves the most compute. Their framework uses a planner for high-level choices, an actor for execution, and a memory manager for context. That split is a known pattern, so the authors focus on how compute should be shared among the parts.
Their analysis finds planning dominates task performance. Execution and memory need far less compute and model size to stay competitive. Building on that, they train only the planner with reinforcement learning, using trajectory rewards from a vision-language judge, while freezing the other parts. The planner-centric design aims for strong long-horizon results at lower total cost.
Catalog record
| CREATOR | Wenyi Wu, Sibo Zhu, Kun Zhou, Biwei Huang, University of California, San Diego |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.02168
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning Wenyi Wu, Sibo Zhu, Kun Zhou, Biwei Huang, University of California, San Diego Abstract Language model (LM)–based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an enhanced multi-agent framework that decomposes automation into three roles: a planner for high-level decision-making, an actor for task execution, and a memory manager for contextual reasoning. While this modular decomposition aligns with established design patterns, our core contribution lies in a systematic compute-allocation analysis, revealing that planning is the dominant factor influencing task performance. Execution and memory management require significantly less compute and model capacity to achieve competitive results. Building on these insights, we introduce a planner-centric reinforcement learning approach, which exclusively optimizes the planner using trajectory-level rewards from a VLM-as-judge, while freezing the other components. Extensive experiments on benchmarks spanning web navigation, OS control, and tool use demonstrate that concentrating model capacity and learning on high-level planning yields robust and compute-efficient improvements in long-horizon agent automation. Our code is publicly released. Code Website 1 Introduction Figure 1: Performance on WebVoyager with planner-centered multi-agent setup across model scales. Using a strong planner with smaller actor and memory manager yields significant gains. Driven by scaling laws, large vision–language models (VLMs) ( Bordes et al. 2024 ; Zhang et al. 2024 ) have achieved remarkable performance across a wide range of multimodal reasoning and planning tasks. Building on this capability, agents powered by these models have demonstrated strong, human-like abilities in operating complex systems, enabling them to autonomously perform tasks such as web navigation, software control, and API-based tool use from natural language instructions ( Zhou et al. 2024b ) . Typically, an agent interacts with a digital environment over multiple turns, jointly performing state interpretation, task planning, and action prediction to complete complex user-specified goals. Despite these successes, existing agents still struggle with tasks that require long-horizon planning and reasoning, such as searching for complex compositional intents or conducting tasks that involve multi-source comparison and constrained filtering. A core difficulty is that it is hard for a single agent to simultaneously do well at both high-level goal management and low-level action execution. These tasks are challenging even for humans, because success requires maintaining the overall objective over time while also making accurate step-by-step decisions in a dynamic environment ( Cheng et al. 2025 ) . When an agent focuses too much on low-level details, it may do the local steps right but still miss the overall goal, e.g., click correctly, yet fail to compare options or apply constraints ( Erdogan et al. 2025 ; Liang et al. 2026 ) . Conversely, when an agent focuses more on the high-level objective, it may keep the overall right direction, but fails at execution through small mistakes, e.g., missing a state change or skipping a check ( Tan et al. 2026 ; Aghzal et al. 2026 ) . To address the challenges of long-horizon planning, decomposing an agent’s responsibilities into distinct yet cooperative components enables more structured and reliable decision-making ( Zhao et al. 2025 ) . While prior work has explored planner–actor decompositions ( Erdogan et al. 2025 ; Li et al. 2025 ) , a systematic understanding of how to allocate compute across components remains lacking. We adopt a multi-agent framework consisting of a planner, an actor, and a memory manager: the planner handles high-level goal decomposition; the memory manager maintains and updates relevant information; and the actor executes concrete actions. As shown in Figure 1 , this framework greatly improves performance, enabling Qwen2.5-VL-7B 1 1 1 All references to Qwen2.5-VL-7B indicate the Qwen2.5-VL-7B-Instruct model throughout this paper. The same applies to Qwen2.5-VL-32B, Qwen3-VL-4B, and Qwen3-VL-8B. to outperform GPT-4o and Gemini. Based on the effective multi-agent framework, we conduct a systematic compute-allocation analysis to study how individual components contribute to task success. Through controlled scaling experiments, we identify that the planner is the primary bottleneck, whereas actor and memory components require significantly reduced computational capacity to achieve comparable performance. Our key findings reveal that planning capacity dominates overall performance. Scaling coefficients suggest that upgrading the planner alone achieves a performance gain comparable to scaling all components simultaneously, while the actor and memory manager have substantially lower contributions. This insight aligns with principles in cognitive neuroscience, where high-level executive control is recognized as a critical bottleneck in complex real-world tasks ( Miller & Cohen 2001 ; Szczepanski & Knight 2014 ) . Building on this insight, we propose a planner-centric reinforcement learning (RL) approach. It exclusively optimizes the planner using trajectory-level rewards derived from VLM-as-judge, while keeping the actor and memory manager frozen. This targeted optimization strategy significantly improves agent performance. For example, with an unbalanced 7B+3B+3B configuration, our framework increases performance by 28%, while achieving results comparable to closed-source baselines including GPT-4o, Gemini-2.5-Pro and Claude-4. These findings highlight the importance of disentangling and prioritizing planning capacity to efficiently achieve state-of-the-art performance in long-horizon agents. 2 Preliminary Long-horizon agent task. We address the problem of long-horizon task automation, where an agent interacts with a digital environment to execute complex user-specified tasks. Each episode initializes with a natural-language task description \mathcal{Q} ( e.g., “book a flight” or “find a recipe and save it”). At each time step t , the environment yields an observation \mathcal{O}_{t} , typically comprising a high-resolution screenshot and structured UI signals ( e.g., a DOM or accessibility tree). The agent generates an action \mathcal{A}_{t}\in\mathcal{A} for execution. Action space. The action space \mathcal{A} consists of parameterized interaction primitives. Each action is a tuple (\texttt{type},\texttt{params}) where \texttt{type}\in\{\texttt{Click},\texttt{Type},\texttt{Scroll},\texttt{Select},\texttt{Stop},\texttt{ToolInvoke}\} . Actions for GUI tasks are executed using Playwright 2 2 2 https://playwright.dev/ or PyAutoGUI 3 3 3 https://pyautogui.readthedocs.io/ , depending on the nature of the task. It enables the agent to interact with digital environments efficiently, while actions for tool-use tasks involve invoking specific tool APIs with corresponding parameters. The episode concludes upon task success, failure, or when a maximum step limit is reached. A formal definition of each action type and its parameters is provided in Appendix A.3 . Multi-agent systems. Unlike a monolithic agent that uses a single policy \pi(\mathcal{A}_{t}\mid\mathcal{O}_{t},\mathcal{Q}) , a multi-agent system decomposes decision-making into specialized modules. Each agent handles a distinct sub-capability, such as reasoning, memory retrieval, or action execution, and operates within its own local context. The global action \mathcal{A}_{t} is produced through structured message passing where agents exchange intermediate outputs z_{t} ( e.g., natural language plans, subgoals, or memory queries). This effectively separates high-level cognitive processes (planning) from low-level control (execution). Figure 2: Overview of the planner-centric multi-agent framework. The system decomposes tasks into three agents: a central Planner that reasons over long-horizon goals; a Memory Manager that retrieves relevant discrete and continuous memories; and an Actor that executes precise actions. The pipeline supports optimization via reinforcement learning. 3 Multi-agent framework 3.1 Multi-agent collaboration We propose a planner-centric multi-agent system consisting of three components: a Planner as the central decision-maker, an Actor that executes commands, and a Memory Manager that provides dynamic context. These interact in an iterative loop throughout the task. Planner. The Planner serves as the central