CollabCoder: Plan-Code Co-Evolution via Collaborative Decision-Making for Efficient Code Generation
Duy Tung Doan, Quang Huy Phung, Ngoc Dung Nguyen, Khac-Hoai Nam Bui · 2026
Read CollabCoder: Plan-Code Co-Evolution via Collaborative Decision-Making for Efficient Code Generation by Duy Tung Doan, Quang Huy Phung, Ngoc Dung Nguyen, Khac-Hoai Nam Bui (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13946.txt.
Introduction
Doan and colleagues let plan and code modules take turns during debugging, rather than following a fixed plan or working in isolation. Their CollabCoder framework picks whichever module should run next through collaborative decision-making. On harder benchmarks the approach beats strong baselines by 11 to 20 percent while saving 4 to 10 API calls per run, with gains growing as tasks get harder.
Catalog record
| CREATOR | Duy Tung Doan, Quang Huy Phung, Ngoc Dung Nguyen, Khac-Hoai Nam Bui |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67733 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.13946
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CollabCoder: Plan-Code Co-Evolution via Collaborative Decision-Making for Efficient Code Generation Duy Tung Doan, Quang Huy Phung, Ngoc Dung Nguyen, Khac-Hoai Nam Bui Abstract Automated code generation remains a persistent challenge in software engineering, as conventional multi-agent frameworks are often constrained by static planning, isolated execution, high computational overhead, and limited adaptability to complex tasks. This paper introduces CollabCoder 1 1 1 The source code is publicly available at https://github.com/ihbkaiser/CollabCoder . , a novel Plan-Code Co-Evolution framework that improves code generation through dynamic multi-agent collaboration. The core idea is to design a collaborative decision-making module between the plan agent and the code agent to decide which should be executed for the debugging process. Extensive experiments on widely used benchmarks demonstrate that CollabCoder consistently improves code quality and robustness across tasks. Importantly, CollabCoder achieves performance comparable to or exceeding current state-of-the-art methods while reducing computational overhead, with efficiency gains becoming more pronounced as benchmark difficulty increases. On the more challenging LiveCodeBench and xCodeEval benchmarks, our approach improves performance by 11-20% over strong baselines while reducing the number of API calls by an average of 4-10 per execution. 1 Introduction Figure 1: Overview of (a) a representative traditional code generation and (b) the proposed CollabCoder framework. Unlike conventional methods that rely on a fixed plan throughout code generation, CollabCoder allows the plan to be revised during execution. Multiple agents collaboratively assess intermediate outcomes and determine whether plan or code updates are required, enabling iterative refinement toward the final result. Code generation (known as program synthesis), a long-standing challenge in computer science, involves automatically generating programs from natural language requirements. The rapid growth of large language models (LLMs) has enabled fully executable code generation without human intervention 17 ; 16 ; 3 . However, generating correct code for complex requirements poses challenges, particularly in advanced programming tasks 15 ; 5 . Early approaches to LLM-based code generation primarily relied on direct prompting, where models such as Codex 3 generated code from natural language descriptions and input-output examples. More recent strategies have introduced structured prompting techniques like Chain-of-Thought reasoning 25 , and retrieval-augmented generation 19 , which guide the model using similar prior problems and solutions. Despite these improvements, performance on complex code generation tasks remains limited, as generated outputs frequently fail to pass test cases and lack integrated bug-fixing mechanisms. To address this, the plan-before-code paradigm 12 has been proposed to separate high-level intent modeling from code synthesis. This idea has been incorporated into modern state-of-the-art systems, which typically adopt a dual-pass paradigm: In the first pass, a plan is generated and used to produce initial code with LLMs, while the second pass focuses on refining or debugging the resulting output (Figure 1 (a)). However, refinement is often superficial, driven by simple score-based retries that do not address root causes of failure. To overcome these limitations, recent works have proposed agent-based frameworks 9 ; 10 , which decompose the generation process into modular components for retrieval, planning, and debugging in an iterative manner for improving the code through iterations. Despite their promise, these systems still suffer from two fundamental limitations. First, debugging remains largely reactive, with little support for contextual learning or explicit error attribution. Consequently, the system often produces repetitive and only marginally effective revisions, while failing to identify the root causes of errors or to leverage insights from prior unsuccessful attempts. This lack of principled error modeling not only undermines debugging efficiency, but also limits the system’s capacity to improve over successive iterations. Second, the planning module in existing approaches is typically held fixed throughout the debugging process, rather than being updated in response to code revisions and intermediate feedback. Such a static planning strategy prevents the planner and debugger from co-adapting over time, weakens coordination across different stages of the code generation pipeline, and further increases the complexity of repeatedly revising code under an already flawed plan. As a result, although these systems have shown encouraging potential, their inability to support adaptive debugging and iterative plan refinement remains a major barrier to robust and scalable performance. Recognizing these limitations, we introduce CollabCoder, a novel Plan-Code Co-Evolution framework that addresses these challenges through multi-agent collaboration, adaptive feedback, and experience-driven learning, as illustrated in Figure 1 (b). Specifically, the main contributions of this study to agent-based code generation are threefold as follows: (i) CollabCoder enables continuous improvement through a co-evolutionary process between planning and code generation. It leverages a multi-agent collaboration framework, termed Collaborative Decision-Making, in which planning, coding, and debugging agents work synergistically to decide whether to update the plan or refine the code at each iteration; (ii) To guide plan- or code-level updates, CollabCoder performs fine-grained analysis of multiple elements, including the plan, the generated code, and their alignment, rather than relying on superficial error-log inspection as in prior methods. These analyses are incorporated into a Reasoning Trajectory module, which integrates diagnostics from the current iteration with historical debugging strategies to iteratively improve both the plan and the code; and (iii) We conduct comprehensive evaluations of CollabCoder across a diverse set of benchmarks, ranging from simpler datasets (i.e., HumanEval and MBPP) to more challenging competitive programming benchmarks (i.e., xCodeEval and LiveCodeBench). The results demonstrate consistent improvements in terms of both accuracy and efficiency. 2 Related Work Figure 2: Architecture of the CollabCoder Framework. This diagram illustrates the co-evolutionary dynamics of the Dynamic Planning Agent and Adaptive Coding Agent, integrated with the Collaborative Debug Agent and Reasoning Trajectory Module, highlighting their continuous feedback loops and self-improving debugging mechanisms that enable adaptive plan evolution and code generation, overcoming the limitations of static planning in prior works. 2.1 Code Generation Tasks Code generation has long been recognized as a fundamental challenge in software engineering 18 . Traditional approaches primarily rely on training neural networks with task-specific annotated data methods, such as semantic parsing 21 and retrieval-based techniques 20 . Recently, several studies have leveraged pretrained language models (LMs) through continual training on both programming languages (PL) and natural languages (NL), enabling support for a variety of downstream NL-PL tasks, such as natural language code search and automatic code documentation generation 6 ; 24 . Nonetheless, the limited capacity of backbone language models restricts their utility in practical applications. 2.2 LLM for Code Generation With their growing success, LLMs have demonstrated remarkable capabilities in code generation, driven by scaling model parameters to billions and training on extensive, diverse corpora with varied learning objectives. Recently, state-of-the-art closed-source models, such as GPT-4.1 and Claude 3.7 Sonnet, have emerged as powerful AI coding assistants. In parallel, open-source models like StarCoder 14 , Code Llama 22 , DeepSeekCoder 7 , and Qwen2.5-Coder 8 have achieved significant breakthroughs, surpassing traditional methods across numerous benchmarks. Despite these advances, modern foundational LLMs for code still lack execution awareness, struggle to distinguish reasoning errors from implementation bugs, operate in a largely stateless manner without learning from past failures. As a result, developers must handle all testing and debugging themselves. 2.3 LLM Agents for Code Generation To overcome the limitations of standalone LLMs, recent work has proposed LLM agents that integrate planning, execution, and debugging into iterative workflows, such as MapCoder 9 , CodeSIM 10 , CodeAgent 28 , ThinkCoder 29 , and PairCoder