CODA : CO ordinating the Cerebrum and Cerebellum for a D ual-Brain Computer Use A gent with Decoupled Reinforcement Learning.
Zeyi Sun, Yuhang Cao, Jianze Liang, Qiushi Sun, Ziyu Liu Zhixiong Zhang, Yuhang Zang, Xiaoyi Dong, Kai Chen, Dahua Lin, Jiaqi Wang · 2025
Read CODA : CO ordinating the Cerebrum and Cerebellum for a D ual-Brain Computer Use A gent with Decoupled Reinforcement Learning. by Zeyi Sun, Yuhang Cao, Jianze Liang, Qiushi Sun, Ziyu Liu Zhixiong Zhang, Yuhang Zang, Xiaoyi Dong, Kai Chen, Dahua Lin, Jiaqi Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20096.txt.
Introduction
A team of eleven authors builds a dual brain computer use agent in this 2025 paper. Software agents that operate computer interfaces struggle in science domains. They must plan long tasks and also click and type with precision, and past planner plus actor pairs could not learn from experience.
Their agent, CODA, pairs a generalist planner, the cerebrum, with a specialist executor, the cerebellum, and trains both. First, an expert planner is trained for each application from a few task runs. Then, winning runs from all experts are pooled to build a shared planner. The two stage design aims to keep both planning range and execution skill as data stay scarce.
Catalog record
| CREATOR | Zeyi Sun, Yuhang Cao, Jianze Liang, Qiushi Sun, Ziyu Liu Zhixiong Zhang, Yuhang Zang, Xiaoyi Dong, Kai Chen, Dahua Lin, Jiaqi Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-20096
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CODA : CO ordinating the Cerebrum and Cerebellum for a D ual-Brain Computer Use A gent with Decoupled Reinforcement Learning. Zeyi Sun, Yuhang Cao, Jianze Liang, Qiushi Sun, Ziyu Liu Zhixiong Zhang, Yuhang Zang, Xiaoyi Dong, Kai Chen, Dahua Lin, Jiaqi Wang Abstract Autonomous agents for Graphical User Interfaces (GUIs) face significant challenges in specialized domains like scientific computing, require both long-horizon planning and precise, fine-grained execution. Existing approaches suffer from a trade-off: generalist agents excel at planning but falter in execution, while specialized agents show the opposite weakness. While recent compositional frameworks attempt to bridge this gap by combining a ”planner” and an ”actor,” they are typically static and non-trainable, preventing adaptation from experience—a critical limitation given the scarcity of high-quality data in scientific domains. To address these limitations, we introduce CODA , a novel and trainable compositional framework that synergizes a generalist planner (Cerebrum) with a specialist executor (Cerebellum), trained with a dedicated two-stage training pipeline. The first stage, Specialization , employs a decoupled GRPO approach to train an expert planner for each scientific application individually, bootstrapping from a small set of initial task trajectories. The second stage, Generalization , aggregates all successful trajectories from all specialized experts. This consolidated, high-quality dataset is then used to perform supervised fine-tuning (SFT) on the final planner, equipping it with the robust, cross-domain capabilities of a generalist. Evaluated on four challenging applications from the ScienceBoard benchmark, our framework significantly outperforms the baseline and establishes a new state-of-the-art (SOTA) among open-source models. Our models and code are available at https://github.com/OpenIXCLab/CODA . † † footnotetext: \dagger Corresponding Authors. ∗ Equal contribution 1 Introduction Autonomous agents for Graphical User Interfaces (GUIs) ( Anthropic 2024 ; OpenAI 2025 ; Qin et al. 2025 ; Lin et al. 2024 ; Wu et al. 2024b ; Hong et al. 2023 ) promise to automate a wide range of digital tasks ( Zhou et al. 2023 ; Xie et al. 2024 ) . However, their application in specialized domains such as scientific computing and engineering analysis remains highly challenging ( Sun et al. 2025a ) . These environments pose two primary difficulties: first, their interfaces are highly complex, requiring precise and fine-grained actions; second, the problems they address are intrinsically complicated, demanding long-horizon planning to achieve effective solutions. Effective agency for computer task automation in these domains requires both high-level planning and low-level execution as well as domain knowledge. However, current models exhibit a clear trade-off. Generalist models like Qwen2.5-VL ( Bai et al. 2025 ) provide robust planning capabilities but often struggle with the precise grounding needed for reliable execution. Conversely, specialized agents ( Wu et al. 2024b ; Wu et al. 2025 ; Xie et al. 2025 ) like UI-Tars ( Qin et al. 2025 ) are highly proficient in execution, yet their capacity for complex, high-level planning is more constrained. To bridge this gap, a natural approach has been to develop compositional frameworks that explicitly decouple planning from execution, effectively pairing a generalist “cerebrum” with a specialist “cerebellum” ( Agashe et al. 2024 ; Agashe et al. 2025 ) . While promising, these pioneering approaches are fundamentally limited. They are typically static and non-trainable, relying on powerful, often closed-source models as their core planner. This design introduces significant drawbacks: it compromises transparency and replicability, and most critically, prevents the agent from learning and adapting through experience. This architectural decoupling is not merely an engineering convenience but is inspired by the functional architecture of the human brain (illustrated in Fig. 1 ). The specialization of high-level planning (the Cerebrum) and low-level motor control (the Cerebellum) is a key aspect of human intelligence. Crucially, these structures exhibit different learning patterns: the Cerebellum, once mature, provides stable and broadly applicable motor skills that require infrequent updates Ito 2000 . In contrast, the Cerebrum continuously adapts its strategies based on the nuances of new tasks and environments Demarin & Morović 2014 ; Hallett 2005 . This biological parallel motivates our core hypothesis: an effective agent should pair a stable, proficient grounding model with a dynamic planner that is specialized for different software domains through targeted, experience-driven learning. Figure 1: Overall architecture of the proposed learnable Planner–Executor framework. Analogous to the relationship between the cerebrum and the cerebellum in the human brain, the Planner (cerebrum) generates high-level thoughts based on the history and screenshots, while the Executor (cerebellum) executes concrete GUI actions accordingly. To realize this vision, we propose a trainable compositional framework that integrates Qwen2.5-VL Bai et al. 2025 as the planner (cerebrum) and UI-Tars-1.5 Qin et al. 2025 as the executor (cerebellum). Unlike prompting-based systems that rely on proprietary closed-source planners, our framework makes the planner itself learnable through interaction with software environments mediated by a static executor. Concretely, the executor provides stable, software-agnostic grounding for low-level GUI actions, while the planner, by leveraging this reliable interface, can gradually acquire domain-specific knowledge and improve its high-level planning strategies. In contrast to end-to-end training of a full agent, which requires massive amounts of specialized data and costly retraining of both perception and execution modules, our decoupled approach is substantially more data efficient: only the planner is optimized for domain adaptation, while the executor remains fixed as a general-purpose grounder that already possesses strong generalization ability after massive pretraining for grounding purposes. This design reduces reliance on curated trajectories, lowers training cost, and ensures controllable adaptation. To train the planner effectively under this cerebrum–cerebellum separation, we avoid the need for costly human-labeled trajectories. Instead, we leverage a judging system built from open-source models to automatically provide dense reward signals, combined with autonomous interaction with scientific software environments through the static executor. This setup enables the planner to gradually acquire domain-specific planning ability with zero human effort. Furthermore, by distributing the interaction process across multiple software environments in parallel—coordinated by a central master—we can significantly accelerate reinforcement learning. This strategy not only makes the training process more efficient but also echoes our brain-inspired design: the cerebellum-like executor delivers stable grounding, while the cerebrum-like planner continually adapts through experience. We validate our framework on four typical scientific software applications from the ScienceBoard benchmark ( Sun et al. 2025a ) . Experiments show that our method not only significantly improves the baseline performance (Cerebrum: Qwen2.5-32B-VL, Cerebellum: UI-Tars-1.5) but also establishes a new state-of-the-art (SOTA) among open-source models, confirming its effectiveness. 2 Related Works Reinforcement Learning for LVLMs. Training for LLMs and LVLMs ( Touvron et al. 2023 ; Grattafiori et al. 2024 ; Liu et al. 2023a ; Bai et al. 2025 ; Wang et al. 2024 ; Xing et al. 2025 ; Sun et al. 2024d ; Sun et al. 2024c ; Ding et al. 2025 ) has progressed from data-intensive Supervised Fine-Tuning (SFT) ( Liu et al. 2023a ; Wei et al. 2022 ) towards Reinforcement Learning (RL). Algorithms like Group Relative Policy Optimization (GRPO) ( Guo et al. 2025 ; Shao et al. 2024 ) have proven effective for reasoning tasks, moving beyond earlier single-turn RLHF applications ( Ouyang et al. 2022 ; Ziegler et al. 2019 ; Rafailov et al. 2023 ) . However, applying RL to complex agentic tasks ( Bai et al. 2024 ; Qi et al.