KAT-Coder-V2 Technical Report
KwaiKAT Team · 2026
Read KAT-Coder-V2 Technical Report by KwaiKAT Team (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27703.txt.
Introduction
Li and a large team present KAT-Coder-V2, an agentic coding model. Training splits skills into five expert domains first. Software, web, terminal, search, and general tasks train apart. Each expert gets supervised tuning plus reinforcement learning. On-policy distillation then merges them into one model. A sandbox system runs tens of thousands of sessions at once. Scores hit 79.6 percent on SWE-bench Verified. Frontend and terminal results also rank high.
Catalog record
| CREATOR | KwaiKAT Team |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55590 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27703
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KAT-Coder-V2 Technical Report KwaiKAT Team Abstract We present KAT-Coder-V2, an agentic coding model developed by the KwaiKAT team at Kuaishou. KAT-Coder-V2 adopts a Specialize-then-Unify paradigm that decomposes agentic coding into five expert domains—SWE, WebCoding, Terminal, WebSearch, and General—each undergoing independent supervised fine-tuning and reinforcement learning, before being consolidated into a single model via on-policy distillation. We develop KwaiEnv , a modular infrastructure sustaining tens of thousands of concurrent sandbox instances, and scale RL training along task complexity, intent alignment, and scaffold generalization. We further propose MCLA for stabilizing MoE RL training and Tree Training for eliminating redundant computation over tree-structured trajectories with up to 6.2 × \times speedup. KAT-Coder-V2 achieves 79.6% on SWE-bench Verified (vs. Claude Opus 4.6 at 80.8%), 88.7 on PinchBench (surpassing GLM-5 and MiniMax M2.7), ranks first across all three frontend aesthetics scenarios, and maintains strong generalist scores on Terminal-Bench Hard (46.8) and τ 2 \tau^{2} -Bench (93.9). Our model is publicly available at https://streamlake.com/product/kat-coder . \reportnumber 001 Figure 1 : Results of KAT-Coder-V2 and Claude Opus 4.6 across different scaffolds on various software engineering benchmarks. 1 Introduction Large Language Models (LLMs) are rapidly evolving from single-turn code generation toward Agentic Coding , the ability to autonomously plan, execute, and verify multi-step software engineering tasks within real-world development environments. Recent frontier models [ 1 , 2 , 3 , 4 , 5 , 6 ] have demonstrated impressive progress in this direction, steadily advancing the state of the art on benchmarks including SWE-bench [ 7 ] , Terminal-Bench [ 8 ] , and \tau^{2} -Bench [ 9 ] . Unlike traditional code question-answering or mathematical reasoning, agentic coding requires models to interact with authentic code repositories, manage intricate dependency graphs, orchestrate multi-turn tool invocations, and ground their decisions in execution feedback. This interactive, long-horizon workflow demands that models’ multi-step behaviors be aligned with end-to-end engineering outcomes, rather than merely optimizing for single-turn code correctness. Realizing this vision presents three fundamental challenges. The first is capability fragmentation . SWE tasks require long-chain code editing grounded in test verification, WebCoding demands aesthetic judgment under sparse colloquial inputs, and Terminal tasks call for persistent environment state tracking. The training signals across these domains are not merely different but often conflicting, making it impractical for a single monolithic training pipeline to reach the optimum in every domain simultaneously. The second challenge is infrastructure coupling . Agentic RL training demands high-throughput sandbox orchestration, heterogeneous benchmark support, and seamless compatibility with a rapidly growing ecosystem of agent scaffolds such as Claude Code, OpenClaw, and OpenCode. Existing systems, however, tightly couple these concerns, making every new scaffold or dataset integration a costly engineering endeavor. The third is scaling agentic RL . Effectively training coding agents requires scaling along multiple dimensions simultaneously—task complexity, prompt diversity, and scaffold generalization—while coping with the MoE instability and computational redundancy introduced by tree-structured, multi-turn trajectories. We introduce KAT-Coder-V2 , a comprehensive agentic coding model developed by the KwaiKAT team at Kuaishou. Built upon KAT-Coder-V1 [ 10 ] through continued post-training, the model follows a Specialize-then-Unify paradigm that systematically addresses all three challenges above. We decompose the full capability spectrum into five orthogonal expert domains (SWE, WebCoding, Terminal, WebSearch, and General), each undergoing independent data construction, supervised fine-tuning, and environment-feedback reinforcement learning. The resulting domain experts are then consolidated into a single deployable model through On-Policy Distillation (OPD) , which combines the direct mistake-avoidance of on-policy exploration with dense, step-by-step supervision from the specialized experts, achieving lossless fusion without the exposure bias of offline imitation. To tackle infrastructure coupling, we develop KwaiEnv , a modular infrastructure that decouples datasets, sandboxes, scaffolds, and verifiers, sustaining tens of thousands of concurrent sandbox instances. Built on this foundation, we propose an Agentic Scaling paradigm that systematically scales RL training along task complexity, intent alignment, and scaffold generalization, yielding over 100K diverse, high-difficulty training samples across multiple agent frameworks. To stabilize MoE RL training, we propose MCLA (Monte-Carlo Log-probability Averaging) for reducing log-probability variance. We further introduce Tree Training for eliminating redundant computation over tree-structured trajectories, achieving up to 6.2 \times training speedup. Extensive evaluation shows that KAT-Coder-V2 closely matches Claude Opus 4.6 across scaffolds and benchmarks: 79.6% on SWE-bench Verified (vs. 80.8%), 88.7 on PinchBench (surpassing GLM-5 at 86.4 and MiniMax M2.7 at 87.1), leading scores across all three frontend aesthetics scenarios (Landing Page 59.8, Slides 57.6, Data Visualization 67.6), and strong generalist performance (Terminal-Bench Hard 46.8, \tau^{2} -Bench 93.9). These results confirm that domain-specialized training, large-scale agentic RL with systematic scaling, and unified on-policy distillation form an effective path to powerful coding agents. 2 KwaiEnv: Infrastructure for Agentic Code Intelligence 2.1 Background and Design Motivation As the capabilities of Large Language Models continue to evolve, Agentic Coding has emerged as a critical domain for model evaluation and Reinforcement Learning (RL) training. Unlike traditional Question-Answering (QA) or mathematical reasoning tasks, Agentic Coding—particularly Software Engineering (SWE) tasks—requires models to execute multi-step, long-chain operations within a sandbox environment equipped with authentic code repositories, dependencies, and test suites. The rollout process for these tasks involves several complex stages, including environment initialization, tool calling, state management, and result verification, far exceeding the complexity of single-turn inference scenarios. In engineering practice, this complexity introduces the following challenges: • Dataset Heterogeneity: Diverse benchmarks (e.g., SWE-bench, SWE-bench Pro [ 11 ] ) impose varying requirements on sandbox images and evaluation logic. • Scaffold Proliferation: New scaffolds for Coding Agents are constantly emerging with significant differences in integration protocols; without a unified abstraction, onboarding each new agent requires redundant engineering effort. • High-Throughput Demands: During the RL training phase, a massive number of rollouts must be executed concurrently, placing stringent performance requirements on sandbox scheduling and trajectory collection. To address these challenges, we developed KwaiEnv. The core design objective is to decouple datasets, sandboxes, scaffolds, and verification logic through a modular and configurable architecture. This allows for the flexible combination of components at minimal cost, supporting the entire workflow from model evaluation to RL training. 2.2 System Overview KwaiEnv provides a unified interface that supports the configurable combination of models, scaffolds, and datasets. This enables a complete closed-loop workflow encompassing model trajectory collection, rollout evaluation, and the delivery of trajectories to the RL engine for training. The system consists of five core modules, each with distinct responsibilities and high degrees of decoupling, allowing for flexible extension as needed. In a typical workflow, the user specifies the dataset, target model, and scaffold via a configuration file. KwaiEnv then orchestrates the necessary remote sandboxes, deploys the scaffold onto the corresponding dataset images, and forwards model requests to the target LLM through a unified network proxy layer, recording the entire interaction trajectory. Upon completion, the Verifier scores the results, and the Trajectory Manager formats the trajectories for the RL engine. This entire pipeline operates autonomously without human intervention, significantly reducing the engineering overhead of data collection and model training, as shown in figure 2 . Figure 2 : KwaiEnv Workflow for SWE Tasks, Supporting Key Processes Including Data Synthesis, RL, and Evaluation 2.3 Core Modules 2.3.1 Dataset KwaiEnv integrates mainstream LLM benchmarks covering data analysis, code generation, SWE, web search, and general reasoning. This includes widely adopted evaluation sets such as SWE-bench [ 7