KAT-Coder Technical Report

Zizheng Zhan ∗ ⁣ † {}^{*\,{\dagger}} , Ken Deng ∗ ⁣ † {}^{*\,{\dagger}} , Jinghui Wang ∗ , Xiaojiang Zhang ∗ , Huaixi Tang ∗ , Minglei Zhang ∗ , Zhiyi Lai ∗ , Haoyang Huang ∗ , Wen Xiang ∗ , Kun Wu ∗ , Wenhao Zhuang, Shaojie Wang, Shangpeng Yan, Kepeng Lei, Zongxian Feng, Huiming Wang, Zheng Lin, Me · 2025

Read KAT-Coder Technical Report by Zizheng Zhan ∗ ⁣ † {}^{*\,{\dagger}} , Ken Deng ∗ ⁣ † {}^{*\,{\dagger}} , Jinghui Wang ∗ , Xiaojiang Zhang ∗ , Huaixi Tang ∗ , Minglei Zhang ∗ , Zhiyi Lai ∗ , Haoyang Huang ∗ , Wen Xiang ∗ , Kun Wu ∗ , Wenhao Zhuang, Shaojie Wang, Shangpeng Yan, Kepeng Lei, Zongxian Feng, Huiming Wang, Zheng Lin, Me (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18779.txt.

Description

Zizheng Zhan and thirty-nine co-authors introduce KAT-Coder, a large language model trained to act as an autonomous coding agent rather than a text completer. Static training on code text does not by itself prepare a model for the planning, tool use, and error recovery of real software work. Their training follows a multi-stage curriculum meant to close that gap step by step.

Early stages build reasoning, planning, and reflection from real engineering data and synthetic agent interactions. A fine-tuning stage uses a million examples balanced across twenty programming languages, ten development settings, and ten task types. A reinforcement stage introduces a reward scheme with several correct answers, stabilizing learning, and a final stage adapts the model to production editor environments. The resulting thirty-two-billion-parameter model, KAT-Dev, was open-sourced, and the report presents it as a deployable foundation for real coding agents.

Catalog record

CREATORZizheng Zhan ∗ ⁣ † {}^{*\,{\dagger}} , Ken Deng ∗ ⁣ † {}^{*\,{\dagger}} , Jinghui Wang ∗ , Xiaojiang Zhang ∗ , Huaixi Tang ∗ , Minglei Zhang ∗ , Zhiyi Lai ∗ , Haoyang Huang ∗ , Wen Xiang ∗ , Kun Wu ∗ , Wenhao Zhuang, Shaojie Wang, Shangpeng Yan, Kepeng Lei, Zongxian Feng, Huiming Wang, Zheng Lin, Me
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-18779

Browse the full library · About the Tower of Babel