SWE-smith: Scaling Data for Software Engineering Agents

John Yang 1, Kilian Lieret 2, Carlos E. Jimenez 2, Alexander Wettig 2, Kabir Khandpur 3, Yanzhe Zhang 1, Binyuan Hui 4, Ofir Press 2, Ludwig Schmidt 1, Diyi Yang 1, 1 Stanford University, 2 Princeton University, 3 Indepedent, 4 Alibaba Qwen · 2025

Read SWE-smith: Scaling Data for Software Engineering Agents by John Yang 1, Kilian Lieret 2, Carlos E. Jimenez 2, Alexander Wettig 2, Kabir Khandpur 3, Yanzhe Zhang 1, Binyuan Hui 4, Ofir Press 2, Ludwig Schmidt 1, Diyi Yang 1, 1 Stanford University, 2 Princeton University, 3 Indepedent, 4 Alibaba Qwen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21798.txt.

Introduction

Yang and a large team present SWE-smith, a pipeline that creates software repair tasks at scale for training AI agents, in a paper from twenty twenty-five. Training data for coding agents were scarce and costly to curate by hand. Past sets held only thousands of cases from a few code bases. SWE-smith builds tasks automatically from any Python project.

For each project, it builds a runnable environment, then breaks tests on purpose to form tasks. The team creates fifty thousand tasks from one hundred twenty-eight projects. That dwarfs all prior sets combined. A model trained on the data solves over forty percent of a verified benchmark. All tools, tasks, and models are released openly.

Catalog record

CREATORJohn Yang 1, Kilian Lieret 2, Carlos E. Jimenez 2, Alexander Wettig 2, Kabir Khandpur 3, Yanzhe Zhang 1, Binyuan Hui 4, Ofir Press 2, Ludwig Schmidt 1, Diyi Yang 1, 1 Stanford University, 2 Princeton University, 3 Indepedent, 4 Alibaba Qwen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE130 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-21798

Browse the full library · About the Tower of Babel