SWE-Protégé: Learning to Selectively Collaborate With an Expert Unlocks Small Language Models as Software Engineering Agents
Patrick Tser Jern Kon, Archana Pradeep, Ang Chen, Alexander P. Ellis, Warren Hunt, Zijian Wang, John Yang, Samuel Thompson · 2026
Read SWE-Protégé: Learning to Selectively Collaborate With an Expert Unlocks Small Language Models as Software Engineering Agents by Patrick Tser Jern Kon, Archana Pradeep, Ang Chen, Alexander P. Ellis, Warren Hunt, Zijian Wang, John Yang, Samuel Thompson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22124.txt.
Description
Small language models are cheap, fast, and adaptable, but they lag on long software-repair tasks, looping actions and rarely finishing. Patrick Tser Jern Kon and seven co-authors reframe repair as an expert-protégé collaboration. The small model stays in charge while learning when to ask a strong expert for help, spot stalled states, and follow through on advice. Training mixes supervised tuning on expert-guided traces with agentic reinforcement learning.
Lightly post-trained, a seven-billion-parameter coder reaches a strong score on SWE-bench Verified, a large jump over the prior small-model best, while calling the expert only a handful of times per task. The system discourages both looping and wasteful expert calls. Small models thus gain a practical path to agent-grade software repair without big-model bills.
Catalog record
| CREATOR | Patrick Tser Jern Kon, Archana Pradeep, Ang Chen, Alexander P. Ellis, Warren Hunt, Zijian Wang, John Yang, Samuel Thompson |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-22124