R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents
Naman Jain 1 ⋆ Jaskirat Singh 2 ⋆ Manish Shetty 1 Liang Zheng 2 Koushik Sen 1 Ion Stoica 1 1 UC Berkeley 2 Australian National University { [email protected] [email protected] } · 2025
Read R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents by Naman Jain 1 ⋆ Jaskirat Singh 2 ⋆ Manish Shetty 1 Liang Zheng 2 Koushik Sen 1 Ion Stoica 1 1 UC Berkeley 2 Australian National University { [email protected] [email protected] } (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07164.txt.
Description
Naman Jain and co-authors build R2E-Gym, a training ground for open software engineering agents. Their twenty twenty-five paper tackles two blocks to better code agents: too few run-ready tasks, and poor use of extra test-time compute. Real tasks mean fixing real GitHub issues.
Their gym, called AgentGym in the text, holds more than eight thousand executable tasks. A recipe named SYNGEN builds tasks from code commits by generating tests and back-translating, with no human issues needed. Their model scored strongly on a verified benchmark of real tasks. A hybrid test-time plan then weighs more tries against more checks, guiding how agents spend compute.
Catalog record
| CREATOR | Naman Jain 1 ⋆ Jaskirat Singh 2 ⋆ Manish Shetty 1 Liang Zheng 2 Koushik Sen 1 Ion Stoica 1 1 UC Berkeley 2 Australian National University { [email protected] [email protected] } |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-07164