R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents

Naman Jain 1 ⋆ Jaskirat Singh 2 ⋆ Manish Shetty 1 Liang Zheng 2 Koushik Sen 1 Ion Stoica 1 1 UC Berkeley 2 Australian National University { [email protected] [email protected] } · 2025

Read R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents by Naman Jain 1 ⋆ Jaskirat Singh 2 ⋆ Manish Shetty 1 Liang Zheng 2 Koushik Sen 1 Ion Stoica 1 1 UC Berkeley 2 Australian National University { [email protected] [email protected] } (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07164.txt.

Description

Naman Jain and co-authors build R2E-Gym, a training ground for open software engineering agents. Their twenty twenty-five paper tackles two blocks to better code agents: too few run-ready tasks, and poor use of extra test-time compute. Real tasks mean fixing real GitHub issues.

Their gym, called AgentGym in the text, holds more than eight thousand executable tasks. A recipe named SYNGEN builds tasks from code commits by generating tests and back-translating, with no human issues needed. Their model scored strongly on a verified benchmark of real tasks. A hybrid test-time plan then weighs more tries against more checks, guiding how agents spend compute.

Catalog record

CREATORNaman Jain 1 ⋆ Jaskirat Singh 2 ⋆ Manish Shetty 1 Liang Zheng 2 Koushik Sen 1 Ion Stoica 1 1 UC Berkeley 2 Australian National University { [email protected] [email protected] }
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07164

Browse the full library · About the Tower of Babel