ResearchEnvBench: Benchmarking Agents on Environment Synthesis for Research Code Execution
Yubang Wang, Chenxi Zhang, Bowen Chen, Zezheng Huai, Zihao Dai, Xinchi Chen, Yuxin Wang, Yining Zheng, Jingjing Gong, Xipeng Qiu · 2026
Read ResearchEnvBench: Benchmarking Agents on Environment Synthesis for Research Code Execution by Yubang Wang, Chenxi Zhang, Bowen Chen, Zezheng Huai, Zihao Dai, Xinchi Chen, Yuxin Wang, Yining Zheng, Jingjing Gong, Xipeng Qiu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06739.txt.
Description
Wang and colleagues present ResearchEnvBench, a benchmark for a skill other agent tests assume away: building a runnable setup for research code. Given a repo, its docs, and a target setting, an agent must sort out dependencies, align hardware and framework versions, and configure execution so the code runs. Tests on varied repos show a large gap in top agents. Failures center on missing dependencies and fragile version ties.
Catalog record
| CREATOR | Yubang Wang, Chenxi Zhang, Bowen Chen, Zezheng Huai, Zihao Dai, Xinchi Chen, Yuxin Wang, Yining Zheng, Jingjing Gong, Xipeng Qiu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37362 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.06739