VeRO: An Evaluation Harness for Agents to Optimize Agents
Varun Ursekar, Apaar Shanker, Veronica Chatrath, Yuan (Emily) Xue, Sam Denton · 2026
Read VeRO: An Evaluation Harness for Agents to Optimize Agents by Varun Ursekar, Apaar Shanker, Veronica Chatrath, Yuan (Emily) Xue, Sam Denton (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22480.txt.
Description
Coding agents are increasingly used to improve other agents, but the field lacks a systematic picture of how well that works. Varun Ursekar and four co-authors note that harness optimization differs from ordinary software work. Agent harnesses mix fixed code with random language-model outputs, so both step-by-step traces and final outcomes must be captured in structured form. They introduce VeRO, an outer harness for versioned snapshots, budget-controlled evaluation, and structured traces of target harnesses.
Alongside it comes VeRO-Bench, a suite of target agents and tasks with reference evaluation procedures. Using VeRO, the team runs an empirical study comparing optimizers across tasks and asking which edits reliably improve target harnesses. The team makes VeRO publicly available so research into agent optimization can develop as a central competence for coding agents.
Catalog record
| CREATOR | Varun Ursekar, Apaar Shanker, Veronica Chatrath, Yuan (Emily) Xue, Sam Denton |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-22480