VeRO: An Evaluation Harness for Agents to Optimize Agents

Varun Ursekar, Apaar Shanker, Veronica Chatrath, Yuan (Emily) Xue, Sam Denton · 2026

Read VeRO: An Evaluation Harness for Agents to Optimize Agents by Varun Ursekar, Apaar Shanker, Veronica Chatrath, Yuan (Emily) Xue, Sam Denton (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22480.txt.

Description

Coding agents are increasingly used to improve other agents, but the field lacks a systematic picture of how well that works. Varun Ursekar and four co-authors note that harness optimization differs from ordinary software work. Agent harnesses mix fixed code with random language-model outputs, so both step-by-step traces and final outcomes must be captured in structured form. They introduce VeRO, an outer harness for versioned snapshots, budget-controlled evaluation, and structured traces of target harnesses.

Alongside it comes VeRO-Bench, a suite of target agents and tasks with reference evaluation procedures. Using VeRO, the team runs an empirical study comparing optimizers across tasks and asking which edits reliably improve target harnesses. The team makes VeRO publicly available so research into agent optimization can develop as a central competence for coding agents.

Catalog record

CREATORVarun Ursekar, Apaar Shanker, Veronica Chatrath, Yuan (Emily) Xue, Sam Denton
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-22480

Browse the full library · About the Tower of Babel