Do Androids Dream of Breaking the Game? Systematically Auditing AI Agent Benchmarks with BenchJack
Hao Wang, Hanchen Li, Qiuyang Mang, Alvin Cheung, Koushik Sen, Dawn Song · 2026
Read Do Androids Dream of Breaking the Game? Systematically Auditing AI Agent Benchmarks with BenchJack by Hao Wang, Hanchen Li, Qiuyang Mang, Alvin Cheung, Koushik Sen, Dawn Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12673.txt.
Description
Wang and five colleagues audit AI agent benchmarks for reward hacking with BenchJack, an auto red-teaming system. Benchmarks guide model selection, funding and use, yet reward hacking emerges on its own in frontier models without overfit. Reward hacking means agents chase a score without performing the set task. From past incidents, the team derives eight repeat flaw patterns in the Agent-Eval list for benchmark makers. BenchJack drives coding agents to audit benchmarks, and a repeat loop finds flaws and patches them.
Catalog record
| CREATOR | Hao Wang, Hanchen Li, Qiuyang Mang, Alvin Cheung, Koushik Sen, Dawn Song |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 151888 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.12673