Cookie-Bench: Continuous On-screen Key Interaction Evaluation for Web Generation
Haoyue Yang, Zhangxiao Shen, Fan Ding, Hangting Lou, Yifeng Kou · 2026
Read Cookie-Bench: Continuous On-screen Key Interaction Evaluation for Web Generation by Haoyue Yang, Zhangxiao Shen, Fan Ding, Hangting Lou, Yifeng Kou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30000.txt.
Introduction
Haoyue Yang and ten colleagues build a new way to judge websites that language models generate, replacing slow human leaderboards with automatic live review. Their benchmark spans 11 areas and 1000 tasks across static pages and interactive apps, with briefs rewritten against memorized answers. Their judging framework first watches, then drives the app while recording video and screenshots, and only then scores function and looks with reasons for failures. On the benchmark, its verdicts track expert human ratings closely, while showing large room for growth across 13 models.
Catalog record
| CREATOR | Haoyue Yang, Zhangxiao Shen, Fan Ding, Hangting Lou, Yifeng Kou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 138037 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30000