Vibe Code Bench: Evaluating AI Models on End-to-End Web Application Development CCS: Computing methodologies Natural language processing CCS: Software and its engineering Software testing and debugging CCS: Software and its engineering Software development techniques CCS: Computing methodologies Neural networks
Hung Tran, Langston Nashold, Rayan Krishnan, Antoine Bigeard, Alex Gu · 2026
Read Vibe Code Bench: Evaluating AI Models on End-to-End Web Application Development CCS: Computing methodologies Natural language processing CCS: Software and its engineering Software testing and debugging CCS: Software and its engineering Software development techniques CCS: Computing methodologies Neural networks by Hung Tran, Langston Nashold, Rayan Krishnan, Antoine Bigeard, Alex Gu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04601.txt.
Description
Tran and colleagues test AI models on full web app building with Vibe Code Bench. Past benchmarks test lone tasks, not the full zero-to-one path from spec to working app. The bench holds 100 web app specs with 964 browser workflows and 10,131 substeps. An autonomous browser agent judges the specs on live apps. Across 16 frontier models, the best reaches 61.8 percent accuracy on the test split. Self-testing during generation strongly predicts performance, and evaluator choice shifts outcomes widely.
Catalog record
| CREATOR | Hung Tran, Langston Nashold, Rayan Krishnan, Antoine Bigeard, Alex Gu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84833 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04601