EvoCodeBench: A Human-Performance Benchmark for Self-Evolving LLM-Driven Coding Systems Conference: KDD 2026; August 9 to 13, 2026; Jeju, Korea
Wentao Zhang 1,† \mathpunct{,} Jianfeng Wang 2,† \mathpunct{,} Liheng Liang 3,† \mathpunct{,} Yilei Zhao 1 \mathpunct{,} HaiBin Wen 4 \mathpunct{,} Zhe Zhao 5,‡ 1 Nanyang Technological University 2 East China University of Science and Technology 3 Guangdong Ocean University 4 City University of Hong · 2026
Read EvoCodeBench: A Human-Performance Benchmark for Self-Evolving LLM-Driven Coding Systems Conference: KDD 2026; August 9 to 13, 2026; Jeju, Korea by Wentao Zhang 1,† \mathpunct{,} Jianfeng Wang 2,† \mathpunct{,} Liheng Liang 3,† \mathpunct{,} Yilei Zhao 1 \mathpunct{,} HaiBin Wen 4 \mathpunct{,} Zhe Zhao 5,‡ 1 Nanyang Technological University 2 East China University of Science and Technology 3 Guangdong Ocean University 4 City University of Hong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-10171.txt.
Description
Coding benchmarks usually grade static results and assume fixed power during runs, missing how agents improve as they iterate. A 2026 paper led by Wentao Zhang, with five co-authors, presents EvoCodeBench, a benchmark for self-changing language-model coding systems across coding languages, matched against human coders. It tracks scores beside speed gauges such as solving time, memory use, and better algorithmic design over repeat attempts.
Results show self-changing systems gaining clearly in speed over time, and human-matched plus multi-language looks reveal insights scores alone hide. Cross-language toughness and long-tail language strength, often thin, are covered under one set of rules. The benchmark sets a base for judging coding intelligence as it changes during runs.
Catalog record
| CREATOR | Wentao Zhang 1,† \mathpunct{,} Jianfeng Wang 2,† \mathpunct{,} Liheng Liang 3,† \mathpunct{,} Yilei Zhao 1 \mathpunct{,} HaiBin Wen 4 \mathpunct{,} Zhe Zhao 5,‡ 1 Nanyang Technological University 2 East China University of Science and Technology 3 Guangdong Ocean University 4 City University of Hong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 118 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-10171