AutoEvoEval: An Automated Framework for Evolving Close-Ended LLM Evaluation Data
Jiaru Wu, Mingwei Liu · 2025
Read AutoEvoEval: An Automated Framework for Evolving Close-Ended LLM Evaluation Data by Jiaru Wu, Mingwei Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23735.txt.
Description
JiaRu Wu and Mingwei Liu present AutoEvoEval in two thousand twenty-five. Their frame grows test data for large language models on its own. Fixed test sets can miss weak spots in how models cope with change. Past growth methods lacked control over change types and depth.
AutoEvoEval has a set of clear atomic change steps. Steps can stack over rounds to make hard, real style samples. Tests span many open and closed models. Single steps cut scores by a clear margin on average. Stacked steps cut scores far more. The pair argue that fixed tests flatter models. Growth aware tests give a truer view of skill.
Catalog record
| CREATOR | Jiaru Wu, Mingwei Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-23735