AutoEvoEval: An Automated Framework for Evolving Close-Ended LLM Evaluation Data

Jiaru Wu, Mingwei Liu · 2025

Read AutoEvoEval: An Automated Framework for Evolving Close-Ended LLM Evaluation Data by Jiaru Wu, Mingwei Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23735.txt.

Description

JiaRu Wu and Mingwei Liu present AutoEvoEval in two thousand twenty-five. Their frame grows test data for large language models on its own. Fixed test sets can miss weak spots in how models cope with change. Past growth methods lacked control over change types and depth.

AutoEvoEval has a set of clear atomic change steps. Steps can stack over rounds to make hard, real style samples. Tests span many open and closed models. Single steps cut scores by a clear margin on average. Stacked steps cut scores far more. The pair argue that fixed tests flatter models. Growth aware tests give a truer view of skill.

Catalog record

CREATORJiaru Wu, Mingwei Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-23735

Browse the full library · About the Tower of Babel