ProEval: Proactive Failure Discovery and Efficient Performance Estimation for Generative AI Evaluation

Yizheng Huang, Wenjun Zeng, Aditi Kumaresan, Zi Wang · 2026

Read ProEval: Proactive Failure Discovery and Efficient Performance Estimation for Generative AI Evaluation by Yizheng Huang, Wenjun Zeng, Aditi Kumaresan, Zi Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23099.txt.

Description

Huang and three colleagues offer ProEval, a cheap way to judge generative AI models by predicting scores and hunting failures early. Pretrained Gaussian Processes stand in for the score function, mapping inputs to error or safety risk, while Bayesian quadrature estimates performance and superlevel sampling seeks failures. Theory shows the estimator unbiased and bounded, and tests on reasoning, safety, and classification benchmarks back the design. ProEval needs 8 to 65 times fewer samples for estimates within 1 percent of truth, surfacing more varied failures under a tight budget.

Catalog record

CREATORYizheng Huang, Wenjun Zeng, Aditi Kumaresan, Zi Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE131684
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23099

Browse the full library · About the Tower of Babel