ProEval: Proactive Failure Discovery and Efficient Performance Estimation for Generative AI Evaluation
Yizheng Huang, Wenjun Zeng, Aditi Kumaresan, Zi Wang · 2026
Read ProEval: Proactive Failure Discovery and Efficient Performance Estimation for Generative AI Evaluation by Yizheng Huang, Wenjun Zeng, Aditi Kumaresan, Zi Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23099.txt.
Description
Huang and three colleagues offer ProEval, a cheap way to judge generative AI models by predicting scores and hunting failures early. Pretrained Gaussian Processes stand in for the score function, mapping inputs to error or safety risk, while Bayesian quadrature estimates performance and superlevel sampling seeks failures. Theory shows the estimator unbiased and bounded, and tests on reasoning, safety, and classification benchmarks back the design. ProEval needs 8 to 65 times fewer samples for estimates within 1 percent of truth, surfacing more varied failures under a tight budget.
Catalog record
| CREATOR | Yizheng Huang, Wenjun Zeng, Aditi Kumaresan, Zi Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 131684 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.23099