Cost-Optimal Active AI Model Evaluation

Anastasios N. Angelopoulos, Jacob Eisenstein, Jonathan Berant, Alekh Agarwal, Adam Fisch · 2025

Read Cost-Optimal Active AI Model Evaluation by Anastasios N. Angelopoulos, Jacob Eisenstein, Jonathan Berant, Alekh Agarwal, Adam Fisch (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07949.txt.

Introduction

Anastasios Angelopoulos and four co-authors develop cost aware methods for evaluating generative AI systems. Checking such systems needs labels, and human labels are accurate but pricey. Machine raters are cheap but biased. The goal is an unbiased estimate of true quality within a fixed labeling budget.

Building on recent work in active and prediction powered inference, the team derives policies that split the budget between weak and strong raters for the best statistical efficiency. Tests on synthetic and real data map when the policies win. Gains grow largest when example difficulty varies a lot. Under those conditions, the same precision costs far less than with standard evaluation.

Catalog record

CREATORAnastasios N. Angelopoulos, Jacob Eisenstein, Jonathan Berant, Alekh Agarwal, Adam Fisch
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-07949

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cost-Optimal Active AI Model Evaluation Anastasios N. Angelopoulos, Jacob Eisenstein, Jonathan Berant, Alekh Agarwal, Adam Fisch Abstract The development lifecycle of generative AI systems requires continual evaluation, data acquisition, and annotation, which is costly in both resources and time. In practice, rapid iteration often makes it necessary to rely on synthetic annotation data because of the low cost, despite the potential for substantial bias. In this paper, we develop novel, cost-aware methods for actively balancing the use of a cheap, but often inaccurate, weak rater—such as a model-based autorater that is designed to automatically assess the quality of generated content—with a more expensive, but also more accurate, strong rater alternative such as a human. More specifically, the goal of our approach is to produce a low variance, unbiased estimate of the mean of the target "strong" rating, subject to some total annotation budget. Building on recent work in active and prediction-powered statistical inference, we derive a family of cost-optimal policies for allocating a given annotation budget between weak and strong raters so as to maximize statistical efficiency. Using synthetic and real-world data, we empirically characterize the conditions under which these policies yield improvements over prior methods. We find that, especially in tasks where there is high variability in the difficulty of examples, our policies can achieve the same estimation precision at a far lower total annotation budget than standard evaluation methods. 1 Introduction Accurately and efficiently evaluating generative AI (GenAI) systems is a core technical challenge, both for model development and for reliable model deployment. In this paper, we introduce new statistical tools for active, cost-sensitive model evaluation. Specifically, we develop evaluation pipelines that dynamically collect and annotate data using a mix of weak and strong annotation options in a way that is aware of their relative costs and strengths. The core idea is to strategically balance inexpensive but potentially inaccurate annotations from a weak rater against more accurate, but also more costly, annotations from a more sophisticated strong rater alternative. The exact composition of the weak and strong raters is flexible; for example, the weak rater might be a small AI model or rule-based heuristic, while the strong rater might be a larger AI model, an AI model equipped with tools or larger inference-time reasoning capabilities, a human, or even an expert human. The cost of the evaluation might then be measured in compute, latency, or dollars. Active evaluation aims to minimize cost by selectively obtaining expensive annotations only when they are informative, relying on the cheaper option otherwise. All of the annotations are then combined using statistically principled, unbiased methods to yield reliable, yet more cost-effective, performance metrics. Combining different data sources to improve evaluation quality is not new: in particular, the use of cheap but biased metrics as control variates to improve statistical efficiency in model evaluation has been explored before from various perspectives [ 1 ; 2 ; 4 ; 5 ; 6 ; 13 ; 19 ; 25 ; 32 ] . Here, our main technical contribution is a theoretical framework for cost-optimal active evaluations—evaluation algorithms that strategically choose when to deploy the strong rater as opposed to the weak rater in order to minimize the final total cost of evaluation while remaining unbiased. Informally, these policies solve the following constrained optimization problem: \displaystyle\mathop{\mathrm{maximize}}\quad Accuracy of the evaluation, (1) subject to \displaystyle\text{Cost of the evaluation remaining below a budget }B. (2) The policies that solve this optimization problem, as we will see, depend both on (i) the relative costs of the raters, and (ii) the error of the weak rater with respect to the strong one. We derive these optimal policies via new technical extensions and combinations of modern techniques in statistics, namely, active statistical inference [ 32 ] and prediction-powered inference [ 1 ; 2 ; 33 ] . Building on this foundation, we test and analyze empirical approximations to these optimal policies. Our experiments demonstrate promising results for implementing cost-optimal active evals in practice, although we also highlight important practical challenges that naturally arise due to "cold-start" issues, as well as imperfections of existing autorater models and their uncertainty estimates. Related work. Prediction-powered inference (PPI) [ 1 ; 2 ; 33 ] is the technique of combining a small number of trusted observations with predictions from a machine learning system for the purpose of statistical estimation. Its core statistical principles are closely related to control variate estimators [ 5 ; 23 ] as well as semi-parametric inference with missing data [ 7 ; 24 ; 27 ] . Recently, a body of work has explored applying PPI to the evaluation of GenAI systems, where human annotations are combined with "autorater" outputs [ 4 ; 6 ; 12 ; 13 ; 25 ] ; though it has also been noted that the sample efficiency gained is limited when the autorater is not sufficiently accurate [ 11 ; 26 ] . A natural extension of PPI is to actively select a fixed number of examples on which to obtain trusted observations, while deferring the remaining examples to the autorater [ 16 ; 32 ] . Roughly speaking, these approaches sample human annotations with probability proportional to the uncertainty of the autorater. However, they work only in a restricted setting in which the ratio of expensive to cheap ratings, n/N , is fixed in advance, and then pick the optimal policy subject to that constraint. No guidance is given as to what this ratio should be based on the relative costs of the ratings, or even what the total number of examples N should be. Contributions. Our work extends this literature both theoretically and empirically. Our core theoretical contribution is the derivation of error-minimizing sampling rules under cost constraints. That is, previous methods have a fixed ratio n/N and a policy that maximizes accuracy under that fixed ratio, while our policy maximizes accuracy subject to a cost constraint by optimizing everything including the ratio n/N . We derive two forms of optimal policies: (i) the best fixed sampling rate (Proposition 1 ), and (ii) the best active sampling rule that depends on covariates (Proposition 2 ). One additional novelty of our work is that it improves upon the policy proposed by Zrnic and Candès 2024 by accounting for the constraint that the policy must lie in [0,1] for all values of x . Finally, Appendix B includes further theoretical innovations, such as an extension to convex M-estimators and an optimal method for selecting the covariate x (as opposed to the label, as considered in the prior work). On the empirical end, we extend the scope of the standard PPI framework to heterogeneous model evaluation settings involving two distinct rating sources, each with a different cost-performance profile. This goes beyond the typical "human-vs-LLM" scenario described above, and encompasses any situation where less expensive, less accurate ratings are combined with more expensive, more accurate ones, even if both sources are automated (e.g., smaller vs. larger models or more vs. less inference-time reasoning). In Sections 3 and 4 , we present an extensive empirical investigation into the conditions under which these new sampling rules prove beneficial over classical estimation. Specifically, we identify that the success of our framework is

Read the complete text