The Capability Frontier: Benchmarks Miss 82% of Model Performance

Bradley Fowler, Ryan Smith, Daniel Thi Graviet, William Myers, Joshua Greaves, Narmeen Fatimah Oozeer, Antía García, Philip Quirke, Amirali Abdullah, Fazl Barez, Shriyash Kaustubh Upadhyay Martian University of Oxford ThoughtWorks · 2026

Read The Capability Frontier: Benchmarks Miss 82% of Model Performance by Bradley Fowler, Ryan Smith, Daniel Thi Graviet, William Myers, Joshua Greaves, Narmeen Fatimah Oozeer, Antía García, Philip Quirke, Amirali Abdullah, Fazl Barez, Shriyash Kaustubh Upadhyay Martian University of Oxford ThoughtWorks (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26836.txt.

Introduction

Bradley Fowler and ten colleagues argue that standard benchmarks badly understate what language models can do. A benchmark usually reports one model's score on one run. Real use is different: different models ace different questions, and a user with a budget can sample several answers and keep the best. The authors define the Capability Frontier, the best achievable score at each cost under ideal selection across models and tries.

Their construction corrects two biases at once. Single-model scoring underrates the field. Taking raw maxima over noisy samples overrates it. Twenty-one models were studied across sixteen benchmarks covering coding, reasoning, medicine, and agent tasks. Correcting for single-model testing cut the error rate by over half. The title's claim follows: single-run benchmarks miss most of the performance actually available.

Catalog record

CREATORBradley Fowler, Ryan Smith, Daniel Thi Graviet, William Myers, Joshua Greaves, Narmeen Fatimah Oozeer, Antía García, Philip Quirke, Amirali Abdullah, Fazl Barez, Shriyash Kaustubh Upadhyay Martian University of Oxford ThoughtWorks
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.26836

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Capability Frontier: Benchmarks Miss 82% of Model Performance Bradley Fowler, Ryan Smith, Daniel Thi Graviet, William Myers, Joshua Greaves, Narmeen Fatimah Oozeer, Antía García, Philip Quirke, Amirali Abdullah, Fazl Barez, Shriyash Kaustubh Upadhyay Martian University of Oxford ThoughtWorks Abstract Existing benchmarks typically report accuracy for a single model on a single run. This systematically understates real-world LLM capabilities, particularly under heterogeneous data distributions: (i) different models get different questions correct according to their specializations, and (ii) given a budget, multiple generations can be sampled and selectively retained. To quantify this gap, we introduce the Capability Frontier : a Pareto frontier over a set of models that characterizes the best achievable performance at each cost level under optimal selection across models and generations (i.e., via an oracle). Our construction corrects for two opposing biases: underestimation from single-model evaluation and overestimation from taking maxima over noisy samples. We study 21 LLMs across 16 widely used benchmarks spanning coding, reasoning, medicine, factuality, instruction following, and agentic tasks, comparing Capability Frontier performance at matched cost to each benchmark’s top-performing model. Correcting for single-model evaluation yields a 54% error rate reduction; additionally correcting for single runs yields an 82% improvement, with SOTA accuracy matched at 85% cost reduction. Complementing these empirical results, we use controlled probabilistic simulations to show that higher query topic entropy produces a near-monotonic increase in the performance gap between oracle routing and the best single model. Our findings suggest collective LLM capabilities are substantially underestimated, with implications for evaluation and deployment in data-heterogeneous, multi-domain settings. 1 Introduction LLMs in the wild face messy and disparate workloads. Consider the example of medical question answering systems, where life-and-death queries form a polyphonic mixture spanning diverse subdomains of medical knowledge such as genomic variation, and human structural physiology. Consistent with this heterogeneity, 33 show that models excel in different medical topics: GPT-4-base ( 1 ) outperforms Med-PaLM-2 ( 33 ) on MMLU Medical Genetics (97.0% vs. 92.0%) and Anatomy (85.2% vs. 84.4%), while Med-PaLM-2 excels on Professional Medicine (95.2% vs. 93.8%) and College Medicine (83.2% vs. 80.9%). An oracle selector with access to per-query ground-truth correctness could therefore outperform both models, yet this achievable performance remains unmeasured in standard evaluation. Foundational work on LLM routing has begun to probe this gap. 32 showed that an oracle router can achieve approximately 20% performance gains by switching models per prompt. RouterBench ( 13 ) quantified model complementarity, finding that secondary models provide unique correct answers on 10–30% of prompts. RouteLLM ( 25 ) further demonstrated up to 2 \times cost reductions by identifying prompts where cheaper models suffice. These studies estimate oracle performance from finite samples of generations per prompt, selecting the highest-performing model accordingly. Because oracle selection takes a maximum over noisy performance estimates, such procedures are positively biased, systematically overstating achievable gains. This effect is amplified under realistic generation budgets, where only limited samples ( G\leq 10 ) are available. Figure 1: The Capability Frontier: Dynamic per-prompt LLM selection substantially outperforms any fixed LLM across our 16 benchmarks. Sample datapoints from App. B are shown. For any given cost budget, substantial quality improvements can be realized relative to a single LLM. Conversely, for a fixed quality threshold substantial cost savings can be realized through dynamic LLM selection. To robustify Capability Frontier estimation and correct for these finite-sample effects, we develop debiasing methods that recover accurate frontier measurements and provide principled upper bounds on achievable performance. Our empirical analysis spans 21 LLMs across 16 benchmarks covering coding, reasoning, medicine, factuality, instruction following, and agentic tasks. The results reveal that standard single-model evaluation substantially understates achievable performance: at matched cost, the Capability Frontier achieves 54% average error reduction compared to each benchmark’s top model. When additionally accounting for multi-run selection (posthoc routing), error reduction reaches 82%. Conversely, SOTA accuracy can be matched at 85% lower cost on the frontier. These gaps are not merely theoretical - they represent performance that is achievable today with existing models and straightforward inference-time strategies. Accurately measuring these gains requires care. The standard oracle computation selects the model with the highest sample mean for each prompt, then reports this mean as achievable performance. Because this takes a maximum over noisy estimates, it preferentially captures positive outliers. With limited generations per prompt ( G\leq 10 due to cost), this bias is substantial: we find it inflates accuracy estimates by up to 8.7% and cost estimates by up to 88% (Sec. 6.3 ). Our debiasing methods - namely extrapolation-based correction and probabilistic graphical modeling— enable accurate frontier estimation. Complementing these empirical findings, we construct controlled probabilistic simulations showing that oracle gains scale monotonically with workload diversity. To highlight our main contributions: 1. Capability Frontier. We introduce a rigorous framework for quantifying the gap between single-model benchmark evaluation and achievable system-level performance under optimal model and generation selection. 2. Debiasing methods. We show that finite-sample oracle estimators are positively biased and propose correction methods based on extrapolation and probabilistic modeling, with explicit assumptions and empirical validation. 3. Bias characterization. We formally analyze oracle bias, showing it decays as O(G^{-\lambda}) with generations per prompt, and empirically validate this scaling across benchmarks. 4. Empirical evaluation. Across 21 LLMs and 16 benchmarks, we quantify both achievable frontier gains and the magnitude of bias in naive oracle estimates. See Figure 1 . 5. Controlled simulations. When simulating synthetic workloads spanning low to high-diversity regimes, we find that oracle gains grow monotonically with workload entropy. These results provide mechanistic grounding for oracle performance, demonstrating that achievable gains are fundamentally driven by data heterogeneity. 2 Related Work The rapid proliferation of LLMs has increased research interest in LLM routing, the dynamic selection of models to balance quality, cost, and latency. 32 first formalized this problem using benchmark datasets, introducing the oracle router as a theoretical upper bound for performance gains. While they identified significant headroom beyond the “best-on-average” model, their oracle relied on biased sample means, a limitation our work addresses. Subsequent frameworks like RouterBench ( 13 ) have standardized evaluation across routing methods, though they similarly utilize these biased estimates. Universal and Zero-Shot Routing Recent methods seek to solve the “model lock-in” problem, where routers must be retrained whenever the model pool changes. UniRoute ( 17 ) addresses this by representing LLMs as feature vectors based on anchor prompts, allowing for generalization to unseen models. Similarly, ZeroRouter ( 39 ) utilizes a universal latent space to decouple query difficulty from specific model profiles, enabling zero-shot selection across evolving model ecosystems. Theoretical Foundations While the industry moves toward expert orchestration for safer and more capable systems ( 28 ) , a gap remains between implementable routers and theoretical optimality. Our work builds upon the foundations of oracle routing ( 32 ; 13 ) , but departs from them by correcting for the “optimizer’s curse”—a statistical bias well-documented in economics ( 3 ; 6 ) and decision analysis ( 34 ) . By introducing debiased oracles, we provide a more rigorous framework for quantifying the true headroom available in the Capability Frontier. See Appendix D for more routing methods, including training-free, cascades and preference routing. 3 Problem Setting Let n\in[N] index dataset prompts, l\in[L] index LLMs, and g\in[G] index independent

Read the complete text