The Measurement Imbalance in Agentic AI Evaluation Undermines Industry Productivity Claims

Kiana Jafari Meimandi Stanford UniversityGabriela Aránguiz-DiasStanford UniversityGrace Ra Kim Stanford University, Lana Saadeddin Montclair State UniversityMykel J. KochenderferStanford University · 2025

Read The Measurement Imbalance in Agentic AI Evaluation Undermines Industry Productivity Claims by Kiana Jafari Meimandi Stanford UniversityGabriela Aránguiz-DiasStanford UniversityGrace Ra Kim Stanford University, Lana Saadeddin Montclair State UniversityMykel J. KochenderferStanford University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02064.txt.

Introduction

Researchers at Stanford and partner schools wrote this 2025 paper questioning the big productivity claims made for agentic AI. Industry reports credit such systems with double-digit gains and trillions of dollars of value. Those claims drive investment, policy, and adoption choices, so the authors ask how well they are measured.

The team reviewed 84 papers from 2023 to 2025 on how agentic systems are evaluated. They found a sharp imbalance. Technical metrics ruled the tests, appearing in 83 percent of papers. Human-centered checks appeared in only 30 percent, safety checks in 53 percent, and economic checks in 30 percent. Just 15 percent of papers joined technical and human measures at all. The authors argue that this gap breaks the link between benchmark wins and real value at work. Strong scores, on this evidence, do not prove the gains that firms advertise.

Catalog record

CREATORKiana Jafari Meimandi Stanford UniversityGabriela Aránguiz-DiasStanford UniversityGrace Ra Kim Stanford University, Lana Saadeddin Montclair State UniversityMykel J. KochenderferStanford University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-02064

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Measurement Imbalance in Agentic AI Evaluation Undermines Industry Productivity Claims Kiana Jafari Meimandi Stanford UniversityGabriela Aránguiz-DiasStanford UniversityGrace Ra Kim Stanford University, Lana Saadeddin Montclair State UniversityMykel J. KochenderferStanford University Abstract As industry reports claim agentic AI systems deliver double-digit productivity gains and multi-trillion dollar economic potential, the validity of these claims has become critical for investment decisions, regulatory policy, and responsible technology adoption. However, this paper demonstrates that current evaluation practices for agentic AI systems exhibit a systemic imbalance that calls into question prevailing industry productivity claims. Our systematic review of 84 papers (2023–2025) reveals an evaluation imbalance where technical metrics dominate assessments (83%), while human-centered (30%), safety (53%), and economic assessments (30%) remain peripheral, with only 15% incorporating both technical and human dimensions. This measurement gap creates a fundamental disconnect between benchmark success and deployment value. We present evidence from healthcare, finance, and retail sectors where systems excelling on technical metrics failed in real-world implementation due to unmeasured human, temporal, and contextual factors. Our position is not against agentic AI’s potential, but rather that current evaluation frameworks systematically privilege narrow technical metrics while neglecting dimensions critical to real-world success. We propose a balanced four-axis evaluation model and call on the community to lead this paradigm shift because benchmark-driven optimization shapes what we build. By redefining evaluation practices, we can better align industry claims with deployment realities and ensure responsible scaling of agentic systems in high-stakes domains. 1 Introduction Agentic AI systems are characterized by: (1) goal-directed behavior with the ability to decompose complex objectives into manageable subtasks gabriel_advancing_2024 ; (2) environmental awareness and adaptability to changing conditions clatterbuck_risk_2024 ; (3) tool utilization, where agents strategically leverage external resources to accomplish tasks agashe_agent_2024 ; and (4) autonomous decision-making with limited human intervention rostcheck_elephant_2024 . These systems are rapidly moving from research labs to critical real-world deployments, yet our evaluation frameworks remain noticeably imbalanced. We define measurement imbalance as the systematic bias in evaluation frameworks that privilege easily quantifiable technical metrics while neglect dimensions critical to real-world deployment success; especially human-centered factors, temporal stability, and contextual fit. This imbalance creates a fundamental misalignment between what we measure and what determines system value. For instance, healthcare diagnostic agents achieving 95% benchmark accuracy have been relegated to limited advisory roles post-deployment due to unmeasured trust and workflow integration issues heaven2021ai . In 2024, agentic AI systems were deployed across sectors such as: clinical triage arslan2025evaluating ; cao2024ai , automated trading yu2024finmem ; xiao2024tradingagents , customer service emarketer2025aiagents ; rome2024ask , and internal software debugging github2024copilotworkspace ; roman2024harmony . Firms report double-digit productivity gains from these deployments, citing speed, cost savings, and increased decision accuracy mckinsey2023genai . These claims are bolstered by benchmark results showcasing near-human or superhuman performance on standard tasks huang_mlagentbench_2024 ; bogin_super_2024 . Benchmarks have long driven progress in machine learning, from ImageNet deng2009imagenet to GLUE wang2018glue and HELM lee2023holistic . In the agentic AI space, MLAgentBench huang_mlagentbench_2024 , ML-Bench tang_ml-bench_2024 , and SUPER bogin_super_2024 evaluate task success, efficiency, and end-to-end execution using predefined scripts or repository-grounded tasks. PlanBench valmeekam_planbench_nodate introduces symbolic validation for plan structure, while VisualWebArena koh_visualwebarena_2024 focuses on multimodal agents in web environments. These frameworks provide critical infrastructure for measuring technical competence but rarely assess how agents integrate into human workflows or operate over time. Meanwhile, HCI and social computing scholars have long emphasized trust, usability, and alignment as critical success factors in AI deployment sundar_rise_2020 ; mitelut_intent-aligned_2023 . Recent agentic AI work includes TrAAIT stevens_theory_2023 , a validated instrument for clinician trust in AI systems; moshkovich2025beyond highlights transparency and observability needs; deng_towards_2024 , propose a multi-axis framework for agent intelligence, adaptivity, and civility. However, these human-centered approaches remain fragmented with limited integration into standard benchmarks or industry practice. This disconnect between technical and sociotechnical evaluation is confirmed by our systematic review of 84 academic and industry papers from 2023–2025. Among these works, technical performance was strongly represented (83%), while human-centered evaluation appeared in 30%, and both in only 15%. Despite the widespread enthusiasm and rapid adoption, we currently lack the multidimensional evaluation tools required to validate the productivity and efficiency claims. Technical metrics, while necessary, capture only a narrow slice of what determines success in real-world deployments. As agentic systems gain more autonomy and become embedded in organizational workflows, this measurement imbalance threatens to create a new wave of mismatched expectations, misallocated resources, and poorly understood risks. We argue that the prevailing evaluation frameworks for agentic AI are largely incomplete, systematically privileging technical performance metrics while underrepresenting critical dimensions such as human-centered interaction, longitudinal behavior, safety, and contextual fit. As a result, the industry’s current productivity claims are premature and, in many cases, can be misleading. We do not argue against the value of agentic systems, nor do we dispute their emerging capabilities. Instead, we focus on the instruments of validation ; the metrics, benchmarks, and evaluation practices that translate system behavior into evidence. Our central claim is that these instruments are misaligned with deployment reality, and that evaluation itself must evolve if we are to responsibly scale agentic AI in high-stakes domains. Benchmark-driven optimization has long been the engine of ML progress, but when benchmarks miss key dimensions of impact, they also drive blind spots. What we measure shapes what we build. As venues for foundational work in LLMs, agent architectures, and evaluation benchmarks, leading AI conferences are well-positioned to catalyze this needed shift toward more comprehensive evaluation practices This paper takes a position grounded in both empirical evidence and practical urgency, offering the following contributions: (1) A quantitative diagnosis of the current imbalance. Our meta-analysis of 84 publications quantifies the overrepresentation of technical metrics in both academic and industry evaluations. (2) Illustrating deployment consequences with real-world examples. We document how overreliance on narrow evaluation metrics led to adoption failure or unexpected business losses in healthcare, financial services, and retail deployments. (3) A new theoretical framework for balanced evaluation. We introduce a four-axis model; technical, human, temporal, and contextual, and propose a formal structure for integrating multiple metric classes across domains. (4) Anticipation and rebuttal of key counterarguments. We address recurring counterarguments including: that human-centered metrics are too subjective; that safety and governance belong to regulators, not ML researchers and thus our of scope; that adding more metrics slows interaction and stifles innovation; that one size cannot fit all domains, and universal frameworks are inherently vague. (5) Actionable recommendations for researchers, industry, and policymakers. We offer a roadmap for closing the measurement gap through benchmark design, instrument development, deployment best practices, and regulatory levers. By grounding what we count as evidence, this paper aims to reset the conversation on agentic AI efficiency, not to constrain innovation, but to ensure that the claims we make reflect the systems we actually build (see Section A.4 for formal definitions). 2 Why Evaluation Matters Unlike classical predictive models, Agentic AI value hinges on sustained interaction with people, data sources, and other agents across time and domains. As these systems rapidly transition from research to deployment in various sectors such as healthcare, finance, and retail, the gap between how we evaluate them and how they actually create value becomes critical. MLAgentBench huang_mlagentbench_2024 is an example of today’s technical focus: agents

Read the complete text