Beyond Benchmark Islands: Toward Representative Trustworthiness Evaluation for Agentic AI DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 9–13, 2026; Jeju, Republic of Korea ISBN: 978-1-4503-XXXX-X/2026/08 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing CCS: Security and privacy Systems security
Jinhu Qi, Yifan Li, Minghao Zhao, Wentao Zhang, Zijian Zhang, Yaoman Li, Irwin King · 2026
Read Beyond Benchmark Islands: Toward Representative Trustworthiness Evaluation for Agentic AI DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 9–13, 2026; Jeju, Republic of Korea ISBN: 978-1-4503-XXXX-X/2026/08 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing CCS: Security and privacy Systems security by Jinhu Qi, Yifan Li, Minghao Zhao, Wentao Zhang, Zijian Zhang, Yaoman Li, Irwin King (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14987.txt.
Introduction
Qi and co-authors define agent trustworthiness as a five-part profile and grade it with HAAF. Agentic systems act through tools in multi-step flows with real stakes. Trust talk stays vague while benchmarks stay fragmented. Their profile names reliability, robustness, safety, social-ethical alignment and operational integrity. HAAF scores that profile over a manifold of scenarios. Policy review, sandbox runs and distribution-aware sampling feed the grade. A factory loop turns red-team findings into blue-team fixes. Deployment risk gets a shared yardstick.
Catalog record
| CREATOR | Jinhu Qi, Yifan Li, Minghao Zhao, Wentao Zhang, Zijian Zhang, Yaoman Li, Irwin King |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29767 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.14987
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Benchmark Islands: Toward Representative Trustworthiness Evaluation for Agentic AI DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 9–13, 2026; Jeju, Republic of Korea ISBN: 978-1-4503-XXXX-X/2026/08 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing CCS: Security and privacy Systems security Jinhu Qi, Yifan Li, Minghao Zhao, Wentao Zhang, Zijian Zhang, Yaoman Li, Irwin King Abstract . As agentic AI systems move beyond static question answering into open-ended, tool-augmented, and multi-step real-world workflows, their increased authority poses greater risks of system misuse and operational failures. However, current evaluation practices remain fragmented, measuring isolated capabilities such as coding, hallucination, jailbreak resistance, or tool use in narrowly defined settings. We argue that the central limitation is not merely insufficient coverage of evaluation dimensions, but the lack of a principled notion of representativeness : an agent’s trustworthiness should be assessed over a representative socio-technical scenario distribution rather than a collection of disconnected benchmark instances. To this end, we propose the Holographic Agent Assessment Framework (HAAF) , a systematic evaluation paradigm that characterizes agent trustworthiness over a scenario manifold spanning task types, tool interfaces, interaction dynamics, social contexts, and risk levels. The framework integrates four complementary components: (i) static cognitive and policy analysis , (ii) interactive sandbox simulation , (iii) social-ethical alignment assessment , and (iv) a distribution-aware representative sampling engine that jointly optimizes coverage and risk sensitivity—particularly for rare but high-consequence tail risks that conventional benchmarks systematically overlook. These components are connected through an iterative Trustworthy Optimization Factory . Through cycles of red-team probing and blue-team hardening, this paradigm progressively narrows the vulnerabilities to meet deployment standards, shifting agent evaluation from benchmark islands toward representative, real-world trustworthiness. Code and data for the illustrative instantiation are available at https://github.com/TonyQJH/haaf-pilot . 1. Introduction Agentic AI systems are rapidly evolving from passive question-answering assistants into autonomous decision-makers that plan, call tools and act in open-ended environments ( 15 ; 3 ; 20 ) . As these systems become embedded in real-world workflows, their failures are no longer limited to incorrect answers on static tasks. Instead, they may exhibit goal drift, unsafe tool use, resource misuse, unauthorized actions, or socially harmful behavior in ways that directly affect downstream users and institutions. For instance, an AI coding agent recently deleted a live production database—erasing records for over a thousand users—while operating under an explicit code freeze, despite instructions requiring human approval before any changes ( 17 ) . As a result, trustworthiness in agentic AI must be understood not as a narrow model property, but as a deployment-level concern shaped by how agents behave under realistic environmental, operational, and social conditions. Despite this shift, current evaluation practices remain largely fragmented. Existing benchmarks often focus on isolated slices of agent behavior, such as task-solving ability ( 22 ) , coding performance ( 6 ) , hallucination ( 9 ) , jailbreak resistance ( 1 ) , or tool-use accuracy ( 10 ) . While these evaluations provide useful local signals, they are typically constructed around narrowly scoped tasks, controlled environments, and single failure modes ( 11 ; 7 ) . Consequently, high scores on existing benchmarks do not necessarily imply real-world reliability, robustness, or safety. We argue that the central limitation is not merely that current evaluations cover too few dimensions, but that they lack a principled notion of representativeness . Agent trustworthiness is not a point property that can be inferred from a handful of benchmark instances; rather, it is a distributional property that depends on how an agent behaves over a heterogeneous, heavy-tailed space of socio-technical scenarios. When the distribution of benchmark tasks is misaligned with the distribution of real deployment conditions, evaluation results can create a false sense of confidence ( 8 ; 19 ) . This problem is particularly severe for low-frequency but high-consequence events, including adversarial manipulations, cascading tool failures, and socially sensitive interactions, which are often absent from standard evaluation suites despite being central to trustworthy deployment. To address this gap, we propose the Holographic Agent Assessment Framework (HAAF) , a new evaluation paradigm for assessing the trustworthiness of agentic AI. Our key idea is to characterize trustworthiness over a scenario manifold that spans task types, tool interfaces, interaction dynamics, social contexts, and risk levels, rather than over disconnected benchmark islands. The framework centers on a distribution-aware representative sampling engine that defines what should be tested, while three complementary probing interfaces, i.e., static cognitive and policy analysis, interactive sandbox simulation, and social-ethical alignment assessment, define how agents should be evaluated. These components are connected through an iterative Trustworthy Optimization Factory : red-team probing exposes vulnerability surfaces, blue-team hardening designs targeted interventions, and re-evaluation verifies improvement, cycling until the deployed system meets deployment-readiness thresholds. Rather than evaluating model weights in isolation, we assess deployed agentic systems comprising the model, prompting policies, tool interfaces, guardrails, and oversight mechanisms. We illustrate this paradigm through coverage audit of existing benchmarks, vulnerability attribution experiments, and a cycle of the Trustworthy Optimization Factory. In summary, this paper makes the following three contributions: • We identify representativeness as the central missing principle in current agent trustworthiness evaluation, arguing that the primary challenge lies in distribution design rather than solely in metric design. • We propose HAAF, a unified framework for representative, multi-view evaluation over risk-sensitive scenario distributions. • We outline an iterative evaluation-hardening methodology and demonstrate its feasibility through a complete cycle. 2. Benchmark Fragmentation and the Representativeness Gap Current benchmark ecosystems have substantially advanced the evaluation of agentic systems by operationalizing important local notions of competence and safety ( 16 ) . Task-centric benchmarks such as AgentBench, WebArena, and SWE-bench evaluate interactive task completion and software engineering ( 12 ; 22 ; 6 ) ; HaluEval and JailbreakBench probe hallucination and adversarial robustness ( 9 ; 1 ) ; API-Bank tests tool-augmented behavior ( 10 ) ; and more recent suites—GAIA, WorkArena, OSWorld, \tau -bench, ToolSandbox, AgentDojo—extend coverage to general assistants, enterprise software, computer-use, and prompt-injection robustness ( 15 ; 3 ; 20 ; 21 ; 14 ; 2 ) . These benchmarks provide valuable signals, but each is tied to a particular evaluation slice. The problem is not that existing benchmarks are individually uninformative, but that they are collectively incomplete in ways that matter for deployment. First, many evaluations remain capability-isolated : they test coding, planning, hallucination, or safety as separate phenomena, even though real-world failures often emerge from their interaction within a single multi-step trajectory. Second, settings are frequently environment-simplified : tools are cleanly specified and interfaces are stable, whereas real deployments involve noisy observations, latency, partial observability, and cascading downstream effects. Third, most benchmarks are socially decontextualized : they abstract away delegation, manipulation, bias, and risk asymmetry. Even when combined, such benchmarks reveal whether an agent can succeed under one pressure at a time, but not whether it remains trustworthy when multiple pressures co-occur. These limitations motivate what we call the representativeness gap . Let \mathcal{S} denote the space of socio-technical scenarios relevant to agent deployment, P_{\mathrm{deploy}} the real deployment distribution over \mathcal{S} , and \mathbf{m}(a,s) a vector of trustworthiness measurements for agent a in scenario s . Deployment-level trustworthiness is then \mathbf{T}(a)=\mathbb{E}_{s\sim P_{\mathrm{deploy}}}[\mathbf{m}(a,s)] . Existing benchmarks estimate