Responsible Agentic AI Requires Explicit Provenance

Jinwei Hu, Xinmiao Huang, Qisong He, Youcheng Sun, Yi Dong, Xiaowei Huang · 2026

Read Responsible Agentic AI Requires Explicit Provenance by Jinwei Hu, Xinmiao Huang, Qisong He, Youcheng Sun, Yi Dong, Xiaowei Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17169.txt.

Introduction

Hu and colleagues argue that responsible agentic AI needs explicit provenance. That means a traceable record across an agent system's whole life, so blame can be assigned when harm comes from combinations no single party designed. They formalize what such provenance must encode and show it can be estimated and acted on during operation. A concrete incident then shows who answers for what.

Catalog record

CREATORJinwei Hu, Xinmiao Huang, Qisong He, Youcheng Sun, Yi Dong, Xiaowei Huang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49553
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17169

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Responsible Agentic AI Requires Explicit Provenance Jinwei Hu, Xinmiao Huang, Qisong He, Youcheng Sun, Yi Dong, Xiaowei Huang Abstract Agentic AI is rapidly proliferating across diverse real-world domains such as software engineering, yet public trust has not kept pace. The central reason is that responsibility, despite being widely discussed, remains a subjective and unenforced concept, as no current agentic framework produces the quantifiable, traceable, and interventionable provenance needed to assign it when harm emerges from compositions no single party designed. We position that what is missing is not better benchmark-level evaluation but explicit provenance across the full agentic lifecycle, which is the only viable basis for making responsibility computable and actionable. We advance this agenda along four axes: establishing why such provenance is a structural necessity by identifying responsibility gaps across sociotechnical dimensions, formalizing what it must encode through a causal attribution function and responsibility tensor, discussing how it can be made computable across four lifecycle layers with preliminary experiments showing that provenance is estimable and interveneable online before irreversible harm accumulates, and examining who bears responsibility through a concrete agentic incident. Explicit provenance is not a discretionary refinement but the necessary condition for responsible agentic AI, and no stakeholder across its ecosystem can afford to treat it as optional. 1 Introduction Figure 1 : Per-component trustworthy AI audits components in isolation ( 1 ), but agentic AI embeds them in long-horizon action loops that produce emergent harms, unanticipated compositional consequences, and diffused responsibility ( 2 ). Closing this gap requires explicit provenance across the full lifecycle of responsible agentic AI and we demonstrate it via four axes ( 3 ). Artificial intelligence (AI) has recently undergone three transitions in the scope of its action. Early AI systems were largely reactive: inputs in, outputs out. A second generation, grounded in large language models (LLMs) ( 9 ; 1 ; 61 ) , shifted the focus from prediction to open-ended text generation. A third transition is now underway: agentic AI , in which models are embedded in autonomous action loops, equipped with tools and persistent memory, integrated into multi-agent pipelines, and granted authority to plan, execute, and revise decisions over extended horizons ( 65 ; 70 ; 31 ) . This transition changes the object of concern: an agentic system does not merely answer questions, but acts in the real world by booking flights, executing code, sending emails, and coordinating with other autonomous systems, often with little or no human intervention ( 51 ; 25 ; 69 ; 28 ; 35 ) . Yet despite this rapid proliferation, enterprise surveys report that real-world adoption remains far below the pace of development and organizations scale capability faster than they are willing to delegate authority ( 41 ; 15 ) . The practical consequence is an adoption bottleneck rooted in a trust deficit. Users, organizations, and regulators hesitate to grant consequential authority to systems whose actions leave no traceable record of how decisions were reached, by whom, and through which causal chain. This is not irrational caution but a predictable response to structural unaccountability: when harm occurs, each party points to another and responsibility dissolves before it can be assigned. Responsibility has been widely discussed in the trustworthy AI literature ( 37 ; 34 ) , yet it has never been made computable or actionable across the full agentic lifecycle, not for lack of normative vocabulary but for lack of the explicit provenance. Consider a case where individually audited skills each pass safety review, yet their composition within an LLM-based agent produces regulatory violations that no per-skill audit could have detected: no party can be held accountable precisely because no responsibility envelope was specified before deployment to bound each party’s obligations, and no record exists of how the harmful trajectory was jointly produced. This failure is not incidental but structural, as harm in agentic systems does not reside in any single component but emerges from system-level trajectories, compositions, and distributed causal chains that no individual audit can inspect ( 10 ) . Existing records are designed around per-component failures and therefore remain too coarse to support causal responsibility attribution or its traceability across parties, and their post-hoc nature means that intervention cannot be mounted until after harm has already occurred ( 45 ) . We therefore position that responsible agentic AI must be quantifiable, traceable and interventionable across the full lifecycle, and that explicit provenance is the necessary infrastructure for making the responsibility computable and actionable. Without it, responsibility remains an subjective concept that cannot be assigned, or enforced, and benchmark-driven evaluation, while necessary for component-level capability, neither reaches compositional behavior nor produces the causal attribution that the responsibility requires. This paper therefore advances a provenance-grounded agenda for computable and actionable responsibility in agentic AI along four axes. We first establish why explicit provenance is a structural necessity rather than a discretionary refinement, identifying socio-technical responsibility gaps (Section 3 ). We then formalize what provenance must encode in agentic contexts through a causal attribution function and an responsibility tensor (Section 4 ). We address how responsibility can be made computable across four lifecycle layers, validated through preliminary experiments showing that causal contribution is estimable online before irreversible harm accumulates (Section 5 ). Finally, we examine who bears responsibility by applying the responsibility tensor to a concrete agentic incident, demonstrating how provenance distributes obligations (Section 6 ). 2 Background Agentic AI now appears across diverse domains, from software automation to professional decision support ( 72 ; 58 ; 78 ; 27 ; 71 ) . Thus, we adopt a general functional definition centered on the capabilities that make these systems consequential. Definition 2.1 (Agentic AI System) . An agentic AI system situates one or more LLM-based agents within a perception-action loop with (i) tool access , (ii) persistent memory , (iii) multi-step planning , and (iv) self-correction , optionally coordinating with other agents. Agentic adoption is outpacing responsibility structures. Frontier providers are productizing agents that use tools, operate computers, and complete multi-step tasks, while open ecosystems such as OpenClaw and ClawHub illustrate the emergence of third-party skill marketplaces where agents can be extended with externally authored capabilities ( 47 ; 48 ; 5 ; 50 ; 49 ) . Enterprise surveys confirm that adoption is already at scale: McKinsey reports that 23% of respondents are scaling agentic AI systems and another 39% experimenting, and PwC reports that 79% of senior executives say AI agents are already being adopted in their companies ( 40 ; 54 ) . Yet responsibility structures remain less mature, with McKinsey identifying persistent gaps in governance and risk management and Deloitte characterizing agentic AI as scaling faster than its guardrails ( 41 ; 15 ) . Agentic AI is therefore not merely a capability frontier but a responsibility frontier. Relation to trustworthy AI and adjacent work. The trustworthy AI paradigm has organized safety around model-level properties, benchmark evaluation, and red-teaming ( 36 ; 20 ; 60 ) , but agentic deployment exposes three structural limitations. Risks is compositional : properties verified for individual components need not survive their interaction ( 35 ) . Evaluation is fragile : task completion can diverge from safety, policy compliance, and harmfulness control ( 3

Read the complete text