A Framework for Cryptographic Verifiability of End-to-End AI Pipelines

Kar Balan, Robert Learney, Tim Wood · 2025

Read A Framework for Cryptographic Verifiability of End-to-End AI Pipelines by Kar Balan, Robert Learney, Tim Wood (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22573.txt.

Introduction

Kar Balan, Robert Learney, and Tim Wood propose a framework for proving, with cryptography, that an AI system was built and run as claimed. As AI spreads into regulated industries, calls grow for safety laws that demand transparency and audit trails. Their framework covers the whole pipeline, from sourcing data through training and inference to unlearning, and sorts the existing cryptographic tools that can vouch for each stage. Proofs attached to AI outputs could let others check where content came from and whether it was made correctly.

The catch is linkage: tools that verify one stage in isolation exist, but chaining proofs across stages efficiently is the open problem. The authors argue research should aim at linkable tools, not just faster single steps. The paper is a map and agenda, meant to guide builders and regulators toward AI that can show its work.

Catalog record

CREATORKar Balan, Robert Learney, Tim Wood
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22573

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Framework for Cryptographic Verifiability of End-to-End AI Pipelines Kar Balan, Robert Learney, Tim Wood Abstract . The increasing integration of Artificial Intelligence across multiple industry sectors necessitates robust mechanisms for ensuring transparency, trust, and auditability of its development and deployment. This topic is particularly important in light of recent calls in various jurisdictions to introduce regulation and legislation on AI safety. In this paper, we propose a framework for complete verifiable AI pipelines, identifying key components and analyzing existing cryptographic approaches that contribute to verifiability across different stages of the AI lifecycle, from data sourcing to training, inference, and unlearning. This framework could be used to combat misinformation by providing cryptographic proofs alongside AI-generated assets to allow downstream verification of their provenance and correctness. Our findings underscore the importance of ongoing research to develop cryptographic tools that are not only efficient for isolated AI processes, but that are efficiently ‘linkable’ across different processes within the AI pipeline, to support the development of end-to-end verifiable AI technologies. DOI: XXXXXXX.XXXXXXX Conference: 11th ACM International Workshop on Security and Privacy Analytics; June 6, 2025; Pittsburgh, PA, USA ISBN: 978-1-4503-XXXX-X/18/06 CCS: Social and professional topics Technology audits CCS: Computing methodologies Multi-agent systems CCS: Theory of computation Data provenance CCS: Computing methodologies Artificial intelligence CCS: Security and privacy Social aspects of security and privacy CCS: Security and privacy Cryptography Figure 1. Framework for end-to-end verifiable AI pipelines: top-row icons represent Zero-Knowledge Proofs for process integrity; bottom-row icons represent Cryptographic Commitments to data objects. Solid/dashed arrows indicate data/model inputs & outputs of ZKPs, respectively. 1. Introduction The rapid adoption of Artificial Intelligence (AI) across diverse sectors has raised significant concerns around the transparency, trust, and auditability of such systems. As AI models become increasingly embedded in critical decision-making, the inability to verify the authenticity, provenance, and operational behaviour of these models poses critical challenges. The increasing use of AI value chains—where data, models, and results are exchanged across various stakeholders ( Lüthi et al., 2020 ) —creates a need for robust mechanisms and pipelines that ensure trust through verifiability. A key scenario illustrating these challenges is that of outsourced model training, where it is important to verify that models are trained using the specified parameters, processes, and datasets ( Dong et al., 2021 ) . Another challenge arises when different versions of a model are served via opaque APIs: users have no means to verify which model is being served, and may be using one that is cheaper for the server to run rather than the one they paid for ( Weng et al., 2021 ) . It may not be immediately easy to distinguish between model versions: model quality (e.g. accuracy) may be hard to detect manually. These challenges are becoming increasingly relevant in the present context of evolving regulatory initiatives, most notably the European Union’s AI Act ( Parliament and Council, 2024 ) , which demands increased transparency and auditability of AI systems, as well as guarantees related to model performance ( South et al., 2024 ) . These regulations often mandate third-party audits and the comprehensive review of technical documentation. At the same time, the AI industry is focused on safeguarding the privacy of their models and sensitive data. This trade-off between regulatory demands for openness and the industry’s desire for privacy motivates developing technical solutions to enable trustless audits and verifiability of AI systems without compromising the privacy of underlying data, processes and models ( Waiwitlikhit et al., 2024 ) . Cryptographic verifiability offers a high level of automatable assurance and provides a way to achieve strong guarantees of the correctness and integrity of various aspects of AI verifiability: • Digital signatures and cryptographic commitments are used in the C2PA framework (discussed in § 2.2.2 ) to provide assurance of media provenance. Cryptographic key material can be held in tamper-proof hardware (e.g. chips within digital cameras) to increase the confidence that a signed image was produced by a particular hardware device. • Zero-knowledge proofs (ZKPs) in various forms allow proving various model properties, including correctness of model training, data provenance and integrity, or execution of model inference, to third parties without revealing inputs they may wish to keep private (such as model weights). • Federated Learning (FL) allows models to be trained without individual entities revealing their data to a third party. This was notably used by Google to improve autocorrect on Android keyboards while maintaining privacy of individual user inputs ( McMahan and Ramage, 2017 ) . The potential for an end-to-end verifiable AI pipeline is only possible through recent advancements in cryptography and verifiable computation due to the high computational complexity of AI training and inference. However, as yet, there are no implementations of this fully verifiable pipeline, although work towards this goal has begun, e.g. ( Waiwitlikhit et al., 2024 ) . In this paper, we propose a framework for achieving end-to-end verifiability in AI pipelines. Specifically, we provide the following contributions: (1) A framework for end-to-end verifiable AI pipelines (§ 4 ): We introduce and outline a framework for verifiability across the AI pipeline, defining the key components required. We review existing solutions and techniques for verifiabality in different parts the AI pipeline—from data provenance and model training, to model evaluation and machine unlearning, and map these approaches onto our framework. (2) Gap analysis (§ 5 ): We conduct an analysis to identify the gaps and challenges in achieving full end-to-end verifiability within the AI pipeline. Building on the mapping of existing techniques to our framework, we also propose (at a high level) a generic method for connecting parts of the pipeline together and highlight critical areas where current techniques fall short of achieving full end-to-end verifiability. We hope that our framework, review of current solutions, and gap analysis motivate further research to develop the necessary tools and technologies to secure the entire AI pipeline. 2. Preliminaries In this section we give an overview of the cryptographic tools used for AI pipeline verification, which form the technical basis for many of the components in our proposed framework. We also discuss existing methodologies for using these tools in a standardised way. 2.1. Cryptographic Tools Most cryptographic protocols discussed in this paper involve the use of many cryptographic primitives. In this subsection, we describe three fundamental primitives: digital signatures, cryptographic commitments, and Zero-Knowledge Proofs (ZKPs). We refer the reader to the literature for technical definitions. 2.1.1. Digital signatures Digital signatures are ubiquitous in digital infrastructure, notably in X.509 certificates. They are used to ensure data is from an authentic source and has not been tampered with in transit ( Rabin, 1979 ) . There are many security definitions for digital signature schemes. A common security goal is Existential Unforgeability under Chosen Message Attack (EUF-CMA): given a number of message/signature pairs for a fixed public key, it should be computationally infeasible for an adversary to construct a signature for a new message that verifies correctly. 2.1.2. Cryptographic Commitments A cryptographic commitment scheme is a mechanism for ‘committing’ to a message (e.g. a statement or dataset) without revealing it. A party will create a cryptographic commitment to send to another party, or to post publicly, so that they can ‘open’ it

Read the complete text