Atlas: A Framework for ML Lifecycle Provenance & Transparency

Marcin Spoczynski, Marcela S. Melara, Sebastian Szyller · 2025

Read Atlas: A Framework for ML Lifecycle Provenance & Transparency by Marcin Spoczynski, Marcela S. Melara, Sebastian Szyller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-19567.txt.

Introduction

Marcin Spoczynski, Marcela Melara, and Sebastian Szyller present a frame that makes each step of a machine learning pipeline provable, in a 2025 arXiv paper. Open data and models spread fast, and with them the risks of poisoned data and supply chain attack. Rules now press vendors for clear records, yet secrets must stay shut.

Their frame, Atlas, borrows open specs from data and software chain proof. It gathers signed records of where each model piece came from and how it was changed. Trusted hardware and public logs guard the records, while locks keep data private and bar stray hands. A test build weds several open tools, and two case pipelines show the frame can run in real work.

Catalog record

CREATORMarcin Spoczynski, Marcela S. Melara, Sebastian Szyller
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-19567

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Atlas: A Framework for ML Lifecycle Provenance & Transparency Marcin Spoczynski, Marcela S. Melara, Sebastian Szyller Abstract The rapid adoption of open source machine learning (ML) datasets and models exposes today’s AI applications to critical risks like data poisoning and supply chain attacks across the ML lifecycle. With growing regulatory pressure to address these issues through greater transparency, ML model vendors face challenges balancing these requirements against confidentiality for data and intellectual property needs. We propose Atlas , a framework that enables fully attestable ML pipelines. Atlas leverages open specifications for data and software supply chain provenance to collect verifiable records of model artifact authenticity and end-to-end lineage metadata. Atlas combines trusted hardware and transparency logs to enhance metadata integrity, preserve data confidentiality, and limit unauthorized access during ML pipeline operations, from training through deployment. Our prototype implementation of Atlas integrates several open-source tools to build an ML lifecycle transparency system, and assess the practicality of Atlas through two case study ML pipelines. I Introduction In recent years, machine learning (ML) models, have become increasingly popular. The pervasive use of large language models (LLMs), in particular, and multi-stakeholder involvement in model creation and deployment exacerbate security and privacy risks. These considerations are emphasized by the global nature and the complexity of large-scale ML deployments with different lifecycle stages: 1) Collection and sanitation of a training dataset from several public and proprietary sources. 2) Provisioning of the training environment (hardware and software). 3) Execution of training across many data centers. 4) Construction of a testing dataset from several sources, and the evaluation. 5) Deployment and use of the model for inference that is compliant with local laws or corporate policies. Each of these stages is vulnerable to malicious or dishonest parties. For example, data can be poisoned [ 1 , 2 ] during collection or training. Service providers executing outsourced training can shorten or omit critical steps to reduce their cost. Model providers can serve smaller models in SaaS, or even distribute malicious ones. On the other hand, responsible model builders and other stakeholders may be incentivised or required to provide security and trust guarantees. They may want to prove low bias in their training data, offer easily verifiable performance claims, or guarantee end-to-end integrity of the model creation in high risk domains. To address these challenges, it is necessary to guarantee the integrity of the entire ML lifecycle – beginning with the data, through the training, and finally, the evaluation and deployment. Was the data modified? Did the hardware and software environment adhere to the specification? Did the contractor follow the specified training procedure? Can I trust the evaluation? How can I guarantee that I am interacting with the intended model? These are example questions that showcase the breadth of the involved challenges that must be tackled to provide end-to-end security. In this work, we introduce Atlas , a framework for enhancing the security and transparency of the lifecycle of ML models. Atlas establishes the baseline of fundamental components and capabilities needed for comprehensive provenance tracking at each stage of the ML lifecycle. Subsequently, Atlas defines the core integrity requirements for verifiable ML lifecycle transparency. We provide a reference implementation that instantiates Atlas using hardware-based security mechanisms – with trusted execution environment (TEE), including attestations. We claim the following contributions: 1. We introduce Atlas , a framework designed for end-to-end ML lifecycle transparency. 2. We instantiate Atlas using TEEs and metadata-based provenance tracking. 3. We evaluate our Atlas prototype through two case studies: 1) fine-tuning of a BERT model [ 3 , 4 ] ; 2) fine-tuning of a bge-reranker model [ 5 ] . II Background & Related Work II-A Data Provenance & Authenticity While not a new concern, the authenticity, provenance and attribution of media has received renewed attention in recent years due to the wide online proliferation of images, videos and text that have been manipulated or forged using generative ML models [ 6 , 7 ] . One common approach for addressing digital image and video manipulation involves cryptographic techniques such as hashing, digital signatures and blockchains, which enable provenance authentication, tamper detection, and checking for divergent views of the content [ 8 ] . Most notably, the Coalition for Content Provenance and Authenticity (C2PA) specification [ 9 , 10 ] introduced by the Content Authenticity Initiative (CAI) [ 11 ] and Project Origin [ 12 ] provides cryptographic binding of authenticity claims, verifiable assertions about content origin and modifications, and tamper-evident audit trails [ 13 ] . Initially launched as a response to the growing challenge of deepfakes [ 11 ] and digital content manipulation, the C2PA standard first gained traction in digital photography and journalism workflows. The standard’s extensible and interoperable metadata format has made C2PA an attractive option for ML dataset and model provenance tracking [ 14 ] . Other prior work in this space builds upon digitally signed metadata by leveraging distributed ledger technologies to create transparent and immutable content or provenance records. Examples of this approach include AMP [ 7 ] , the News Provenance Project [ 15 ] and Collomosse et al. [ 14 ] . Atlas borrows techniques from C2PA and similar approaches, but integrates them directly into the ML system to track model artifact provenance closer to where the transformations occur to achieve higher metadata fidelity, rather than applying them in an ad hoc fashion after a particular dataset or model artifact has been created. The Open Source Security Foundation (OpenSSF) Model Signing project [ 16 ] is a parallel effort in this space focusing specifically on cryptographic signing of model artifacts to ensure their authenticity and integrity. As such, it serves as a crucial building block but requires integration with other tools for more comprehensive supply chain security. While Model Signing might integrate with Atlas , additional mechanisms would be needed to address our goal of tracking full model lineage. LakeFS [ 17 ] combines Git-like semantics with concepts from object stores such as S3 to provide a version control system for data, including ML datsets. Thus, LakeFS aims to capture data lineage by tracking changes to stored data over time, and allowing ML applications to reference specific versions of the stored data. This approach is meant to integrate with existing first-party data processing pipelines, but does not facilitate verification of data provenance by downstream consumers. Atlas ’ metadata centered approach, on the other hand, enables first- and third-party ML dataset consumers to track changes and check their provenance, even when they may not have direct access to the data. II-B Supply Chain Integrity While the ML supply chain is an emerging area of research, software supply chain security and integrity has been the subject of much prior work. Thus, several of these approaches are being explored for their applicability to enhancing the integrity of the ML model lifecycle. Bills of Materials (BOM) have been employed to document the list of components of a hardware or software product for over three decades [ 18 ] . Due to recent regulations [ 19 , 20 ] , Software BOM (SBOM) have been the focus of many industry and academic efforts seeking to facilitate tracking software dependencies and other

Read the complete text