AI Model Passport: Data and System Traceability Framework for Transparent AI in Health

Varvara Kalokyri, Nikolaos S. Tachos, Charalampos N. Kalantzopoulos, Stelios Sfakianakis, Haridimos Kondylakis, Sara Colantonio, Daniele Regge, Nikolaos Papanikolaou, The ProCAncer-I consortium, Konstantinos Marias, Dimitrios I. Fotiadis, Manolis Tsiknakis · 2025

Read AI Model Passport: Data and System Traceability Framework for Transparent AI in Health by Varvara Kalokyri, Nikolaos S. Tachos, Charalampos N. Kalantzopoulos, Stelios Sfakianakis, Haridimos Kondylakis, Sara Colantonio, Daniele Regge, Nikolaos Papanikolaou, The ProCAncer-I consortium, Konstantinos Marias, Dimitrios I. Fotiadis, Manolis Tsiknakis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-22358.txt.

Introduction

Kalokyri and co-authors propose giving every medical AI model a passport: a structured, machine-readable record of what it is, what it was trained on, and how it has changed. Health AI is spreading fast, but its paperwork is mostly hand-written documents that cannot be compared or checked at scale, and models carry no verifiable identity. The passport framework captures the full life story, from data collection and cleaning through design, training, and deployment.

The paper also presents a working tool, AIPassport, built inside a European prostate cancer imaging project. The tool gathers the metadata automatically, keeps versions straight, and separates results from the scripts that made them. A lesion segmentation case shows it in action. The authors argue the approach cuts manual documentation effort while raising transparency and readiness for regulators. For hospitals and developers alike, the pitch is trust you can audit.

Catalog record

CREATORVarvara Kalokyri, Nikolaos S. Tachos, Charalampos N. Kalantzopoulos, Stelios Sfakianakis, Haridimos Kondylakis, Sara Colantonio, Daniele Regge, Nikolaos Papanikolaou, The ProCAncer-I consortium, Konstantinos Marias, Dimitrios I. Fotiadis, Manolis Tsiknakis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-22358

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AI Model Passport: Data and System Traceability Framework for Transparent AI in Health Varvara Kalokyri, Nikolaos S. Tachos, Charalampos N. Kalantzopoulos, Stelios Sfakianakis, Haridimos Kondylakis, Sara Colantonio, Daniele Regge, Nikolaos Papanikolaou, The ProCAncer-I consortium, Konstantinos Marias, Dimitrios I. Fotiadis, Manolis Tsiknakis Abstract The increasing integration of Artificial Intelligence (AI) into health and biomedical systems necessitates robust frameworks for transparency, accountability, and ethical compliance. Existing frameworks often rely on human-readable, manual documentation which limits scalability, comparability, and machine interpretability across projects and platforms. They also fail to provide a unique, verifiable identity for AI models to ensure their provenance and authenticity across systems and use cases, limiting reproducibility and stakeholder trust. This paper introduces the concept of the AI Model Passport , a structured and standardized documentation framework that acts as a digital identity and verification tool for AI models. It captures essential metadata to uniquely identify, verify, trace and monitor AI models across their lifecycle - from data acquisition and preprocessing to model design, development and deployment. In addition, an implementation of this framework is presented through AIPassport , an MLOps tool developed within the ProCAncer-I EU project for medical imaging applications. AIPassport automates metadata collection, ensures proper versioning, decouples results from source scripts, and integrates with various development environments. Its effectiveness is showcased through a lesion segmentation use case using data from the ProCAncer-I dataset, illustrating how the AI Model Passport enhances transparency, reproducibility, and regulatory readiness while reducing manual effort. This approach aims to set a new standard for fostering trust and accountability in AI-driven healthcare solutions, aspiring to serve as the basis for developing transparent and regulation compliant AI systems across domains. K eywords AI \cdot MLOps \cdot Traceability \cdot Transparency \cdot Reproducibility \cdot F.U.T.U.R.E. AI \cdot ontologies \cdot medical imaging \cdot FAIR 1 Introduction Artificial Intelligence (AI) is transforming healthcare by enabling the development of advanced tools that support clinicians in disease diagnosis, complex case analysis, and optimized treatment planning. However, for an AI system to be adopted in healthcare, it must be reliable, clinically useful, and above all, safe for patients [ 1 ] . Trust from healthcare professionals, patients, and policy makers is essential, and one of the key factors in building this trust is transparency [ 2 , 3 ] —ensuring that AI models are clearly documented, traceable, and their outputs are interpretable and accountable. Transparency in AI is emphasized by multiple regulatory and scientific bodies, including the High-Level Expert Group (HLEG) on Artificial Intelligence [ 4 ] and the European AI Act [ 5 ] , which highlight the need for traceability, explainability, and clear disclosure of an AI system’s limitations. Additionally, the FUTURE-AI guiding principles [ 6 ] emphasize that transparency must be built into AI development through structured documentation and monitoring of the entire AI lifecycle. This includes tracking data origins, processing steps, model training, and evaluation processes to ensure the system can be audited and validated. AI systems across healthcare rely on AI models trained on large-scale, often heterogeneous datasets. Variations in data sources, collection protocols, and processing methods can significantly impact the performance, reproducibility, and generalization capacity of these models, making comprehensive documentation essential. Maintaining data and model provenance is particularly important to identify and mitigate potential risks, such as the introduction of bias, which may arise from inherent imbalances in the data or from preprocessing decisions, including transformations and filtering applied by data scientists. Achieving transparency in such systems requires detailed data traceability , including information on data ownership, collection methodologies, applicable standards, and curation procedures. Similarly, AI model traceability demands thorough documentation of the entire model development lifecycle—from training and validation to deployment and monitoring. Both forms of traceability are essential for supporting transparency, as they enable effective auditing, reproducibility, and regulatory compliance [ 7 , 8 ] . Transparency in the development and deployment of AI systems has attracted significant attention from regulatory bodies, the research community and industry stakeholders. While initiatives like Datasheets for Datasets [ 9 ] , Model Cards [ 10 ] , and Google Data Cards [ 11 ] promote structured documentation, they typically rely on manual, human-readable templates completed after development, and lack automation, standardization, and machine interpretability, limiting scalability and comparability across projects and platforms. Technical tools such as MLflow [ 12 ] , ML Metadata (MLMD) [ 13 ] , and OpenLineage [ 14 ] support metadata tracking during development but focus primarily on experiment management rather than providing end-to-end traceability. Although recent frameworks like ML Commons Croissant [ 15 ] advance standardized metadata exchange for datasets, they do not address model provenance or identity verification. As a result, the lack of integrated solutions makes it difficult to reliably trace AI models’ development histories, assess reproducibility, and verify authenticity across systems. Enterprise solutions such as IBM FactSheets [ 16 ] , Azure Machine Learning [ 17 ] , and Google Vertex AI [ 18 ] provide more comprehensive governance and monitoring capabilities, yet they rely on proprietary standards and fall short in delivering open, verifiable model identities that ensure provenance, authenticity, and compliance across diverse environments. This gap makes it difficult to verify a model’s development journey, assess reproducibility, and trace back the steps in its creation process. To overcome current challenges in transparency and traceability, we propose the AI Model Passport—a standardized, machine-interpretable framework that automates the collection of essential metadata and monitors the entire AI model development lifecycle. Its aim is to bridge the gap between human-centric documentation tools and technical MLOps solutions and provide an integrated solution which focuses on recording critical information needed to uniquely identify, verify, and reproduce AI development processes. The AI Model Passport automatically tracks key metadata related to dataset creation and curation, model training and validation, and the stakeholders involved, ensuring full traceability and accountability throughout the workflow. By leveraging ontological models and integrating with open MLOps frameworks, it standardizes descriptions of datasets and AI workflows, enhancing interoperability, discoverability, and reusability of AI model assets. At the core of this framework is a unique, verifiable digital identity for AI models, enabling their verification across deployments. This identity-centric approach supports regulatory compliance, reproducibility, and fosters trust by ensuring models can be reliably identified, audited, and validated throughout their operational lifecycle. Furthermore, the framework is designed to align with the latest European regulatory initiatives and data governance strategies, including the Common European Data Spaces [ 19 ] , the Open European Data Portal [ 20 ] , and demands of the European Health Data Space (EHDS) Regulation [ 21 ] . These efforts emphasize structured, machine-readable documentation to promote trust, secure data sharing, and interoperability in digital ecosystems. In this context, the AI Model Passport also closely mirrors the principles behind the European Union’s Digital Product Passport [ 22 ] , providing a standardized, verifiable mechanism to record and share critical lifecycle information—ensuring that AI models, like physical products, can be transparently traced, identified, and trusted across their usage environments. Finally, we present and deliver AIPassport , an open source, end-to-end MLOps pythonic tool, that implements the AI Model Passport framework and aspires to serve as the basis for developing transparent and regulation compliant AI systems across domains. Currently, deployed across several

Read the complete text