Trustworthy Provenance for Big Data Science: a Modular Architecture Leveraging Blockchain in Federated Settings

Nicola Giuseppe Marchioro, Yannis Velegrakis, Valentine Anantharaj, Ian Foster, Sandro Luigi Fiore · 2025

Read Trustworthy Provenance for Big Data Science: a Modular Architecture Leveraging Blockchain in Federated Settings by Nicola Giuseppe Marchioro, Yannis Velegrakis, Valentine Anantharaj, Ian Foster, Sandro Luigi Fiore (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24675.txt.

Introduction

Nicola Giuseppe Marchioro and co-authors present a 2025 paper on keeping trustworthy records of where scientific data came from. In big collaborative science, datasets cross many labs, and later users need proof of each file's origin and every change it went through. Existing tracking tools strain in such federated settings.

The authors propose a modular design that logs provenance on a permissioned blockchain, whose records cannot be quietly rewritten. Each artifact gets a lasting identifier, and its history is versioned like source code. The system is meant to work across institutions and fields alike, so any partner can audit a dataset's full journey long after the work is done.

Catalog record

CREATORNicola Giuseppe Marchioro, Yannis Velegrakis, Valentine Anantharaj, Ian Foster, Sandro Luigi Fiore
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24675

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Trustworthy Provenance for Big Data Science: a Modular Architecture Leveraging Blockchain in Federated Settings Nicola Giuseppe Marchioro, Yannis Velegrakis, Valentine Anantharaj, Ian Foster, Sandro Luigi Fiore Abstract Ensuring the trustworthiness and long-term verifiability of scientific data is a foundational challenge in the era of data-intensive, collaborative research. Provenance metadata plays a key role in this context, capturing the origin, transformation, and usage of research artifacts. However, existing solutions often fall short when applied to distributed, multi-institutional settings. This paper introduces a modular, domain-agnostic architecture for provenance tracking in federated environments, leveraging permissioned blockchain infrastructure to guarantee integrity, immutability, and auditability. The system supports decentralized interaction, persistent identifiers for artifact traceability, and a provenance versioning model that preserves the history of updates. Designed to interoperate with diverse scientific domains, the architecture promotes transparency, accountability, and reproducibility across organizational boundaries. Ongoing work focuses on validating the system through a distributed prototype and exploring its performance in collaborative settings. I Introduction As scientific research becomes more data-driven and collaborative, ensuring the reliability and accessibility of research data is crucial to advancing knowledge. Across disciplines, researchers are generating and analyzing vast amounts of data, driving new discoveries and challenges in data collection, management, and integration. However, geographical dispersion, diverse access patterns, and restrictions on data availability create significant challenges in managing and integrating research data effectively [ 8 , 20 , 16 , 1 ] . In the absence of coordination, these issues can lead to inefficiencies and unpredictability in data retrieval in many real-world scenarios. In Open Science [ 28 ] , FAIR [ 40 ] and TRUST [ 24 ] principles have emerged as two essential frameworks, offering structured guidelines to enhance transparency, reliability, trustworthiness and data reuse across the scientific community. These principles have shifted the focus toward making research data more than just accessible; they emphasize structured, interpretable data that can be reused and verified by other researchers. In line with these principles, the significance of unrestricted access to valuable information has become increasingly relevant, as seen in free software movements [ 34 ] and initiatives that promote the free circulation of information [ 3 ] . A critical barrier to the full achievement of such principles in practical settings is the issue of producing and sharing valuable provenance information (i.e., metadata that captures the entire lifecycle of an artifact, providing a complete record from its creation to its consumption). Provenance allows researchers to understand where data originated, how it was processed, and by whom it was created, offering essential context to assess its quality [ 10 , 29 , 37 ] . Yet, many current approaches to provenance tracking are insufficient, often lacking the comprehensiveness and transparency required for reliable scientific work. This gap makes it increasingly difficult to verify the authenticity of data, reproduce experiments, or build upon previous findings [ 2 , 36 , 11 ] . These issues can take many forms when provenance is not properly recorded. For instance, version control mistakes can cause outdated or contradictory data to be used [ 23 ] . Furthermore, ambiguity regarding who created the data or what software was utilized to manipulate it can raise questions about its validity. Finally, even when provenance is recorded, its utility depends on its accessibility. However, link rot, the phenomenon where data URLs or resources become unavailable, poses a significant risk and can potentially break crucial connections in the research chain [ 14 , 19 ] . Addressing these challenges requires a multifaceted solution, a provenance management system that strengthens each link in the chain and ensures that all phases of data handling, from generation to distribution, are trustworthy. This system must also be domain-agnostic, flexible enough to integrate with diverse scientific disciplines, and scalable to handle the growing volume of data being produced. By taking advantage of a robust, reliable, and transparent provenance chain, researchers can not only ensure the integrity of their data but also contribute to the wider scientific ecosystem’s need for collaboration and reproducibility. To this end, this paper introduces a modular, domain-agnostic architecture for provenance tracking in federated environments, leveraging permissioned blockchain infrastructure to guarantee integrity, immutability, and auditability. The remainder of this paper is structured as follows: Section II provides a comprehensive background on provenance metadata and blockchain-based solutions. Section III outlines the methodology, detailing the design decisions that underpin our architecture. Section IV illustrates the operational behavior of the system through real-world use cases, while Section V concludes with a summary of contributions and a discussion of future work. II Background Metadata has sometimes been described as ‘‘a love note to the future’’ 1 1 1 https://ascii.textfiles.com/archives/3181 , emphasizing its role in preserving the meaning and context of information over time. However, metadata is only useful when it is well-structured and consistently maintained; otherwise, it becomes little more than digital noise, sophistication without any substance. In scientific research, bad metadata can hinder reproducibility, introduce uncertainty, and reduce the long-term utility of data. Metadata generally falls into three categories: descriptive metadata, which provides information about the content of a dataset; structural metadata, which describes relationships between different data elements; and administrative metadata, which includes technical details such as file formats and access rights [ 30 ] . Provenance metadata spans all three categories: it describes what the data is (descriptive), how it was derived or related to other data (structural), and who modified or accessed it (administrative). This makes provenance a key enabler of transparency and reproducibility in scientific workflows. As research increasingly relies on distributed data sources, computational models, and automated workflows, robust provenance tracking has become a fundamental requirement for scientific integrity. Moreover, provenance aligns closely with the FAIR principles, emphasizing the need for rich metadata to ensure long-term usability and verifiability of research data. Provenance is well-established in disciplines where data consistency, accountability, and traceability are critical. In databases, provenance tracking is fundamental for query explainability, with models such as why-provenance, how-provenance, and where-provenance [ 4 , 6 ] helping users understand how data is derived. In bioinformatics, provenance ensures the reproducibility of genomic analyses and machine learning workflows [ 13 , 35 ] . Climate Science, through tools like ESMValTool, integrates provenance tracking to ensure transparency in climate model evaluation [ 32 ] . However, although provenance is established in certain areas, its application within large-scale, distributed scientific infrastructures is fragmented. This lack of standardized, integrated provenance mechanisms raises concerns about metadata completeness, data integrity, and long-term verifiability. The credibility of scientific processes is directly tied to the availability and reliability of provenance records. Without clear provenance, data origin and processing steps remain opaque, making it difficult to assess whether results are reproducible and credible. In short, provenance aims to guarantee: • Data authenticity verification: Ensuring that datasets have not been tampered with. • Error tracing and reasoning: Finding the source of discrepancies or inconsistencies. • Accountability: Unambiguously assigning actions to responsible parties. Transparency in provenance is particularly critical for high-stakes research, such as medical trials, climate modeling, and AI-based decision making, where unreliable data can lead to faulty conclusions with real-world consequences. Various standards and frameworks have been developed to address provenance tracking and to support the reproducibility of experiments, most

Read the complete text