An open framework for archival, reproducible, and transparent science
Sabar Dasgupta, Paul Nuyujukian · 2025
Read An open framework for archival, reproducible, and transparent science by Sabar Dasgupta, Paul Nuyujukian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08171.txt.
Introduction
Sabar Dasgupta and Paul Nuyujukian propose an open framework for science that others can rerun and check, in a 2025 paper. Data and code are now easy to share, yet redoing a study's figures still fails often. The missing piece, they argue, is the computing environment and the pipeline that turned data into figures. Their framework, called ARTS, packs those pieces together.
The design leans on containers that freeze the environment, version control that tracks every change, and lasting archives that hold the whole bundle. Data, code, and figures then live in one place that later teams can rebuild and test. The authors argue that wide adoption would lift trust in computational research across fields.
Catalog record
| CREATOR | Sabar Dasgupta, Paul Nuyujukian |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08171
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An open framework for archival, reproducible, and transparent science Sabar Dasgupta, Paul Nuyujukian Abstract 1 Abstract Digital computational outputs are now ubiquitous in the research workflow and the way in which these data are stored and cataloged is becoming more standardized across fields of research. However, even with accessible data and code, the barrier to recreating figures and reproducing scientific findings remains high. What is generally missing is the computational environment and associated pipelines in which the data and code are executed to generate figures. The archival, reproducible, and transparent science (ARTS) open framework incorporates containers, version control systems, and persistent archives through which all data, code, and figures related to a research project can be stored together, easily recreated, and serve as an accessible platform for long-term sharing and validation. If the underlying principles behind this framework are broadly adopted, it will improve the reproducibility and transparency of research. 2 Introduction Over the past few decades, researchers have recognized the large effort required to replicate experiments and the rate at which these replication studies produce negative results [ 28 ] . Dubbed a “replicability crisis” [ 43 ] , the current paradigm for communicating experimental methods and distributing research outputs impedes future collaboration and the development of public trust in findings. To improve replicability, both the processes for data collection and those for creating reproducible analyses must be improved. Reproducibility is the primary focus of this manuscript with a goal of minimizing the time, effort, and expertise required to analyze data from a study beyond its published manuscript [ 25 ] . In this writing and in the context of computational workflows that perform analysis with code on data to generate results, reproducibility is defined as the measure of ease by which one can run an equivalent workflow with original data to reproduce published results. Then, replicability is the measure of ease by which an equivalent workflow can be run with independently collected data to verify published results [ 8 ] . Research that is replicable is reproducible by default so long as the original data is available and usable, but the converse is not necessarily true. Replicability sets a higher bar due to the cost associated with collecting data to repeat experiments. At a minimum, research findings should be easily reproducible to foster collaboration and knowledge access, lower the barrier to building on an existing piece of work, and comply with new funding mandates. By the end of of 2025, research funded by the US federal government must make data accessible at the time of publishing [ 54 , 49 ] . Each funding agency has their own specific policies for data sharing [ 37 , 40 , 50 , 32 , 13 , 51 ] . While these policies offer guidance for researchers pursuing collaboration and open science, they do not outline how data, and more importantly, entire workflows should be shared and made accessible. The details around implementing computational best practices are left up to researchers, which is generally outside their scope of expertise and takes the focus away from core scientific work. There are a number of standards put out by the scientific community to address these concerns ranging from generic (and not necessarily research-specific) to highly focused on one field of research. Data standards include the FAIR Guiding Principles [ 56 ] and DataFed [ 12 ] . While FAIR is a good set of principles surrounding the sharing of data, it alone does not assure reproducibility as it does not consider computation. Standards for reproducibility must advise on not only how data is stored, but also how it is manipulated and presented in analysis. Figure 1: The research workflow involves collecting raw data, transforming it into derivative data, and producing experimental outputs using code. Ideally, all pieces of the workflow should be archived as research artifacts—the data, computation, environment, experiment outputs, and associated manuscript. A signature of each piece of data can then be kept track of using a timestamp authority to keep a trusted historical record. Frameworks such as Spyglass (for neuroscience) or Galaxy (for bioinformatics) recommend field-specific workflows with associated software and are an excellent step towards integrating various software frameworks, but can be fragile as they rely on the permanence and compatibility of external services and APIs [ 30 , 24 ] . Journals are starting to place a focus on software quality and availability and are recommending ways in which scientific code should be written in order to ensure accessibility [ 29 ] . Major journals such as Nature Scientific Data also have specific requirements and recommendations for deposition of data and code, but fall short of promoting accessible pipeline reproducibility [ 45 ] . Specifically, Nature and Science now prohibit the use of GitHub as a code deposition framework because they can be altered at a later time [ 35 , 44 ] and Cell strongly recommends archives that support digital longevity [ 4 ] . New SaaS tools such as Code Ocean have been developed to address these issues and offer reproducibility and analysis pipeline visualization as a service [ 7 ] . Code Ocean uses Amazon as a cloud provider to reproduce analyses and allows exporting of the files that define the workflow environment—Containerfiles—so that they can be run elsewhere. While this is a useful tool for increasing reproducibility for the journal review process [ 5 ] , it does not define an open standard and is a centralized, commercial solution that is not accessible during the research lifecycle. The calkit Python package is another useful reproducibility tool and acts as a wrapper around some of the needed technologies discussed later in this manuscript. [ 3 ] . These existing environment solutions do not yet define an open framework that aims to minimize compliance burden and the time and effort required to reproduce a research workflow many years down the line. Neither highly opinionated field-specific frameworks nor existing generic research workflow aids provide end-to-end support at the computational environment level for a wide array of fields. The medal scale (pertaining to life sciences) [ 25 ] recommends automating dependency installation and describes a gold standard where analyses are reproducible with a signal command. Unless these dependencies are versioned and running in a consistent environment, there is no guarantee that they will produce deterministic outputs or even run without error in the future. While reproduction effort is a crucial metric, a further key consideration is how far into the future the workflow is able to be run in one step. To truly meet this gold standard the complete software pipelines associated with experiment analyses must be captured as a container image —a binary file that bundles all dependencies, including the operating system, needed to recreate the experiment outputs. Until recently, reproducing pipelines encompassing a workflow was difficult, if not impossible, without locking in to specific computational platforms. Researchers concerned with reproducibility will often specify versioned dependencies and the operating system they used to run their code, but this may miss hidden dependencies, and further burdens researchers attempting to reproduce findings with the task of recreating the computational environment. For example, code run in a Python virtual environment