In Pursuit of Total Reproducibility
Moritz E. Beber · 2025
Read In Pursuit of Total Reproducibility by Moritz E. Beber (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11635.txt.
Introduction
Moritz Beber argued in 2025 for total reproducibility in computational systems biology through a software method called event sourcing. Most work in that field rests on math models, either dynamic or steady-state. Models are shared in markup languages meant to standardize them, yet results still prove hard to reproduce.
Beber notes that standards demand heavy effort, tools vary, and researchers get little reward for the extra work. Event sourcing instead keeps a full, unchanging record of every change, and the current state is rebuilt from that record, much as version control does for code. Worked examples show how the approach handles model history. Readers get a practical shift in focus: rather than asking authors to polish a final file, keep the whole trail so any result can be rebuilt.
Catalog record
| CREATOR | Moritz E. Beber |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-11635
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
In Pursuit of Total Reproducibility Moritz E. Beber Abstract The vast majority of scientific contributions in the field of computational systems biology are based on mathematical models. These models can be broadly classified as either dynamic (kinetic) models or steady-state (constraint-based) models. They are often described in specific markup languages whose purpose is to aid in the distribution and standardization of models. Despite numerous established standards in the field, reproducibility remains problematic due to the substantial effort required for compliance, diversity of implementations, and the lack of proportionate rewards for researchers. This article explores the application of event sourcing - a software engineering technique where system state is derived from sequential recorded events - to address reproducibility challenges in computational systems biology. Event sourcing, exemplified by systems like git, offers a promising solution by maintaining complete, immutable records of all changes to a model. Through examples including leader and follower applications, local and remote computation, and contribution tracking, this work demonstrates how event-sourced systems can automate standards compliance, provide comprehensive audit trails, enable perfect replication of processes, facilitate collaboration, and generate multiple specialized read models from a single event log. An implementation of the outlined principles has the potential to transform computational systems biology by providing unprecedented transparency, reproducibility, and collaborative capabilities, ultimately accelerating research through more effective model reuse and integration. An event-sourced approach to modeling in computational systems biology may act as an example to related disciplines and contribute to ending the reproducibility crisis plaguing multiple major fields of science. Marrying Event Sourcing with Computational Systems Biology Introduction Reproducibility Crisis Although the field of computational systems biology is, in principle, in the enviable situation to be able to completely and deterministically define its own tools and artefacts, like many other sciences, it has been caught in the reproducibility crisis ( [ ref-baker_1500_2016 ] ; [ ref-ioannidis_why_2005 ] ). Reproducibility, the ability of independent parties to replicate results by merely using their methodological description ( [ ref-blinov_practical_2021 ] ; [ ref-bacon_opus_2016 ] ), is integral to the scientific method ( [ ref-john_scientific_2017 ] ). Reproducibility is not only vital to the house of cards of scientific progress, but also to the credibility of systems biology models in the eyes of the wider public, as well as their eligibility for use in critical decision making ( [ ref-tatka_adapting_2023 ] ; [ ref-d_waltemath_how_2016 ] ). As reviewed by Blinov et al. ( [ ref-blinov_practical_2021 ] ) and D. Waltemath and O. Wolkenhauer ( [ ref-d_waltemath_how_2016 ] ), reproducibility has been called into question in the related fields of computational biology, bioinformatics, medicine, artificial intelligence, neuroscience, and directly in computational systems biology by Tiwari et al. ( [ ref-tiwari_reproducibility_2021 ] ). On one hand, many of these are computational fields, so the lack of reproducibility is surprising. On the other hand, the nature of our scientific progress is such that we are building ever more complex models. As remarked by Blinov et al. ( [ ref-blinov_practical_2021 ] ), combining credible systems biology models from various sources is a matter of accelerating research. Starting every modeling project from scratch is simply not feasible within our short life spans and even shorter period of graduate studies. Standards There exist ample standards in computational systems biology ( [ ref-tatka_adapting_2023 ] ; [ ref-niarakis_addressing_2022 ] ; [ ref-blinov_practical_2021 ] ; [ ref-d_waltemath_how_2016 ] ) defined by and for the community, that, when consistently applied, facilitate reuse, interoperability, and reproducibility of models. Although sharing research data and reproducible models is correlated with more citations ( [ ref-hopfl_bayesian_2023 ] ; [ ref-piwowar_sharing_2007 ] ), the substantial effort required to conform with all the standards, is rewarded too little ( [ ref-ioannidis_increasing_2014 ] ). A situation that remains unchanged despite the clear benefits at an institutional level ( [ ref-sandve_ten_2013 ] ). The main standards to consider are CellML ( [ ref-clerx_cellml_2020 ] ), NeuroML ( [ ref-gleeson_neuroml_2010 ] ), or SBML ( [ ref-hucka_systems_2019 ] ) for model definition. BioPAX ( [ ref-demir_biopax_2010 ] ) for describing biological pathways. MIRIAM ( [ ref-novere_minimum_2005 ] ) for the critical task of component annotation, which requires reference to many resources. SBO ( [ ref-courtot_controlled_2011 ] ; [ ref-juty_systems_2010 ] ) for anchoring the intended meaning of model components. PEtab ( [ ref-schmiester_petabinteroperable_2021 ] ) for describing parameter estimation. MIASE ( [ ref-waltemath_minimum_2011 ] ) and SED-ML ( [ ref-waltemath_reproducible_2011 ] ) to describe model simulations. KiSAO ( [ ref-zhukova_kinetic_2011 ] ) for describing simulation algorithms used. Finally, OMEX to describe metadata and package everything into a COMBINE archive ( [ ref-bergmann_combine_2014 ] ). As even the uninitiated can imagine, following all of the above standards to the letter, especially manually annotating all model components, requires an amount of effort that runs counter to today’s fast publishing climate and poses a challenge even to experts. Marrying Event Sourcing Event sourcing is a software engineering technique that is gaining in popularity, but whose origins are somewhat unclear. Suffice to say that it relates to modern double-entry book keeping 1 1 1 According to Wikipedia , the practice started around the 13th century in Europe. Probably much earlier in other parts of the world [author’s note]. and has lately been popularized in a series of talks by Greg Young 2 2 2 The technique was possibly first published in rudimentary form by Martin Fowler on his blog in 2005. 3 3 3 See, for example, this recording at GOTO 2014 . A book on the topic is apparently in preparation. . The core idea of event sourcing is that application state is derived from all past events which are records of facts; just like your bank account’s balance is the sum of all transactions. Besides banking, a prime example of event sourcing is git . A version control software used by the vast majority of the software industry. In this work, I explain event sourcing for computational systems biologists and outline several applications of this technique for the task of automating generating standards compliant models, provide critical infrastructure, foster collaboration, and subsequently improve reproducibility. In trying to design and understand event-sourced systems, there have been numerous influences. Early on, Domain-Driven Design’s (DDD - [ ref-evans_domain-driven_2004 ] ) aggregates and the ubiquitous language were a large inspiration. The ubiquitous language means that all software artifacts, like documentation, code, and tests are using the same concepts and language as the domain being modelled. Aggregates are objects that ensure the consistency of their data within their context. That means, they contain rules that may disallow commands issued to the aggregate from succeeding and thus control the state of the aggregate. Greg Young’s work on Command Query Responsibility Segregation (CQRS) was key to more functional implementations of event sourcing and led to the realization that it is not only possible, but in fact desirable to have multiple specialized read models to serve information queries. Designing event-sourced systems was helped by a workshop format called Event Storming by Alberto Brandolini 4 4 4 https://www.eventstorming.com . Today, many practitioners follow Adam Dymitruk’s Event Modeling 5 5 5 https://eventmodeling.org , which was recently more formally published by Dilger ( [ ref-dilger_understanding_2024 ] ). Methods Event Sourcing in a Nut Shell