A Master Class on Reproducibility: A Student Hackathon on Advanced MRI Reconstruction Methods

Lina Felsner, Sevgi G. Kafali *, Hannah Eichhorn, Agnes A. J. Leth, Aidas Batvinskas, André Datchev, Fabian Klemm, Jan Aulich, Puntika Leepagorn, Ruben Klinger, Daniel Rueckert, Julia A. Schnabel · 2026

Read A Master Class on Reproducibility: A Student Hackathon on Advanced MRI Reconstruction Methods by Lina Felsner, Sevgi G. Kafali *, Hannah Eichhorn, Agnes A. J. Leth, Aidas Batvinskas, André Datchev, Fabian Klemm, Jan Aulich, Puntika Leepagorn, Ruben Klinger, Daniel Rueckert, Julia A. Schnabel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18314.txt.

Introduction

Lina Felsner and co-authors report a student hackathon built around reproducing MRI results. Their 2026 preprint describes the design, protocol, and outcomes of the event. Students set out to replicate three influential MRI reconstruction papers. One is MoDL, an unrolled model-based network with learned denoising. The second is HUMUS-Net, a hybrid unrolled design that mixes CNN and transformer parts. The third is an untrained, physics-regularized method for dynamic MRI that uses a quantitative prior.

Reproduction is a hard test of whether a paper gives enough detail to rebuild its claims. A hackathon format turns that test into training. The outcomes show where advanced methods stand up to fresh hands. Such exercises strengthen the field's habits of care.

Catalog record

CREATORLina Felsner, Sevgi G. Kafali *, Hannah Eichhorn, Agnes A. J. Leth, Aidas Batvinskas, André Datchev, Fabian Klemm, Jan Aulich, Puntika Leepagorn, Ruben Klinger, Daniel Rueckert, Julia A. Schnabel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-18314

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Master Class on Reproducibility: A Student Hackathon on Advanced MRI Reconstruction Methods Lina Felsner, Sevgi G. Kafali *, Hannah Eichhorn, Agnes A. J. Leth, Aidas Batvinskas, André Datchev, Fabian Klemm, Jan Aulich, Puntika Leepagorn, Ruben Klinger, Daniel Rueckert, Julia A. Schnabel Abstract We report the design, protocol, and outcomes of a student reproducibility hackathon focused on replicating the results of three influential MRI reconstruction papers: (a) MoDL, an unrolled model-based network with learned denoising 2 ; (b) HUMUS-Net, a hybrid unrolled multi-scale CNN+Transformer architecture 4 ; and (c) an untrained, physics-regularized dynamic MRI method that uses a quantitative MR model for early stopping 12 . We describe the setup of the hackathon and present reproduction outcomes alongside additional experiments, and we detail fundamental practices for building reproducible codebases. 1 Introduction Magnetic resonance imaging (MRI) is known for its strong soft-tissue contrast and can be used to diagnose several diseases from tumors to strokes and joint injuries. One of the biggest challenges in MRI is the long scan time, which is why accelerated MRI reconstruction has been extensively studied over the last few decades. This is done by using sophisticated algorithms which can mitigate acceleration artifacts. Deep learning has transformed accelerated MRI reconstruction by casting it as a learned regularized inverse problem. A standard approach for high-quality reconstructions with strong physics grounding are unrolled neural networks, which explicitly interleave data-consistency with learned priors . The Model-Based Deep Learning Architecture for Inverse Problems (MoDL) 2 introduces a supervised unrolled network that integrates a variational framework with a data-consistency term and a learned CNN to capture image redundancy. Another unrolled network, called HUMUS-Net 4 is a hybrid architecture that leverages transformers to model long-range dependencies while retaining the efficiency and inductive bias of convolutions. Following the growing interest in unsupervised approaches, Slavkova et al. 12 proposed an untrained, i.e., self-supervised network that exploits the architectural bias and scan-specific optimization, while benefiting from physics-based regularization to reduce reliance on fully sampled ground truth. Even at higher acceleration rates, these previous studies all yield extraordinary image reconstruction quality, validated by extensive evaluations and experiments. However, complex and intricate deep learning frameworks, specialized data acquisition protocols, and sophisticated training regimens, can make it challenging to verify reported results. Additional challenges might arise while reproducing the results due to varying software dependencies, hardware configurations, random seeds, and subtle differences in pre-processing or hyperparameter tuning. Therefore, best practices emphasize the use of version-controlled code, standardized computing environments, and fully executable pipelines. These practices are supported by pragmatic checklists and further reinforced by the Findable, Accessible, Interoperable, and Reusable (FAIR) principles 14 , which extend the scope from data to also models and workflows. Beyond FAIR, the FUTURE-AI 8 principles offer a concise, consensus framework for trustworthy medical AI across the full lifecycle considering: Fairness, Universality, Traceability, Usability, Robustness, and Explainability. The guideline translates these six pillars into actionable recommendations for data curation, model development, validation, deployment, and monitoring. Following these principles alongside open code and defined environments could also strengthen both the credibility and reproducibility of reported results. For computational research reproducibility has become an essential component 13 . In the medical imaging community, two main conferences have been holding hackathons focusing on reproducibility: the annual meeting of International Society of Magnetic Resonance in Medicine (ISMRM) 10 and Medical Image Computing and Computer Assisted Interventions (MICCAI) 3 . In addition, educational hackathons specifically focusing on reproducibility have emerged as a valuable tool for promoting best practices in a teaching environment. Initiatives such as the ‘Reproduced Papers’ series 11 or classroom setting type hackathons 9 highlight the growing recognition of reproducibility challenges. Particularly, the ‘reproduce CVPR Hackathon’ 9 , organized at Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) has aimed to reproduce papers from CVPR 2024. The FAU hackathon contained three stages: automated detection of code availability, a PhD hackathon to evaluate reproducibility effort, and a master’s course to reproduce CVPR papers. This work documents a student hackathon organized to reproduce three selected works in the context of accelerated MRI reconstruction: HUMUS-Net, MoDL, and untrained+physics model. The hackathon has been designed to (1) help students connect theory and practice in inverse problems applied to MRI reconstruction; and (2) emphasize reproducibility and responsible use of MRI data. 2 Methods In this section we describe the setup of our reproducibility hackathon. This hackathon has been an integral component of the ‘Deep Learning for Inverse Problems in Medical Imaging’ master seminar at Technical University of Munich (TUM). Its primary objective has been to transition students from paper reading (i.e., theoretical understanding) to practical application with a hands-on experience. The hackathon spanned a total of four hours, divided across three sessions. Paper selection was done by the seminar course instructors. During this selection, instructors ensured code and data availability including MR images and the respective raw data, as well as pre-trained model weights. Seven students from the School of Computation, Information and Technology at TUM, originating from diverse master’s programs, formed three teams. Each team selected one out of six possible papers. The task was to recreate one of the figures in the result section of the chosen scientific paper. The students were asked to utilize the provided pre-trained weights, thus bypassing the need for training models from scratch to avoid differences in code or training set-up. If the students could complete the task before the deadline, they were asked to show additional out-of-distribution (i.e., cross-domain) results in a test dataset for bonus credit. • Team A: The first team consisted of two students and focused on reproducing MoDL’s results 2 utilizing its corresponding codebase 5 and dataset 1 . The model was trained with a variable density (VD) k-space sampling mask with an acceleration rate of R=6. The students additionally tested on self-generated VD mask following a Gaussian distribution and GRAPPA-style sampling masks, with results reported for R=4 and R=14. • Team B: Team B, comprising three students, tackled HUMUS-Net 4 using its codebase 15 and single- and multi-coil data (fastMRI knee dataset 16 ) with an acceleration rate of R=8. Since this team had an additional student it was challenged to also evaluate the model on the brain multi-coil fastMRI dataset 1 . The students also compared the results to a Zero-filled approach. • Team C: The third team consisted of two students and focused on an ”Untrained+Physics” model by Slavkova et al. 12 utilizing its corresponding codebase 6 and dataset 7 . For all models, error maps were calculated as the difference between the reconstructed image and the fully sampled ground truth image. The evaluation metrics included structural similarity (SSIM) and peak signal-to-noise ratio (PSNR). All experiments were performed on a workstation featuring Ubuntu 24.04 LTS, an Intel Xeon W-2133 CPU, 30 GB RAM, and a single NVIDIA GeForce GTX 1080 GPU. The hackathon concluded with student teams presenting both the original papers and their reproduced results via posters within the seminar. 3 Results The results for the reproducibility hackathon for each team/paper are reported below. Mask Acc. rate SSIM PSNR [dB] Original VD R=6 0.92 \pm 0.00 38.51 \pm 0.75 Self-gen. VD R=4 0.93 \pm 0.00 40.06 \pm 0.88 Self-gen. VD R=14 0.85 \pm 0.01 30.59 \pm 1.01 GRAPPA-style R=4 0.87 \pm

Read the complete text