Bridging the Reproducibility Divide: Open Source Software’s Role in Standardizing Healthcare AI

John Wu, Zhenbang Wu, Jimeng Sun · 2026

Read Bridging the Reproducibility Divide: Open Source Software’s Role in Standardizing Healthcare AI by John Wu, Zhenbang Wu, Jimeng Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03367.txt.

Description

John Wu, Zhenbang Wu, and Jimeng Sun examine a reproducibility crisis in artificial intelligence for healthcare. Models in this field guide diagnosis and treatment, so weak checking carries real risk. Their 2026 analysis of recent papers finds a field talking openness while practicing secrecy: about three quarters still use private datasets or keep their modeling code unshared.

Sloppy, poorly documented data preparation makes matters worse, producing different reported scores for identical tasks and data. Open work pays off clearly. Papers using both public data and shared code earned more than twice the citations of papers doing neither. The authors urge open science practices, standard rules for data preprocessing, and robust shared benchmarks, arguing that trustworthy medical systems depend on results others can repeat.

Catalog record

CREATORJohn Wu, Zhenbang Wu, Jimeng Sun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56160
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.03367

Browse the full library · About the Tower of Babel