Evaluating the Impact of Medical Image Reconstruction on Downstream AI Fairness and Performance
Matteo Wohlrapp 1,2, Niklas Bubeck 2,3, Daniel Rueckert 2,3,4, William Lotter 1,5 · 2026
Read Evaluating the Impact of Medical Image Reconstruction on Downstream AI Fairness and Performance by Matteo Wohlrapp 1,2, Niklas Bubeck 2,3, Daniel Rueckert 2,3,4, William Lotter 1,5 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10904.txt.
Introduction
Wohlrapp and three colleagues build a frame pairing rebuild and diagnostic models to test how image reconstruction affects fairness and performance. Across classification and segmentation, rebuild methods (U-Net, GAN, diffusion), and X-ray and MRI data, rebuild scores track task performance poorly. Diagnostic accuracy stays stable even as PSNR falls with rising noise. Fairness scores vary more, with rebuilds widening gaps for patient sex, though added bias stays modest beside diagnostic biases. Two mitigation strategies from classification show limited effect, underscoring the need for holistic checks.
Catalog record
| CREATOR | Matteo Wohlrapp 1,2, Niklas Bubeck 2,3, Daniel Rueckert 2,3,4, William Lotter 1,5 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52454 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10904
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating the Impact of Medical Image Reconstruction on Downstream AI Fairness and Performance Matteo Wohlrapp 1,2, Niklas Bubeck 2,3, Daniel Rueckert 2,3,4, William Lotter 1,5 Abstract AI-based image reconstruction models are increasingly deployed in clinical workflows to improve image quality from noisy data, such as low-dose X-rays or accelerated MRI scans. However, these models are typically evaluated using pixel-level metrics like PSNR, leaving their impact on downstream diagnostic performance and fairness unclear. We introduce a scalable evaluation framework that applies reconstruction and diagnostic AI models in tandem, which we apply to two tasks (classification, segmentation), three reconstruction approaches (U-Net, GAN, diffusion), and two data types (X-ray, MRI) to assess the potential downstream implications of reconstruction. We find that conventional reconstruction metrics poorly track task performance, where diagnostic accuracy remains largely stable even as reconstruction PSNR declines with increasing image noise. Fairness metrics exhibit greater variability, with reconstruction sometimes amplifying demographic biases, particularly regarding patient sex. However, the overall magnitude of this additional bias is modest compared to the inherent biases already present in diagnostic models. To explore potential bias mitigation, we adapt two strategies from classification literature to the reconstruction setting, but observe limited efficacy. Overall, our findings emphasize the importance of holistic performance and fairness assessments throughout the entire medical imaging workflow, especially as generative reconstruction models are increasingly deployed. \midlauthor 1 Department of Data Science, Dana-Farber Cancer Institute, Boston, MA, USA 2 AI in Medicine, Technical University of Munich, Munich, Germany 3 Munich Center for Machine Learning (MCML), Munich, Germany 4 Department of Computing, Imperial College London, London, UK 5 Harvard Medical School, Boston, MA, USA † † volume: – 37 † † year: 2026 † † workshop: Full Paper – MIDL 2026 † † editors: Accepted for publication at MIDL 2026 keywords Fairness, Image Reconstruction, GANs, Diffusion Models Figure 1: Combined pipeline for downstream bias evaluation and mitigation in medical image reconstruction. MRI and X-ray images undergo realistic simulated degradation and are subsequently reconstructed with three approaches before serving as input to downstream prediction models. Reconstruction quality, downstream performance, and fairness are evaluated. Subsequently, two bias mitigation strategies are applied exclusively during reconstruction fine-tuning. 1 Introduction AI-based image reconstruction is an increasingly integral component of clinical workflows. These approaches are designed to enhance the quality of noisy medical images such as low-dose X-rays or faster-sampled MRIs, ultimately generating new medical images by imputing patterns learned from the training datasets 2 . Notably, there are now over 80 FDA-cleared devices based on this approach 53 , whose generated images are ultimately interpreted by clinicians. Traditionally, reconstruction model performance has been evaluated using pixel-level image metrics such as PSNR. However, these metrics provide an incomplete picture, as they do not reflect the impact of reconstructed images on subsequent clinical tasks. This gap raises a key unresolved question: How does AI-based reconstruction influence downstream clinical performance and, in particular, fairness? The latter is especially important to assess given the risk of generative models in encoding biases 48 ; 45 ; 38 ; 41 . While some smaller-scale studies have involved clinician review of AI-reconstructed images ( 18 ; 33 ) , this approach is not scalable, especially when investigating nuanced performance differences across subgroups. In this work, we assess the downstream implications of AI-based reconstruction through an evaluation framework that leverages reconstruction and classification/segmentation AI models applied in tandem. The framework provides a scalable approach to understand how reconstruction errors propagate, while also simulating a realistic clinical scenario as both reconstruction and diagnostic models are increasingly deployed in medical workflows. We apply this framework across three reconstruction approaches (U-Net, GAN, diffusion), two imaging domains (MRI, X-ray), and two tasks (classification and segmentation). We additionally propose and evaluate bias mitigation techniques tailored to reconstruction models. Our findings highlight differences in trends between image metrics and diagnostic accuracy, and the potential of reconstruction models to shift demographic biases. 2 Related Work Reconstruction Models in Medical Imaging: Medical image reconstruction is a popular AI application due to its promise in increasing image quality while facilitating lower radiation doses and faster scanning times 2 ; 14 . Given pairs of noisy (i.e., undersampled/lower dose) and original images, these models are trained to reconstruct the original from the noisy image. Recently, unsupervised methods have also been developed that do not require paired original and noisy images 8 ; 55 ; 7 . Variations of the U-Net 44 are commonly used as the neural network architecture for reconstruction models. In addition to standard losses like mean-squared error (MSE), GAN and diffusion-based approaches are common in the field 4 ; 25 . Fairness Analysis in Medical Imaging: Research on bias in AI-driven healthcare spans various medical domains, with medical imaging receiving considerable attention. In classification tasks, biases are typically revealed by comparing performance across subgroups. Studies cover various imaging modalities, including brain MRI 54 ; 27 , chest X-rays 50 ; 20 ; 59 ; 37 , dermatology images 9 ; 22 , and retinal images 5 . They address sensitive attributes such as sex 54 , age 50 , race 50 , and skin tone 32 , evaluating disparities using performance metrics such as Area Under the Curve (AUC) 50 , or more dedicated fairness criteria 60 . In segmentation, studies have assessed segmentation performance under varying demographic distributions, such as by race and sex representation in training datasets 27 ; 34 ; 43 . Fairness Analysis of Reconstruction Models: Reconstruction model performance is typically measured using image quality metrics such as Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM). Recent studies assessing subgroup biases primarily rely on these metrics, examining how image quality varies across demographic subgroups. For instance, 16 investigated fairness in deep learning-based brain MRI reconstruction, highlighting disparities in image reconstruction quality across different demographic groups using PSNR and SSIM. Similarly, 51 explored fairness challenges and potential solutions in ultrasound computed tomography, identifying significant disparities in reconstruction performance linked to subgroup attributes. With limited available literature, bias evaluation in reconstruction models is an emerging area of research for which there is a need to study the implications of image reconstruction on downstream tasks. Bias Mitigation: In classification, substantial efforts have focused on developing bias mitigation strategies. Data-centric approaches directly modify training datasets, employing methods such as data redistribution 42 , differentiable resampling techniques 35 , harmonization of datasets 3 , and synthetic generation of diverse samples 56 . Additionally, methods like Just Train Twice (JTT) target misclassified instances to implicitly mitigate subgroup biases without explicit annotations 36 . Representation-level strategies aim to learn unbiased feature representations through explicit disentanglement. Techniques include variational autoencoders 12 , orthogonal disentanglement methods enforcing independence between sensitive attributes and task-specific features 47 ; 13 ; 9 ; 15 , and group-adaptive architectures employing demographic-specific attention mechanisms 21 . Optimization-level methods integrate fairness constraints into model training via adversarial learning, fairness-specific loss functions, or specialized training regimens. Adversarial methods discourage encoding protected attributes 61 ; 1 ; 30 ; 57 , distributionally robust optimization (Group DRO) targets worst-case subgroup performance 46 , and fairness-specific constraints can be incorporated directly into training 40 . Post-processing methods adjust model outputs after training, employing techniques such as calibration and pruning