Differential Privacy for Deep Learning in Medicine

Marziyeh Mohammadi, Mohsen Vejdanihemmat, Mahshad Lotfinia, Mirabela Rusu, Daniel Truhn, Andreas Maier, Soroosh Tayebi Arasteh · 2025

Read Differential Privacy for Deep Learning in Medicine by Marziyeh Mohammadi, Mohsen Vejdanihemmat, Mahshad Lotfinia, Mirabela Rusu, Daniel Truhn, Andreas Maier, Soroosh Tayebi Arasteh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00660.txt.

Introduction

Marziyeh Mohammadi, Mohsen Vejdanihemmat, and colleagues review privacy protection for deep learning in medicine in a 2025 survey. Clinical models hunger for patient data, and differential privacy offers a mathematical promise that no single patient's record can be inferred from the trained model. Adding the required noise, though, costs accuracy and can unevenly hurt fairness across patient groups.

The scoping review gathers recent methods and their trade-offs, then turns to deployment: what hospitals must decide before a private model touches care. A balanced map matters because privacy rules are legal duties in medicine, not optional polish.

Catalog record

CREATORMarziyeh Mohammadi, Mohsen Vejdanihemmat, Mahshad Lotfinia, Mirabela Rusu, Daniel Truhn, Andreas Maier, Soroosh Tayebi Arasteh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00660

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Differential Privacy for Deep Learning in Medicine Marziyeh Mohammadi, Mohsen Vejdanihemmat, Mahshad Lotfinia, Mirabela Rusu, Daniel Truhn, Andreas Maier, Soroosh Tayebi Arasteh Abstract Differential privacy (DP) is a key technique for protecting sensitive patient data in medical deep learning (DL). As clinical models grow more data-dependent, balancing privacy with utility and fairness has become a critical challenge. This scoping review synthesizes recent developments in applying DP to medical DL, with a particular focus on DP-SGD and alternative mechanisms across centralized and federated settings. Using a structured search strategy, we identified 74 studies published up to March 2025. Our analysis spans diverse data modalities, training setups, and downstream tasks, and highlights the tradeoffs between privacy guarantees, model accuracy, and subgroup fairness. We find that while DP—especially at strong privacy budgets—can preserve performance in well-structured imaging tasks, severe degradation often occurs under strict privacy, particularly in underrepresented or complex modalities. Furthermore, privacy-induced performance gaps disproportionately affect demographic subgroups, with fairness impacts varying by data type and task. A small subset of studies explicitly addresses these tradeoffs through subgroup analysis or fairness metrics, but most omit them entirely. Beyond DP-SGD, emerging approaches leverage alternative mechanisms, generative models, and hybrid federated designs, though reporting remains inconsistent. We conclude by outlining key gaps in fairness auditing, standardization, and evaluation protocols, offering guidance for future work toward equitable and clinically robust privacy-preserving DL systems in medicine. 1 Introduction Deep learning (DL) has become a cornerstone of modern medical artificial intelligence (AI), driving advances in diagnostic imaging, survival prediction, biosignal analysis, and electronic health record (EHR) modeling Rajpurkar et al. 2022 ; Tayebi Arasteh et al. 2024 ; Haug and Drazen 2023 . However, the deployment of DL models in clinical settings raises critical concerns regarding patient privacy Kaissis et al. 2021 . Medical data are inherently sensitive, and DL models trained on such data are vulnerable to various privacy attacks—including membership inference, model inversion, and identity disclosure—potentially exposing the presence or characteristics of individual patients in the training set Tayebi Arasteh et al. 2024 ; Usynin et al. 2021 ; Wang et al. 2021 ; Haim et al. 2022 ; Carlini et al. 2023 . Differential privacy (DP) Dwork and Roth provides formal guarantees to protect individuals within a dataset by bounding the influence of any single record on the model’s output. In DL, this is commonly implemented via differentially private stochastic gradient descent (DP-SGD) Abadi et al. 2016 , which injects noise into clipped gradients during training (Fig. 1 ). Despite its theoretical strength, practical deployment of DP in healthcare DL introduces key trade-offs: noise reduces model utility and may disproportionately affect underrepresented subgroups, potentially reinforcing existing healthcare inequities Tran et al. 2021 ; Tayebi Arasteh et al. 2023 ; Tayebi Arasteh et al. 2024 . To better understand the state of DP in clinical DL, we conduct a comprehensive scoping review of empirical studies that apply DP mechanisms in medical contexts. While several prior reviews address DP broadly or focus on applications in generic domains, no existing synthesis systematically evaluates how DP interacts with clinical data, model design, privacy-utility trade-offs, fairness impacts, or adversarial robustness. To guide our review, we investigate the following research questions: RQ1: To what extent do medical DL models leak sensitive information, and under what conditions are privacy breaches most likely? RQ2: How effectively do DP-based methods mitigate membership inference and other privacy attacks in healthcare applications? RQ3: What are the empirical impacts of DP on model performance, fairness, and clinical applicability in real-world scenarios? This scoping review aims to critically synthesize current knowledge, identify key challenges and opportunities, and provide practical guidance for future research and clinical practice involving privacy-preserving DL models in medicine. In the following sections, we first review the applications of DP across clinical DL tasks, covering data modalities, training settings, and privacy accounting methods. We then analyze how architectural choices, normalization strategies, and pretraining affect the privacy-utility tradeoff, with a focus on model performance across varying privacy budgets. Next, we examine fairness impacts, highlighting subgroup disparities, the metrics used to evaluate them, and gaps in current practices. We also survey alternative privacy mechanisms beyond DP-SGD, including federated learning (FL), local perturbation, and hybrid methods. Finally, we synthesize empirical findings on privacy attacks and defenses, before concluding with a discussion of key limitations, open challenges, and recommendations for building robust, equitable, and privacy-preserving AI systems in medicine. Figure 1: Overview of privacy risks and defenses in different phases of medical deep learning. (a) During model training, raw patient data—collected from clinical sources—can be vulnerable to leakage if accessed by unauthorized parties. Differential privacy is applied at this stage, typically by injecting noise into model gradients, to prevent individual data from being memorized. (b) After deployment, the trained model is exposed to potential inference attacks, such as membership inference, where adversaries aim to determine if specific individuals were in the training set. Models trained with differential privacy are more resistant to such attacks, enhancing patient confidentiality throughout the model lifecycle. 2 Methods This scoping review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guidelines Tricco et al. 2018 ; Page et al. 2021 to ensure methodological rigor and transparency Buess et al. 2025 . The complete PRISMA-ScR checklist is provided in Supplementary Table 1. The methodological approach to data collection, article selection, and results synthesis is described in detail below. 2.1 Eligibility Criteria Any study was eligible if it was published on or before March 1, 2025, and explicitly focused on empirical applications of DP in conjunction with DL methods for healthcare-related tasks. Eligible articles included original peer-reviewed journal papers, conference proceedings, and impactful preprints in English. Studies purely theoretical in nature or without explicit medical or clinical applications were excluded. Review articles, editorials, and commentaries were also excluded to focus exclusively on primary empirical contributions. 2.2 Information Sources We systematically searched four electronic databases: PubMed, IEEE Xplore, ACM Digital Library, and Web of Science. Database queries were performed on March 1, 2025, and search results were imported into Rayyan software Ouzzani et al. 2016 , a tool designed to facilitate the systematic screening of literature and duplicate removal. A detailed description of the database-specific search queries is provided in Supplementary Table 2. 2.3 Search Strategy The search strategy was carefully designed to identify publications at the intersection of DP, DL, and medical applications. Specifically, the search strings combined three primary keyword groups: (1) differential privacy techniques (e.g., “differential privacy,” “differentially private,” “DP-SGD”), (2) deep learning and related machine learning methodologies (e.g., “deep learning,” “machine learning,” “neural network,” “artificial intelligence”), and (3) healthcare and clinical applications (e.g., “medical,” “clinical,” “healthcare,” “biomedical,” “EHR,” “imaging,” “radiology,” “text,” “speech”). Each database query was adapted to database-specific indexing conventions to maximize search sensitivity. The comprehensive queries and exact search strings used, along with the number of articles retrieved from each database, are summarized in Supplementary Table 2. Additionally, manual searches were conducted by screening reference lists from key articles and reviewing recent preprints and related studies to capture any relevant works missed by the database searches. 2.4 Inclusion and Exclusion Criteria The literature selection involved multiple screening steps: (1) Initial

Read the complete text