Longitudinal Mammogram Exam-based Breast Cancer Diagnosis Models: Vulnerability to Adversarial Attacks
Zhengbo Zhou ⋆ Degan Hao ⋆ Dooman Arefan † Margarita Zuley † Jules Sumkin † Shandong Wu ⋆†§ · 2024
Read Longitudinal Mammogram Exam-based Breast Cancer Diagnosis Models: Vulnerability to Adversarial Attacks by Zhengbo Zhou ⋆ Degan Hao ⋆ Dooman Arefan † Margarita Zuley † Jules Sumkin † Shandong Wu ⋆†§ (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00837.txt.
Description
Abstract In breast cancer detection and diagnosis, the longitudinal analysis of mammogram images is crucial. Contemporary models excel in detecting temporal imaging feature changes, thus enhancing the learning process over sequential imaging exams. Yet, the resilience of these longitudinal models against adversarial attacks remains underexplored.
Catalog record
| CREATOR | Zhengbo Zhou ⋆ Degan Hao ⋆ Dooman Arefan † Margarita Zuley † Jules Sumkin † Shandong Wu ⋆†§ |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-00837
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Longitudinal Mammogram Exam-based Breast Cancer Diagnosis Models: Vulnerability to Adversarial Attacks Zhengbo Zhou ⋆ Degan Hao ⋆ Dooman Arefan † Margarita Zuley † Jules Sumkin † Shandong Wu ⋆†§ Abstract In breast cancer detection and diagnosis, the longitudinal analysis of mammogram images is crucial. Contemporary models excel in detecting temporal imaging feature changes, thus enhancing the learning process over sequential imaging exams. Yet, the resilience of these longitudinal models against adversarial attacks remains underexplored. In this study, we proposed a novel attack method that capitalizes on the feature-level relationship between two sequential mammogram exams of a longitudinal model, guided by both cross-entropy loss and distance metric learning, to achieve significant attack efficacy, as implemented using attack transferring in a black-box attacking manner. We performed experiments on a cohort of 590 breast cancer patients (each has two sequential mammogram exams) in a case-control setting. Results showed that our proposed method surpassed several state-of-the-art adversarial attacks in fooling the diagnosis models to give opposite outputs. Our method remained effective even if the model was trained with the common defending method of adversarial training. 1 Introduction Mammography-based AI is at the forefront of medical AI research and many AI products are being translated for clinical deployment. The cyber-security of such models is therefore becoming a paramount need to ensure AI integrity. Although medical IT system is relatively closed, but cyber-attacks still occur, quite often, through infiltration of the IT systems [ 1 ] or by internal hackers [ 2 ] . For example, hospitals had to pay ransom when their data are hacked [ 3 ] . In fact, 94 % of U.S. hospitals are affected by healthcare data breaches [ 4 ] , showing high vulnerability and risks to adversarial attacks. As elucidated in [ 5 ] , adversarial attacks can occur with real world bad intentions for data-based ransom, insurance fraud, clinical trial effect manipulation, etc. In clinical radiology, the established practice of comparing prior data with current data serves as a cornerstone for radiologists to perform lesion detection and diagnosis. The emergence of deep learning models has refined this process by integrating temporal sequential data, such as using multiple mammograms, magnetic resonance imaging, computed tomography, etc., as model inputs. Recent evidences indicate that these longitudinal models outperform those relying solely on a single time-point input. Cui et al. [ 6 ] shows that applying convolutional neural networks to follow-up MRI scans can effectively diagnose Alzheimer’s disease. Dadsetan et al. [ 7 ] proposes a novel deep learning model on longitudinal mammogram showing superior effects compared to the model using a single exam. Lee et al. [ 8 ] leverages a Transformer decoder to incorporate prior images showing improved performance on breast cancer risk prediction. In the biomedical domain, longitudinal models using sequential imaging scans are gaining popularity, where these models are effective by utilizing spatiotemporal relationships of longitudinal data. Adversarial attacks on models using an individual time-point scans have received considerable attention [ 9 ] . However, there has been little to none exploration into attacks on longitudinal models. In this work, we focus on the task of diagnosing breast cancer through a Transformer decoder architecture [ 10 ] using sequential mammogram exams. We examine the susceptibility of this longitudinal model to adversarial attacks. We propose a novel attack method tailored to combine cross-entropy loss (to guide adversarial samples across the decision boundary) and distance metric learning (to modify the relationship between sequential imaging exams), aiming to fool the diagnosis models to give rise to an opposite output. We followed the attack transferring scheme and showed through experiments that, even when adversarial training is employed to enhance the model’s robustness, our attacking method can still effectively degrade the model’s performance. Our method also outperforms several other compared methods. Our study highlights a significant vulnerability of longitudinal models to adversarial attacks, which urges the needs of enhancing such model’s safety against adversarial attacks. The contributions of our work can be summarized as: (1) We studied a novel topic of investigating adversarial attacks on longitudinal imaging-based diagnostic models; (2) We evaluated the method of integrating cross-entropy loss with distance metric learning to implement the attack, which exhibited stronger attaching effects in leading to misclassification of breast cancer, compared to several state-of-the-art attack techniques; and (3) We showed that in distance metric learning, medical knowledge can be leveraged in selecting effective adversarial samples aiming to fool a diagnosis model. 2 Related Work Adversarial Attack Methods: Szegedy et al [ 11 ] showed that classifiers may confidently make incorrect predictions when subjected to imperceptible perturbations. Kurakin et al. [ 12 ] showed that classifiers remain vulnerable to adversarial samples even in the physical world. Goodfellow et al. [ 13 ] propose FGSM, a simple and efficient adversarial samples generating method. In addition, Basic Iterative Method (BIM) [ 14 ] is proposed as an extension of the Fast Gradient Sign Method (FGSM) and aims to generate stronger adversarial samples by iteratively applying FGSM with smaller perturbation steps. Benefiting from the iteration strategy, MI-FGSM is proposed by adding momentum through iterations [ 15 ] . The Projected Gradient Descent (PGD) attack [ 16 ] is another popular and powerful attack method. On the other hand, optimization-based C&W attack [ 17 ] treat the adversarial sample generation as an optimization problem. Attack Transferability: The vulnerability of models to adversarial samples generated by other models is known as the transferability of adversarial attacks [ 11 ] . Kurakin et al. [ 12 ] conducted a study on adversarial samples within the context of ImageNet. Their found that BIM’s multi-step approach is less transferable than the single-step FGSM. Zhou et al. [ 18 ] showed that enhancing the transferability of the BIM can be achieved by maximizing the distance between natural images and their adversarial counterparts within the intermediate feature maps, coupled with the addition of regularization. The transferability of a single-input model to longitudinal models is an interesting approach but not yet studied in the literature. Defense Methods: Hinton et al. [ 19 ] introduced distillation as a method to bolster resistance against adversarial samples. The adversarial training method involves incorporating adversarial samples into the training set to enhance model robustness through retraining [ 12 ] . Tramèr et al. [ 20 ] expanded on this approach with ensemble adversarial training, augmenting training data with perturbations transferred from other models. In general, adversarial training is a common defending method for adversarial attacks. Figure 1 : Adversarial attacks transferred from a source model (a single input, Current) to a target model (two sequential input, Prior and Current) for breast cancer diagnosis. 3 Methods 3.1 Task and Model Architecture Task. In this study, we implemented our novel method on the task of diagnosing breast cancer on mammograms (i.e., classification of cancer cases vs. normal controls). The diagnosis can be based on a single time-point exam or multiple longitudinal exams that leverage temporal information to improve diagnosis accuracy. Thus, we designed two models: Source model (using a single time-point mammogram exam, denoted as Current) and Target model (using two sequential exams, denoted as Prior and Current, respectively, which are taken at two different time points). The Source model is useful when