SurvAttack: Black-Box Attack On Survival Models through Ontology-Informed EHR Perturbation

Mohsen Nayebi Kerdabadi, Arya Hadizadeh Moghaddam, Bin Liu, Mei Liu, Zijun Yao · 2024

Read SurvAttack: Black-Box Attack On Survival Models through Ontology-Informed EHR Perturbation by Mohsen Nayebi Kerdabadi, Arya Hadizadeh Moghaddam, Bin Liu, Mei Liu, Zijun Yao (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-18706.txt.

Introduction

Mohsen Nayebi Kerdabadi and co-authors attack the models hospitals use to rank patient risk. Their 2024 paper introduces SurvAttack, a black-box method for probing survival models, which forecast how urgently patients need attention from their health records.

The attacker never sees the model's innards. Instead a greedy algorithm edits medical codes across a patient's history, choosing changes that stay clinically plausible and hard to spot. A scoring blend of impact, stealth, and medical sense ranks the edits, and a survival-specific strategy targets the ranking of patients by urgency. Experiments showed the nudges reliably degrade predictions. The authors offer the tool as pre-deployment stress testing, and as a way to interrogate what these models truly rely on.

Catalog record

CREATORMohsen Nayebi Kerdabadi, Arya Hadizadeh Moghaddam, Bin Liu, Mei Liu, Zijun Yao
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-18706

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SurvAttack: Black-Box Attack On Survival Models through Ontology-Informed EHR Perturbation Mohsen Nayebi Kerdabadi, Arya Hadizadeh Moghaddam, Bin Liu, Mei Liu, Zijun Yao Abstract . Survival analysis (SA) models have been widely studied in mining electronic health records (EHRs), particularly in forecasting the risk of critical conditions for prioritizing high-risk patients. However, their vulnerability to adversarial attacks is much less explored in the literature. Developing black-box perturbation algorithms and evaluating their impact on state-of-the-art survival models brings two benefits to medical applications. First, it can effectively evaluate the robustness of models in pre-deployment testing. Also, exploring how subtle perturbations would result in significantly different outcomes can provide counterfactual insights into the clinical interpretation of model prediction. In this work, we introduce SurvAttack, a novel black-box adversarial attack framework leveraging subtle clinically compatible, and semantically consistent perturbations on longitudinal EHRs to degrade survival models’ predictive performance. We specifically develop a greedy algorithm to manipulate medical codes with various adversarial actions throughout a patient’s medical history. Then, these adversarial actions are prioritized using a composite scoring strategy based on multi-aspect perturbation quality, including saliency, perturbation stealthiness, and clinical meaningfulness. The proposed adversarial EHR perturbation algorithm is then used in an efficient SA-specific strategy to attack a survival model when estimating the temporal ranking of survival urgency for patients. To demonstrate the significance of our work, we conduct extensive experiments, including baseline comparisons, explainability analysis, and case studies. The experimental results affirm our research’s effectiveness in illustrating the vulnerabilities of patient survival models, model interpretation, and ultimately contributing to healthcare quality. 1. Introduction Mining health records uncovers valuable patterns and insights to enhance healthcare decision-making ( Choi et al., 2016 ; Hadizadeh Moghaddam et al., 2024a ; Hadizadeh Moghaddam et al., 2024b ; Moghaddam et al., 2024 ) . Mining health records uncovers valuable patterns and insights to enhance healthcare decision-making ( Choi et al., 2016 ; Hadizadeh Moghaddam et al., 2024a ; Hadizadeh Moghaddam et al., 2024b ; Moghaddam et al., 2024 ) . Survival analysis ( Cox, 1972 ) , as a significant tool for time-to-event modeling, has been widely used in mining electronic health records (EHR) to analyze the time until the occurrence of an event of interest ( Liu et al., 2018 ; Ohno-Machado, 2001 ; Katzman et al., 2018 ; Wang et al., 2019 ) . Despite extensive research on constructing more effective survival models ( Wang et al., 2019 ) , there is a growing demand for model robustness and failure analysis when facing threatening situations given the high-stakes nature of health applications. Therefore, testing through a series of practical and effective “adversarial attacks” can be a necessary step for certifying the safety and robustness of a medical decision-support model before its deployment in the real world. One of the prevalent adversarial attacks is applying a curated imperceptible perturbation ( Goldblum et al., 2022 ) to input data, to “trick” a well-trained predictive model into overturning its decisions. In survival analysis, which estimates the patient’s survival urgency and its underlying risk factors, the consequences of such attacks can be particularly severe as the patients in critical condition may lose their priority for ICU admission to the non-urgent patients. In such threatening situations, survival models are usually the “black-box” where adversaries lack knowledge of the model’s architecture and parameters and cannot make any alterations to the model. Thus, the attack actions would solely fall on the input data. Studying adversarial attacks on survival models in this “black-box” setting can be beneficial in three ways. First, this is one of the most practical means to initialize an attack which requires almost the lowest level of model access - inference. Therefore, the framework to study can account for a major portion of realistic threats. Second, studying how these models get “fooled” by making minimal changes to the input is an effective approach to illustrate the inherent vulnerabilities of the model, prompting preemptive measures to avoid such high-risk failure in deployment. Third, such attacks can offer explainability insights into the turning points and sensitive decision boundaries in the survival model’s decision-making process since they can pinpoint the critical positions along the EHR history. Although studies on adversarial attacks initially emerged in image recognition ( Goodfellow et al., 2014 ; Papernot et al., 2016a ; Carlini and Wagner, 2017 ; Moosavi-Dezfooli et al., 2016 ) , and later extended to more tasks such as natural language processing ( Ebrahimi et al., 2017 ; Zang et al., 2019 ; Ren et al., 2019 ) , the study of such attacks on healthcare modeling ( Sun et al., 2018 ; An et al., 2019 ; Ye et al., 2022b ) , specifically for the task of survival models within the context of longitudinal health records, still remains highly unexplored. To bridge this research gap, there are two pressing challenges. The first challenge is posed by the uniqueness of longitudinal EHR data. Generally, EHR data intrinsically exhibit a high-dimensional, discrete, and sparse feature space, where each patient instance consists of a temporal sequence of medical visits and each visit is associated with an unordered set of medical codes. Hence, unlike attacking image data where small amounts of numerical noise can be added to pixels, attacking EHR data takes an entire code as the smallest units of perturbation, such as removing or replacing an existing code or adding a new one. This different way of input perturbation introduces a higher difficulty of keeping the poisoned EHR sequence after manipulation clinically consistent with the original one. One naive solution is to count the number of codes being perturbed in a sequence, where more codes changed means lower clinical similarity before and after perturbation. However, given the diverse information each code carries and the varying time steps each code locates, choosing different codes to perturb would inevitably make an unequal impact on the “health landscape” of a patient. Therefore, how to keep the EHR perturbations aligned with the patient’s health trajectory, and keep the perturbations conformed to clinical reality is a major challenge for designing adversarial attacks on EHR-based tasks. Otherwise, the required attack’s stealthiness is compromised. The second challenge involves the distinct goal in survival analysis. Although survival analysis is generally seen as building a predictive model for “time to event”, it is not merely a regression model because of the existence of censored data. The censored data refers to the patients whose event occurrences were not observed, for instance, due to the limited observation period or patient withdrawal during the study or hospitalization. Instead, we have a weaker label as “length of survival” since at least we know they survived (the event did not happen) till some point. Therefore, on top of the regression task for observed patients (uncensored), survival models perform a ranking task to prioritize all patients (uncensored and censored) according to the predicted survival risk or duration. Due to serving a different goal from traditional supervised classification or regression tasks, survival models, a semi-supervised task, are evaluated by different metrics, such as the ranking-based c-index measuring how well the model can correctly rank a pair of patients by their relative survival risks. Therefore, how to effectively attack the input data not only to downgrade

Read the complete text