Crossfire: An Elastic Defense Framework for Graph Neural Networks under Bit Flip Attacks
Lorenz Kummer, Samir Moustafa, Wilfried N. Gansterer, Nils Kriege · 2025
Read Crossfire: An Elastic Defense Framework for Graph Neural Networks under Bit Flip Attacks by Lorenz Kummer, Samir Moustafa, Wilfried N. Gansterer, Nils Kriege (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13776.txt.
Introduction
Lorenz Kummer, Samir Moustafa, Wilfried Gansterer, and Nils Kriege present Crossfire, a defense for graph neural networks in 2025. Bit flip attacks alter a few stored bits to sabotage a network. Such attacks, built for vision models, now hit graph models too, and no defense existed for them.
Older tricks from vision work, like hashing and honeypots, fall short on graphs when tested alone. Crossfire blends both with bit-level repair of odd weights, exploiting natural weight sparsity. It needs no retraining and no labeled data. Across 2,160 trials, it restored attacked networks to their prior state far more often than rivals, and lifted post-repair accuracy as well.
Catalog record
| CREATOR | Lorenz Kummer, Samir Moustafa, Wilfried N. Gansterer, Nils Kriege |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-13776
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Crossfire: An Elastic Defense Framework for Graph Neural Networks under Bit Flip Attacks Lorenz Kummer, Samir Moustafa, Wilfried N. Gansterer, Nils Kriege Abstract Bit Flip Attacks (BFAs) are a well-established class of adversarial attacks, originally developed for Convolutional Neural Networks within the computer vision domain. Most recently, these attacks have been extended to target Graph Neural Networks (GNNs), revealing significant vulnerabilities. This new development naturally raises questions about the best strategies to defend GNNs against BFAs, a challenge for which no solutions currently exist. Given the applications of GNNs in critical fields, any defense mechanism must not only maintain network performance, but also verifiably restore the network to its pre-attack state. Verifiably restoring the network to its pre-attack state also eliminates the need for costly evaluations on test data to ensure network quality. We offer first insights into the effectiveness of existing honeypot- and hashing-based defenses against BFAs adapted from the computer vision domain to GNNs, and characterize the shortcomings of these approaches. To overcome their limitations, we propose Crossfire, a hybrid approach that exploits weight sparsity and combines hashing and honeypots with bit-level correction of out-of-distribution weight elements to restore network integrity. Crossfire is retraining-free and does not require labeled data. Averaged over 2,160 experiments on six benchmark datasets, Crossfire offers a 21.8% higher probability than its competitors of reconstructing a GNN attacked by a BFA to its pre-attack state. These experiments cover up to 55 bit flips from various attacks. Moreover, it improves post-repair prediction quality by 10.85%. Computational and storage overheads are negligible compared to the inherent complexity of even the simplest GNNs. 1 Faculty of Computer Science, University of Vienna, Vienna, Austria 2 Doctoral School Computer Science, University of Vienna, Vienna, Austria 3 Research Network Data Science University of Vienna, Vienna, Austria {lorenz.kummer, samir.moustafa, wilfried.gansterer, nils.kriege}@univie.ac.at Introduction Graph Neural Networks (GNNs) are effective machine learning methods for processing structured data in graph format, consisting of nodes and edges. They demonstrate versatility by enabling the application of deep learning in diverse domains such as finance, social networks, medicine, chemistry, and biological data analysis ( Lu and Uddin 2021 ; Cheung and Moura 2020 ; Sun et al. 2021 ; Wu et al. 2018 ; Xiong et al. 2021 ) . As GNNs become more widely used, it is crucial to examine their potential security vulnerabilities. Conventional adversarial attacks on GNNs primarily involve manipulating input graph data ( Wu et al. 2022 ) . These attacks include poisoning, which leads to the learning of flawed models ( Ma, Ding, and Mei 2020 ; Wu et al. 2022 ) , and evasion strategies, which use adversarial examples to impair inference. Such attacks on GNNs, which involve altering node features, edges, or introducing new nodes ( Sun et al. 2020 ; Wu et al. 2022 ) , as discussed in prior studies ( Ma, Ding, and Mei 2020 ) , can be either targeted or untargeted. Targeted attacks reduce the model’s prediction quality on specific instances, whereas untargeted attacks affect the model’s overall performance ( Zhang et al. 2022a ) . For a thorough overview of graph poisoning and evasion attacks, along with defenses and relevant algorithms, refer to the detailed reviews by Jin et al. (2021) and Dai et al. (2022) . Recent research on GNN vulnerability has expanded beyond poisoning and evasion attacks on input graphs, now encompassing systematic attacks that directly manipulate network weights through malicious bit flips during inference. While such attacks are well-understood for Convolutional Neural Networks (CNNs) in computer vision ( Rakin, He, and Fan 2019 ; Qian et al. 2023 ; Khare et al. 2022 ) , understanding GNN vulnerability to BFAs is a relatively new area of study. Currently, only one dedicated BFA for GNNs has been described by Kummer et al. (2024) , and existing defenses against BFAs ( Khare et al. 2022 ) have not been evaluated for GNNs. To the best of our knowledge, the topic of defending GNNs against BFAs has not yet been addressed in the literature. Given the fundamental differences between GNNs and CNNs – such as GNNs’ reliance on the message-passing algorithm (MP) to process graph-structured data and the lack of vulnerable convolutional filters ( Hector et al. 2022 ) – as well as distinct properties like expressivity that can be exploited by attackers ( Kummer et al. 2024 ) , it is essential to explore whether existing CNN defenses against BFAs are applicable to GNNs. Moreover, it is crucial to develop defenses specifically designed for GNNs, given the importance of their applications across multiple domains. In the following, we assume a white-box threat model to evaluate CNN defenses against BFAs on GNNs and introduce our approach, considering an attacker who can precisely manipulate bits without budget constraints. Related Work The BFA initially presented in Rakin, He, and Fan (2019) , targets a quantized CNN by conducting a single forward-backward pass using a randomly selected training data batch, without updating the weights. It identifies the top- k binary gradient bits as potential bit-flip candidates. These bits are then flipped iteratively to maximize the loss (using the same loss function as in training) until the desired network degradation is achieved. This original BFA is termed Progressive BFA (PBFA). We use BFA to refer to a broader range of attacks that systematically induce malicious bit flips in a neural network’s weights and biases, and refer the interested reader to the comprehensive survey for BFAs on CNNs by Qian et al. (2023) . For GNNs, only a single dedicated BFA has been explored so far, termed Injectivity Bit Flip Attack (IBFA), which exploits certain properties related to GNN expressivity by Kummer et al. (2024) . To defend against BFAs on CNNs, several approaches have been proposed. Network hardening methods, such as adversarial ( He et al. 2020 ; Li et al. 2020a ) and perturbation-resilient training ( Chitsaz et al. 2023 ) , as well as gradient obfuscation strategies ( Zhang et al. 2022b ; Wang et al. 2023a ) , focus on resisting gradient-based bit search attacks. However, they may require (re)training, which limits their ex-post deployment, and they do not necessarily rectify compromised neurons. Detection-focused methods leverage hashing ( Javaheripi and Koushanfar 2021 ; Li et al. 2021 ) or output code matching ( Özdenizci and Legenstein 2022 ) for efficient bit flip detection and consistently achieve high detection rates in the computer vision domain. These methods often wrap around existing pre-trained networks and can be applied ex-post. However, their restoration capabilities are limited, often necessitating retraining or pruning of manipulated weights. Proactive defenses take a different approach by anticipating attacks through analyzing assumed underlying attack mechanisms ( Liu et al. 2023 ; Li et al. 2020a ) . These methods prioritize weight restoration over pruning, aiming to revert the network to its pre-attack configuration ( Liu et al. 2023 ) , or use statistical approximation to address compromised weights ( Li et al. 2020a ) . For an overview of defense mechanisms, see the review by Khare et al. (2022) . Challenges and Limitations Existing defenses against BFAs face shared challenges and limitations. First, they lack mechanisms to ensure full network restoration after attacks; while