β \beta -GNN: A Robust Ensemble Approach Against Graph Structure Perturbation

Haci Ismail Aslan, Philipp Wiesner, Ping Xiong, Odej Kao · 2025

Read β \beta -GNN: A Robust Ensemble Approach Against Graph Structure Perturbation by Haci Ismail Aslan, Philipp Wiesner, Ping Xiong, Odej Kao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20630.txt.

Introduction

Haci Ismail Aslan and three co-authors present a robust ensemble for graph neural networks in this 2025 paper. Graph networks serve scheduling, anomaly detection, and resource management in computing systems. Their weak point is the graph itself: small attacks or noise in the links can wreck their output. Their model, called β-GNN, pairs any graph network with a plain perceptron in a weighted blend. A learned weight, beta, sets how much the graph network counts.

That weight doubles as a gauge of how perturbed the data look, which lets the system react early. Tests on varied data sets showed stronger accuracy under attack than rivals, plus a usable estimate of attack severity. The design assumes nothing about the attack in advance. Clean data scores held up, since the blend leans on the graph network when the input looks clean.

Catalog record

CREATORHaci Ismail Aslan, Philipp Wiesner, Ping Xiong, Odej Kao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-20630

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

β \beta -GNN: A Robust Ensemble Approach Against Graph Structure Perturbation Haci Ismail Aslan, Philipp Wiesner, Ping Xiong, Odej Kao Abstract . Graph Neural Networks (GNNs) are playing an increasingly important role in the efficient operation and security of computing systems, with applications in workload scheduling, anomaly detection, and resource management. However, their vulnerability to network perturbations poses a significant challenge. We propose β \beta -GNN, a model enhancing GNN robustness without sacrificing clean data performance. β \beta -GNN uses a weighted ensemble, combining any GNN with a multi-layer perceptron. A learned dynamic weight, β \beta , modulates the GNN’s contribution. This β \beta not only weights GNN influence but also indicates data perturbation levels, enabling proactive mitigation. Experimental results on diverse datasets show β \beta -GNN’s superior adversarial accuracy and attack severity quantification. Crucially, β \beta -GNN avoids perturbation assumptions, preserving clean data structure and performance. Conference: The 5th Workshop on Machine Learning and Systems ; March 30-April 3, 2025; Rotterdam, Netherlands The 5th Workshop on Machine Learning and Systems (EuroMLSys ’25), March 30-April 3, 2025, Rotterdam, Netherlands DOI: 10.1145/3721146.3721949 ISBN: 979-8-4007-1538-9/2025/03 CCS: Computing methodologies Ensemble methods CCS: Mathematics of computing Graph algorithms † † cc-license: by 1. Introduction GNN applications are rapidly expanding due to advancements in GNN generalization. By leveraging both node attributes and the topology, GNNs perform downstream tasks (i.e., node classification) more effectively than other models ( Di Massa et al., 2006 ) . Computing systems increasingly rely on reliable and robust GNNs to improve efficiency in operation as well as security, for example in network intrusion detection ( Bilot et al., 2023 ) , workload scheduling ( Liu and Huang, 2023 ) , social networks ( Fan et al., 2019 ) , transportation systems ( Rahmani et al., 2023 ) , or chip placement ( Mirhoseini et al., 2021 ) . A key challenge to achieving this robustness lies in the demonstrated vulnerability of GNNs to adversarial attacks. Recent studies have substantiated these vulnerabilities, showing how attacks can manipulate the graph structure by adding adversarial noise to node features or manipulating edges via rewiring ( Dai et al., 2024 ; Zügner et al., 2018 ; Zügner and Günnemann, 2019 ) . This vulnerability has driven research into GNN robustness, with approaches ranging from model-centric enhancements to data-centric adversarial training. While these strategies aim to mitigate the impact of attacks, they often suffer from drawbacks, notably scalability issues ( Geisler et al., 2021 ) , which persist despite the advancements achieved in training GNNs at scale ( Yang et al., 2022 ) . Furthermore, many existing methods focus on reacting to perturbations rather than detecting them. This reactive approach can lead to unnecessary graph cleaning operations, potentially distorting clean graphs and yielding suboptimal results. In this work, we introduce \beta -GNN, a solution that addresses these limitations. \beta -GNN enhances the robustness of GNNs by integrating any GNN model with a multi-layer perceptron (MLP) in a weighted ensemble. Unlike existing methods, \beta -GNN learns a dynamic weighting factor, denoted as \beta , which adjusts the contribution of the GNN model in the final prediction layer. This not only improves the model’s ability to withstand adversarial attacks but also provides an interpretable metric for quantifying the severity of perturbations in the data. Practitioners can leverage this information to take preventive actions when the data is highly perturbed, thus offering a proactive approach to GNN robustness. Our key contributions are as follows. • We propose \mathbf{\beta} -GNN, a flexible and modular framework applicable to any GNN architecture. We introduce \mathbf{\beta} as a learned parameter that balances model performance and robustness, serving as a diagnostic tool for assessing graph perturbation severity. • We conduct extensive experiments on both homophilic and heterophilic datasets, demonstrating that \beta -GNN achieves state-of-the-art results in terms of node classification accuracy under adversarial conditions. • We provide a thorough analysis of the learned \beta values, illustrating how they can be used to track the severity of attacks and guide response strategies. The reported results can be reproduced using our open-source implementation 1 1 1 https://github.com/AslantheAslan/beta-GNN . The remainder of this paper is structured as follows: In Section 2, we review the related work and motivation of this study. Section 3 introduces the \beta -GNN model architecture and its training process. Section 4 presents experimental results and analysis. Section 5 concludes the paper. 2. Related Work Adversaries can subtly perturb graph structures or node features, leading to significant performance degradation in tasks like node classification and link prediction. In particular, poisoning attacks, where the graph is manipulated during the training phase, resulting in poor performance during inference, have been a primary focus of recent research. For instance, Nettack ( Zügner et al., 2018 ) introduced a targeted poisoning attack designed to modify both the graph structure and node features. The method seeks to alter a minimal number of edges and features to misclassify a specific node, without significantly disrupting the overall structure of the graph. Nettack formulates the attack as a bi-level optimization problem where the GNN is first trained on the poisoned graph, and the adversary then evaluates how modifications affect classification performance. An extended version of Nettack, called Metattack ( Zügner and Günnemann, 2019 ) , on the other hand, proposes a more general and scalable poisoning attack by formulating the problem as meta-learning ( Andrychowicz et al., 2016 ) , where the adversarial perturbations are optimized in a meta-gradient approach. Unlike Nettack, Metattack is untargeted and attacks the entire graph. In response to vulnerabilities exposed by adversarial attacks, several defense strategies have been proposed to enhance the robustness of GNNs. These methods either aim to detect and remove the adversarial perturbations or to strengthen the GNN model itself. To filter out potential adversarial edges before training, GCN-Jaccard ( Wu et al., 2019 ) calculates the Jaccard similarity between feature sets of connected nodes and removes edges with low similarity. This approach assumes that adversarial edges are more likely to connect dissimilar nodes, however, it causes problems if the adversarial influence is the opposite, or the data itself is heterophilic. Pro-GNN ( Jin et al., 2020 ) adopts a two-step approach that combines graph structure learning with adversarial robustness. It formulates the defense as a joint optimization problem, denoising the graph using low-rank approximation and sparsity constraints while training a robust GNN. However, Pro-GNN may remove essential structural information along with perturbations, potentially degrading performance on the original graph. Similarly, since adversarial attacks mainly affect high-rank properties, constructing a low-rank graph via truncated singular value decomposition (TSVD) ( Entezari et al., 2020a ) improves GNN robustness. This idea is further refined through reduced-rank topology learning, which preserves only the dominant singular components of the adversarial adjacency matrix to maintain the graph spectrum. Alongside methods that mitigate adversarial impact on graphs, training-based approaches have also advanced GNN robustness. RGCN ( Zhu et al., 2019 ) assigns latent variables to nodes, sampling representations from a Gaussian distribution to enhance robustness and diversity in feature aggregation. Similarly, GNNGuard ( Zhang and Zitnik, 2020 ) modifies message passing, reducing the influence of suspicious nodes during aggregation. Although these methods improve GNN robustness, they have disadvantages in practice.

Read the complete text