SCL-GNN: Towards Generalizable Graph Neural Networks via Spurious Correlation Learning

Yuxiang Zhang, Enyan Dai · 2026

Read SCL-GNN: Towards Generalizable Graph Neural Networks via Spurious Correlation Learning by Yuxiang Zhang, Enyan Dai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08270.txt.

Introduction

Zhang and colleagues present SCL-GNN, a graph neural network designed to generalize better by learning spurious correlations. Graph neural networks succeed across many tasks, but their reach suffers when node features and labels share spurious correlations in the graph. The authors show these networks exploit imperceptible statistical links in training data, even when those links mislead prediction. SCL-GNN uses the Hilbert-Schmidt Independence Criterion to measure links between node representations and class scores, letting the model spot and mitigate influential but irrelevant links.

Catalog record

CREATORYuxiang Zhang, Enyan Dai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35008
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08270

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SCL-GNN: Towards Generalizable Graph Neural Networks via Spurious Correlation Learning Yuxiang Zhang, Enyan Dai Abstract Graph Neural Networks (GNNs) have demonstrated remarkable success across diverse tasks. However, their generalization capability is often hindered by spurious correlations between node features and labels in the graph. Our analysis reveals that GNNs tend to exploit imperceptible statistical correlations in training data, even when such correlations are unreliable for prediction. To address this challenge, we propose the Spurious Correlation Learning Graph Neural Network (SCL-GNN), a novel framework designed to enhance generalization on both Independent and Identically Distributed (IID) and Out-of-Distribution (OOD) graphs. SCL-GNN incorporates a principled spurious correlation learning mechanism, leveraging the Hilbert-Schmidt Independence Criterion (HSIC) to quantify correlations between node representations and class scores. This enables the model to identify and mitigate irrelevant but influential spurious correlations effectively. Additionally, we introduce an efficient bi-level optimization strategy to jointly optimize modules and GNN parameters, preventing overfitting. Extensive experiments on real-world and synthetic datasets demonstrate that SCL-GNN consistently outperforms state-of-the-art baselines under various distribution shifts, highlighting its robustness and generalization capabilities. 1 Introduction Graph Neural Networks (GNNs) 19 ; 32 have emerged as powerful models for learning from graph data across various tasks 1 ; 5 ; 26 . The standard learning paradigm for GNNs involves optimizing parameters on training graphs to make predictions on unseen testing graphs. With the increasing need to handle graphs with diverse sources, improving the generalization of GNNs has become a central focus in the graph learning community. However, recent studies indicate that spurious correlations are prevalent in machine learning 17 ; 42 ; 38 , often compromising the generalization of deep neural networks 6 ; 20 . In GNNs, the issues are particularly severe due to the complex non-Euclidean structure of graph data and the message-passing mechanism. Furthermore, unlike standard data modalities (e.g., text and images) where samples are typically treated independently 33 ; 11 , the intricate inter-dependencies within graph data (e.g., dense node clusters) significantly increase the difficulty of identifying and mitigating spurious correlations 36 ; 35 . Figure 1: An illustration of node classification task on an academic network for GNNs. (a) The task aims to classify the label y of target node v based on the compact graph \mathcal{G}_{v}=\{\mathbf{A}_{v},\mathbf{X}_{v} } consisting of its neighbors. (b) Four existing relations and the notion in the network example, only the AI researcher feature of the collaborator has a positive influence for predicting that the researcher also researches AI. (c) Description and comparison of the workflow of SCL-GNN and existing works. We virtually split features into spurious and stable sets. We propose a more effective method to achieve the same goal by spurious correlation learning, instead of importing complex probability computation. Recent studies show that GNN generalizability degrades primarily because models learn correlations between irrelevant representations and category labels 2 ; 9 ; 3 ; 38 . However, existing solutions mainly target Out-of-Distribution (OOD) generalization. They often ignore the spurious correlations present in Independent and Identically Distributed (IID) scenarios, which limits their practical applicability. Consider a node classification task in an academic network in Fig. 1 , where nodes are researchers, edges are collaborations, and the target label y is whether a researcher specializes in AI. GNNs typically rely on stable correlations, such as the actual relationship between a researcher’s collaborators and their own field 34 . Yet, they also absorb spurious correlations, such as a coincidental link between being a student and studying AI. In an IID setting, an industry researcher collaborating with both an AI expert and an engineer might be misclassified simply because they lack the ”student” attribute. This problem worsens under OOD conditions where these spurious correlations shift or disappear entirely (e.g., observing no students in industry settings), leading to systematic mispredictions as detailed in Sec. 5.2 . Consequently, there is a clear need for GNNs equipped to identify and mitigate spurious correlations across both IID and OOD settings. Nevertheless, a significant challenge lies in identifying and mitigating the generation of spurious correlations from the broader set of statistical correlations, which are inherently intertwined with the learning mechanisms of Graph Neural Network (GNN) models. To illustrate this, we present an example with Fig. 1 : the marginal probabilities for a researcher’s collaborators have an interest in researching AI , i.e. stable correlation, and a researcher’s collaborator is a student , i.e. spurious correlation, are both high for the GNN model’s prediction of whether a researcher is researching AI . Additionally, the scarcity of labeled training data, compounded by the complex non-Euclidean geometric structure of graph data, further complicates the learning process. These factors collectively hinder the identification of spurious correlations, which is crucial for ensuring that GNN models avoid relying on non-generalizable patterns in graph learning. Although prior studies 9 ; 24 ; 34 have attempted to address OOD degradation of GNN, exploration of spurious correlation learning on both in-distribution (ID) and OOD samples remains nascent. This is primarily due to the non-trivial nature of the problem, which presents two key challenges: (i) How can spurious correlations be disentangled and distinguished from the broader set of statistical correlations between representations and labels? and (ii) How can sufficient and meaningful information be provided to enhance GNN learning across both ID and OOD samples, particularly in the presence of diverse distribution shifts? Motivated by the aforementioned challenges, we propose a novel S purious C orrelation L earning GNN(SCL-GNN) framework to reduce the degradation of GNNs caused by the spurious correlation and enhance the generalizability of models. SCL-GNN incorporates an intuitive yet theoretically grounded method to determine whether a correlation between a feature and the predicted label is spurious. To achieve this, we employ the Hilbert-Schmidt Independence Criterion (HSIC) 12 to quantify the independence between node representations and the class scores predicted by the model. Additionally, we utilize Gradient-weighted Class Activation Mapping (Grad-CAM) 28 ; 27 to assess the importance of node representations in influencing the expected class scores, serving as a cross-validation mechanism. These two metrics collectively measure the precise correlation between specific features and label predictions. To address spurious correlation, a novel learning objective is deployed to fine-tune the model weights through a collaborative self-supervised learning module. Our approach outperforms existing methods in decorrelating spurious relationships and significantly enhances the model’s ability to generalize across domains. To summarize, our main contributions are: (i) We study a novel problem of addressing the degradation of GNNs under distribution shift from a spurious correlation learning perspective empirically and theoretically. We ensure that GNNs trained with this learning purpose would capture the pattern of spurious correlations and mitigate the deficiency. (ii) We proposed a novel framework that can effectively learn spurious correlation and perform better under complex distribution shifts. The model in the framework utilizes adequate and rich information to avoid overfitting using the auxiliary self-supervised spurious correlation learner module that fine-tunes the model with the unobserved OOD samples. (iii) We conduct comprehensive experiments on various datasets with different distributions. The convincing results show that the SCL-GNN framework significantly outperforms competitors regarding effectiveness, flexibility, and interpretability. 2 Related Works Graph Neural Networks . GNNs have shown remarkable success in learning graph-structured data 19 , driving progress in applications like drug

Read the complete text