Towards Automated Self-Supervised Learning for Truly Unsupervised Graph Anomaly Detection
Zhong Li, Yuhang Wang, Matthijs van Leeuwen · 2025
Read Towards Automated Self-Supervised Learning for Truly Unsupervised Graph Anomaly Detection by Zhong Li, Yuhang Wang, Matthijs van Leeuwen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14694.txt.
Introduction
Zhong Li, Yuhang Wang, and Matthijs van Leeuwen present a 2025 paper on finding odd nodes in graph data. Many current methods learn from the data itself, with no labels given. The authors show that three plain choices shape how well these methods work. The choices are which self-taught task to use, how to set its dials, and how to weigh tasks when more than one is used.
Past work often picked those choices by chance or by peeking at labels. Peeking breaks the no-label rule and makes results look too good. The authors push for a fully label-free way to set the method on its own. Readers in machine learning get a frank check on past claims. They also get a path toward tools that tune themselves and can be trusted on new graph data with no labels at all.
Catalog record
| CREATOR | Zhong Li, Yuhang Wang, Matthijs van Leeuwen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-14694
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Automated Self-Supervised Learning for Truly Unsupervised Graph Anomaly Detection Zhong Li, Yuhang Wang, Matthijs van Leeuwen Abstract Self-supervised learning (SSL) is an emerging paradigm that exploits supervisory signals generated from the data itself, and many recent studies have leveraged SSL to conduct graph anomaly detection. However, we empirically found that three important factors can substantially impact detection performance across datasets: 1) the specific SSL strategy employed; 2) the tuning of the strategy’s hyperparameters; and 3) the allocation of combination weights when using multiple strategies. Most SSL-based graph anomaly detection methods circumvent these issues by arbitrarily or selectively (i.e., guided by label information) choosing SSL strategies, hyperparameter settings, and combination weights. While an arbitrary choice may lead to subpar performance, using label information in an unsupervised setting is label information leakage and leads to severe overestimation of a method’s performance. Leakage has been criticized as “one of the top ten data mining mistakes”, yet many recent studies on SSL-based graph anomaly detection have been using label information to select hyperparameters. To mitigate this issue, we propose to use an internal evaluation strategy (with theoretical analysis) to select hyperparameters in SSL for unsupervised anomaly detection. We perform extensive experiments using 10 recent SSL-based graph anomaly detection algorithms on various benchmark datasets, demonstrating both the prior issues with hyperparameter selection and the effectiveness of our proposed strategy. Manuscript accepted by Data Mining and Knowledge Discovery journal for publication (June 2025). This is a preprint version. keywords Graph Anomaly Detection, Self-Supervised Learning, Automated Machine Learning, Graph Neural Networks, Label Leakage 1 Introduction Graph anomaly detection (GAD) refers to the tasks of identifying anomalous graph objects—such as nodes, edges or sub-graphs—in an individual graph ( Akoglu et al, 2015 ; Ma et al, 2021 ) , or identifying anomalous graphs from a set of graphs ( Ma et al, 2022 ; Li et al, 2024a ) . GAD has numerous successful applications, e.g., in finance fraud detection ( Motie and Raahemi, 2023 ) , fake news detection ( Xu et al, 2022a ) , system fault diagnosis ( Li et al, 2024b ) , and network intrusion detection ( Garcia-Teodoro et al, 2009 ) . In this paper, we focus on unsupervised node anomaly detection on static attributed graphs, namely identifying which nodes in a static attributed graph are anomalous. Recently, Graph Neural Networks (GNNs) have become prevalent in detecting node anomalies in graphs and have shown promising performance ( Kim et al, 2022 ) . Specifically, GNNs can learn an embedding for each node by considering both the node attributes and the graph topological information, enabling them to capture and exploit complex patterns for anomaly detection. Like with other neural networks, the high performance of GNNs is typically achieved at the cost of a substantial volume of labeled data. However, the process of labeling graphs is often a laborious and time-consuming effort, necessitating domain-specific expertise. For these reasons, GAD is preferably tackled in an unsupervised manner, without relying on any ground-truth labels. Self-supervised learning (SSL) has emerged as a promising unsupervised learning technique on graphs ( Liu et al, 2022c ) , and recent studies have shown its usefulness for node anomaly detection ( Fan et al, 2020 ; Zheng et al, 2021 ; Jin et al, 2021a ; Liu et al, 2021 ; Yuan et al, 2021 ; Xu et al, 2022b ; Liu et al, 2022a ; Chen et al, 2022 ) . Graph SSL can be roughly divided into generative , contrastive , and predictive methods ( Wu et al, 2021 ) . First, generative methods such as DOMINANT ( Ding et al, 2019 ) , GUIDE ( Yuan et al, 2021 ) , and AnomalyDAE ( Fan et al, 2020 ) aim to detect graph anomalies by reconstructing (‘generating’) the adjacency matrix and/or the node attribute matrix. Next, contrastive methods such as CoLA ( Liu et al, 2021 ) , ANEMONE ( Jin et al, 2021a ) , GRADATE ( Duan et al, 2023 ) , and Sub-CR ( Zhang et al, 2022 ) train a graph encoder to pull positive pairs closer while pushing negative pairs away in the embedding space. The nodes with relatively large contrastive loss values are deemed anomalies. Finally, predictive methods such as SL-GAD ( Zheng et al, 2021 ) try to predict node properties using its local context (e.g., a subgraph), and nodes with large prediction errors are considered anomalies. Contrastive learning is arguably the most successful SSL strategy for graphs ( Xie et al, 2022 ) . Most contrastive graph learning methods consist of two main modules: 1) a data augmentation module that generates augmented data by operations such as edge dropping, node attribute masking, node addition, subgraph sampling, and/or graph diffusion. The augmented view of an instance is generally regarded as a positive pair with the original instance; and 2) a contrastive learning module that contrasts positive pairs (and often involves negative pairs) at different levels, such as node-node contrast, node-subgraph contrast, and subgraph-subgraph contrast. Although SSL-based graph anomaly detection has been successful, using it in practice is often not straightforward. The most important reason for this is that most methods require a large number of choices to be made, leading to three challenges: C1. How should we select appropriate data augmentation functions? C2. How should we choose appropriate values for hyperparameters (HPs) of a given augmentation function? (e.g., subgraph size in a subgraph sampling function, or the proportion of edges to drop in an edge dropping function) C3. How to combine the contrast losses at different levels? (i.e., how to set their combination weights?) Further, a recent study ( Zheng et al, 2021 ) shows that combining multiple SSL strategies for GAD can achieve better performance than using a single SSL strategy. This leads to the fourth challenge: C4. How should we combine different SSL strategies?(i.e., how to set the combination weights of different SSL loss functions?) Previous work ( Chen et al, 2020a ; You et al, 2020 ; Yoo et al, 2023 ) showed that the choice of SSL strategies and hyperparameter values can strongly impact performance. In a supervised setting, these choices can be systematically and rigorously made by using separate labeled data for validation. In an unsupervised setting such as anomaly detection, however, one should assume that no labels are available even for hyperparameter tuning. In our extensive literature study, we found that existing SSL-based GAD methods typically either 1) arbitrarily choose settings or 2) do use labeled data, corroborating the findings in Yoo et al (2023) . In the former case, practitioners typically heuristically select an augmentation function (C1) and fix its associated HPs (C2) across all datasets, and set the combination weights all equal to 1 or other fixed values (for C3 and C4). Although this approach is not flawed, it is likely to result in suboptimal detection performance: graphs from different domains usually have different properties ( Zhao et al, 2022a ) , implying that the optimal SSL strategy is in general data-dependent ( Chen et al, 2020a ; You et al, 2020 ) . Therefore, utilizing a unified and pre-fixed combination weights and/or HPs in SSL strategies for all graphs can result