AS-GCL: Asymmetric Spectral Augmentation on Graph Contrastive Learning

Ruyue Liu, Rong Yin *, Yong Liu, Xiaoshuai Hao, Haichao Shi, Can Ma, Weiping Wang · 2025

Read AS-GCL: Asymmetric Spectral Augmentation on Graph Contrastive Learning by Ruyue Liu, Rong Yin *, Yong Liu, Xiaoshuai Hao, Haichao Shi, Can Ma, Weiping Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13525.txt.

Introduction

Ruyue Liu and co-authors present a 2025 method for learning from graph data when few labels are known. Graphs link items as nodes and edges, as in social or cite networks. Their method, called AS-GCL, learns by comparing changed views of the same graph and pulling like nodes close in the learned space.

The team changes each graph in the frequency domain, which shows the broad shape of the graph. They use two linked coders with distinct spread steps to make views that resist noise. A new loss rule keeps class gaps in balance to aid later use. Tests on eight standard data sets showed gains on node-level tasks.

Catalog record

CREATORRuyue Liu, Rong Yin *, Yong Liu, Xiaoshuai Hao, Haichao Shi, Can Ma, Weiping Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-13525

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AS-GCL: Asymmetric Spectral Augmentation on Graph Contrastive Learning Ruyue Liu, Rong Yin *, Yong Liu, Xiaoshuai Hao, Haichao Shi, Can Ma, Weiping Wang Abstract Graph Contrastive Learning (GCL) has emerged as the foremost approach for self-supervised learning on graph-structured data. GCL reduces reliance on labeled data by learning robust representations from various augmented views. However, existing GCL methods typically depend on consistent stochastic augmentations, which overlook their impact on the intrinsic structure of the spectral domain, thereby limiting the model’s ability to generalize effectively. To address these limitations, we propose a novel paradigm called AS-GCL that incorporates asymmetric spectral augmentation for graph contrastive learning. A typical GCL framework consists of three key components: graph data augmentation, view encoding, and contrastive loss. Our method introduces significant enhancements to each of these components. Specifically, for data augmentation, we apply spectral-based augmentation to minimize spectral variations, strengthen structural invariance, and reduce noise. With respect to encoding, we employ parameter-sharing encoders with distinct diffusion operators to generate diverse, noise-resistant graph views. For contrastive loss, we introduce an upper-bound loss function that promotes generalization by maintaining a balanced distribution of intra- and inter-class distance. To our knowledge, we are the first to encode augmentation views of the spectral domain using asymmetric encoders. Extensive experiments on eight benchmark datasets across various node-level tasks demonstrate the advantages of the proposed method. Fig. 1 : The general framework of the proposed AS-GCL method. First, topology augmentation is optimized by generating paired augmented views \mathcal{G}_{1} and \mathcal{G}_{2} through spectral variation minimization. Then, encoders with shared parameters but different diffusion operators are used to generate representations for different views ( \bm{H}^{1} , and \bm{H}^{2} ). Finally, a contrastive loss function is introduced to reduce intraclass variation and increase interclass contrast. I Introduction Graph data play a significant role in multimedia applications, enabling cross-modal content analysis and generation. Graph neural networks (GNNs) have been widely adopted across diverse domains such as computer vision (CV) [ 1 ] , natural language processing (NLP) [ 2 ] , and information retrieval (IR) [ 3 ] . Notably, Graph Convolutional Networks (GCNs) [ 4 ] and Graph Attention Networks (GATs) [ 5 ] are specifically tailored to semi-supervised node classification tasks involving labeled nodes. Labeled data are particularly crucial for enhancing the performance of these GNN models. Contrastive learning (CL) learns representations from supervision signals derived from data without relying on human-provided labels. CL has achieved great success in many domains, including computer vision [ 6 ] , natural language processing [ 7 ] , and signal processing [ 8 ] . Specifically, contrastive methods aim to build effective representations by joining semantically similar (positive) pairs and separating dissimilar (negative) pairs [ 9 , 10 ] . Inspired by the success of contrastive methods in computer vision, these methods have recently been adopted for graphs [ 8 , 11 , 12 ] . While graph contrastive learning methods are effective on graph-related tasks, they often overlook a fundamental distinction between images and graphs. In the context of images, augmentation is well-defined and typically involves operations like cropping and rotation. However, in graphs, the representation of augmentation can become arbitrary. For example, the core semantics in images remain relatively stable even after they undergo random transformations [ 13 ] . In contrast, when the edges or nodes of a graph are perturbed, it is difficult to determine whether the augmented graph maintains a positive correlation with the original graph. This is mainly because graphs contain both semantic and structural information. Due to the arbitrary behavior of augmentation in graphs, the quality of learned graph representations in augmentation-based contrastive methods highly depends on selecting an appropriate augmentation scheme [ 14 ] . Graph augmentation methods can be categorized into four main groups: subgraph extraction [ 15 , 16 ] , adaptive augmentation [ 17 , 18 ] , random augmentation [ 19 , 9 , 20 ] , and other methods [ 11 , 21 ] . Subgraph extraction involves partitioning each graph into multiple subgraphs, with subgraph selection determined by the specific requirements of different models. However, this category of methods incurs significant computational overhead that is often considered prohibitive. Adaptive augmentation leverages principles rooted in task labeling and information bottlenecks to identify optimal views to enhance learning, although these methods usually entail intricate model architectures. In random augmentation, contrastive views are constructed by applying random perturbations, such as discarding nodes or edges. While straightforward and readily implementable, random augmentation overlooks the nuanced impact of distinct edge perturbations on underlying graph structure, thus failing to benefit from the relational inductive bias of graph-structured data. To address the severe structural damage caused by consistent random augmentation processes, we propose AS-GCL, a contrastive learning method utilizing spectral augmentation. To our knowledge, AS-GCL represents a pioneering effort in encoding spectral augmented views through an asymmetric encoder. The proposed method consists of three main components. The first component employs minimal spectral variation to guide topology augmentation, resulting in augmented views with minimal structural differences. In the second phase, we improve the GCN encoder by using an asymmetric encoder to generate different view representations. The final component achieves model optimization by maximizing the mutual information of the various view representations. We introduce a multiple loss function based on upper-bound loss, which prevents positive embeddings from deviating significantly from anchor embeddings, thereby minimizing intraclass differences. The main contributions of this paper are as follows. • We propose the AS-GCL framework, employing a novel asymmetric spectral augmentation strategy that minimizes spectral variations and generates diverse, noise-resilient graph views through parameter-sharing encoders with different diffusion operators. • This method introduces spectral-based augmentation and an upper-bound loss function, ensuring improved structural invariance, reduced noise, and improved generalizability by maintaining balanced intraclass and interclass distance. • Extensive experiments on node classification and clustering tasks demonstrate that AS-GCL consistently outperforms state-of-the-art methods and shows strong robustness against adversarial attacks on graph structures. The paper is organized as follows: Section II provides an overview of related work on graph contrastive learning. Section III introduces the notation and preliminaries used in the paper. Section IV presents the details of the proposed method. Section V describes a comprehensive set of experiments conducted to evaluate the effectiveness of the proposed method. Finally, Section VI summarizes the contributions of the paper and describes future research directions. II Related Work II-A Graph Contrastive Learning Recently, due to the significant success of contrastive learning methods for images, CL techniques have increasingly been applied to graphs. DGI [ 22 ] is a notable pioneering work inspired by Deep InfoMax [ 23 ] . The objective of DGI is to acquire node representations by maximizing the mutual information of local graph blocks. GMI [ 24 ] and HDMI [ 25 ] further enhanced DGI by incorporating mutual information about edges and node attributes. Inspired by SimCLR [ 26 ] , GRACE [ 27 ] , which generates two augmented graph views by randomly perturbing nodes and edges, learns node representations by aligning representations of the same nodes across two augmented graphs while maintaining separation of the other nodes. Despite these advancements, a major criticism of graph contrastive learning (GCL) methods is so-called semantic drift, where

Read the complete text