Self-Reinforced Graph Contrastive Learning

Chou-Ying Hsieh 1 , Chun-Fu Jang 1 , Cheng-En Hsieh 1 , Qian-Hui Chen 1 , Sy-Yen Kuo 1 2 · 2025

Read Self-Reinforced Graph Contrastive Learning by Chou-Ying Hsieh 1 , Chun-Fu Jang 1 , Cheng-En Hsieh 1 , Qian-Hui Chen 1 , Sy-Yen Kuo 1 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13650.txt.

Introduction

Chou-Ying Hsieh and co-authors present SRGCL, a self-reinforced method for learning from graphs in two thousand twenty-five. Graph contrastive learning trains models by telling apart matched and unmatched views of a graph. Bad matched pairs warp what the model learns, so pair quality is the weak point.

SRGCL lets the model's own encoder grade candidate pairs as it improves. A generator builds pairs by several remix tricks, and a selector keeps those that respect the data's shape. Picks are probabilistic, so grading sharpens as the encoder does. Tested as a plug-in across graph sorting tasks, it beat top rival methods with steady gains. The frame adapts to many domains, the authors say.

Catalog record

CREATORChou-Ying Hsieh 1 , Chun-Fu Jang 1 , Cheng-En Hsieh 1 , Qian-Hui Chen 1 , Sy-Yen Kuo 1 2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13650

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Self-Reinforced Graph Contrastive Learning Chou-Ying Hsieh 1 , Chun-Fu Jang 1 , Cheng-En Hsieh 1 , Qian-Hui Chen 1 , Sy-Yen Kuo 1 2 Abstract Graphs serve as versatile data structures in numerous real-world domains—including social networks, molecular biology, and knowledge graphs—by capturing intricate relational information among entities. Among graph-based learning techniques, Graph Contrastive Learning (GCL) has gained significant attention for its ability to derive robust, self-supervised graph representations through the contrasting of positive and negative sample pairs. However, a critical challenge lies in ensuring high-quality positive pairs so that the intrinsic semantic and structural properties of the original graph are preserved rather than distorted. To address this issue, we propose SRGCL (Self-Reinforced Graph Contrastive Learning), a novel framework that leverages the model’s own encoder to dynamically evaluate and select high-quality positive pairs. We designed an unified positive pair generator employing multiple augmentation strategies, and a selector guided by the manifold hypothesis to maintain the underlying geometry of the latent space. By adopting a probabilistic mechanism for selecting positive pairs, SRGCL iteratively refines its assessment of pair quality as the encoder’s representational power improves. Extensive experiments on diverse graph-level classification tasks demonstrate that SRGCL, as a plug-in module, consistently outperforms state-of-the-art GCL methods, underscoring its adaptability and efficacy across various domains. I Introduction Graphs, as powerful and flexible data structures, have become a cornerstone in numerous real-world applications, ranging from social networks [ 1 ] and biochemical molecule modeling [ 2 ] to knowledge graphs [ 3 ] and recommendation systems [ 4 ] . Their ability to capture complex relational information among entities grants a high level of generalizability, enabling practitioners to tackle diverse tasks under a unified framework. Consequently, graph-based learning has gained remarkable attention for its capacity to model and analyze data where relationships play a critical role. Fig. 1 : The core idea of SRGCL is that high-quality positive pairs enhance the model’s capability, enabling it to more effectively discriminate the quality of positive pairs. In Graph Contrastive Learning (GCL) [ 5 , 6 , 7 , 8 , 9 , 10 , 11 ] , a positive pair comprises two correlated views of the same underlying graph. We regard a pair as high-quality when (i) both views conserve critical topological or attribute-based substructures and (ii) the two graphs necessarily remain in the same semantic class as the anchor. Conventional random augmentations (e.g., node dropping or edge perturbation [ 5 ] ) easily violate these conditions, producing false positives that mislead the contrastive objective. A typical failure case is the MUTAG dataset [ 12 ] , where randomly deleting bonds can break aromatic rings and invert mutagenicity labels, degrading representation quality. Empirically, substituting the two augmented views in GraphCL with two ground-truth graphs sharing the same label boosts accuracy from 87.59\!\pm\!0.78\% to 89.02\!\pm\!1.29\% , and similar gains appear across other benchmarks, underscoring the importance of high-quality positives. Despite recent progress, existing GCL frameworks offer limited mechanisms to guarantee such quality, especially as graph size and heterogeneity increase. Unreliable positives hamper the encoder from learning discriminative features and ultimately yield sub-optimal graph-level embeddings. To overcome this limitation, we introduce SRGCL 1 1 1 https://github.com/NTUDDSNLab/SRGCL (Self-Reinforced Graph Contrastive Learning), which leverages the encoder itself to detect and select high-quality positives: • Self-reinforced positive selection. SRGCL forms a feedback loop in which high-quality positives iteratively refine the encoder, and the strengthened encoder, in turn, more accurately judges pair quality. • Unified Positive Pair Generator (UPPG). Multiple augmentation strategies are unified to produce diverse candidate pairs, from which SRGCL retains only those consistent with the encoder’s manifold-based similarity criterion. • Manifold-aware, probabilistic optimization. We embed the manifold hypothesis into a probabilistic selector that gradually sharpens its acceptance distribution as representation power improves, eliminating false positives while keeping informative diversity. • Plug-and-play design and empirical gains. SRGCL integrates seamlessly into existing GCL pipelines and achieves consistent improvements on multiple graph-level benchmarks over the state of the art, without compromising generality across domains. Overall, SRGCL demonstrates that rigorously filtering positive pairs is vital for contrastive objectives and offers a principled, self-reinforcing solution to realize this goal. The remainder of the paper is organized as follows: Section II introduces the terminology, reviews the fundamentals of GCL, and categorizes existing positive pair construction methods. Section III presents the proposed SRGCL framework and its core components. In Section V , we conduct extensive experiments and analyses comparing SRGCL with state-of-the-art GCL methods. Finally, Section VII concludes the paper and outlines directions for future work. II Background and Related Works II-A Terminologies and Notations We introduce the primary symbols and notations used consistently in this paper. Matrices are denoted by bold uppercase letters (e.g., \mathbf{X} ), vectors by bold lowercase letters (e.g., \mathbf{v} ), scalars by normal letters (e.g., m , n ). Sets are represented by calligraphic letters (e.g., \mathcal{V} ). We primarily examine undirected attributed graphs. We represent a graph as \mathcal{G}=\{\mathcal{V},\mathcal{E}\} , where \mathcal{V} is the node set \{v_{i}\}_{i=1}^{n} and \mathcal{E} is the edge set \{e_{i}\}_{i=1}^{m} . Alternatively, in matrix form, we denote the graph as \mathcal{G}=(\mathbf{A},\mathbf{X}) , where \mathbf{A}\in\mathbb{R}^{n\times n} is the adjacency matrix and \mathbf{X}\in\mathbb{R}^{n\times k} is the node feature matrix, with n as the number of nodes, m as the number of edges, and d as the feature dimension. When dealing with multiple graphs (e.g., in graph-level tasks), subscripts are used to differentiate between graphs and their corresponding components. For instance, p_{i} represents the positive pair of the i -th graph \mathcal{G}_{i} . II-B Graph Contrastive Learning Graph Contrastive Learning (GCL) is a self-supervised framework designed to learn robust representations of graph-structured data by contrasting positive and negative sample pairs. Inspired by the success of contrastive learning in computer vision [ 13 , 14 ] , GCL derives supervisory signals directly from the data without relying on explicit labels. To encode structural information, GCL employs Graph Neural Networks (GNNs), where a typical layer updates the representation of node v by aggregating information from its neighbors: \mathbf{x}_{v}^{(l)}=\sigma\!\Big(\mathbf{W}^{(l)}\cdot\mathrm{AGG}\big(\{\mathbf{x}_{u}^{(l-1)}:u\in\mathcal{N}(v)\}\big)\Big), (1) where \mathbf{x}_{v}^{(l)} is the node embedding at layer l , \mathrm{AGG}(\cdot) is an aggregation function (e.g., mean or sum), \sigma is a nonlinear activation, and \mathbf{W}^{(l)} is a learnable weight matrix. A readout function, often an MLP, pools node embeddings to obtain a graph-level representation \mathbf{z} . Positive pairs are generated by applying different augmentations to the same node or graph, while negative pairs consist of different nodes or graphs. GCL typically adopts the InfoNCE loss [ 15 ] to align positive pairs and separate negative ones: \mathcal{L}=-\sum_{i}\log\frac{\exp(\mathrm{sim}(\mathbf{z}_{i},\mathbf{z}_{i}^{+})/\tau)}{\sum_{j}\mathbb{I}_{j\neq i}\exp(\mathrm{sim}(\mathbf{z}_{i},\mathbf{z}_{j})/\tau)}, (2) where \mathrm{sim}(\cdot,\cdot) denotes a similarity measure (e.g., cosine), and \tau is a temperature parameter. Positive pair quality is critical, as it provides the alignment signal necessary for learning perturbation-invariant and semantically meaningful embeddings. In the following sections, we discuss modern strategies for constructing high-quality positive pairs in GCL. Fig. 2 : The proposed framework of SRGCL, which is the plug-in module for existing GCL frameworks. SRGCL comprises: (1) UPPG for generating positive pair candidate set \mathcal{C}_{i} , whose size is c , (2) GNN shared encoder e(\cdot) for encoding the input graph and candidate positive pairs to vector z_{i},\tilde{z}_{i}^{c} , and (3) MiPPS for selecting the final positive set \mathcal{P}_{i} from \mathcal{C}_{i} .

Read the complete text