Adaptive Multi-view Graph Contrastive Learning via Fractional-order Neural Diffusion Networks
Yanan Zhao, Feng Ji, Jingyang Dai, Jiaze Ma, Keyue Jiang, Kai Zhao, Wee Peng Tay · 2025
Read Adaptive Multi-view Graph Contrastive Learning via Fractional-order Neural Diffusion Networks by Yanan Zhao, Feng Ji, Jingyang Dai, Jiaze Ma, Keyue Jiang, Kai Zhao, Wee Peng Tay (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06216.txt.
Introduction
Yanan Zhao and colleagues rethink how graph learning creates the multiple views it needs for contrastive training. Graph contrastive learning teaches representations by comparing different views of one graph, but most methods rely on two fixed, hand-made views. That habit limits the range of structure the model can notice, from local detail to global shape.
Their framework builds views from fractional-order diffusion, where a single adjustable order sweeps from local to global behavior. The order itself is learned, so the data decides which diffusion scales are informative, with no manual augmentation. Experiments on standard benchmarks produced stronger, more robust embeddings than leading graph contrastive baselines.
Catalog record
| CREATOR | Yanan Zhao, Feng Ji, Jingyang Dai, Jiaze Ma, Keyue Jiang, Kai Zhao, Wee Peng Tay |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-06216
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive Multi-view Graph Contrastive Learning via Fractional-order Neural Diffusion Networks Yanan Zhao, Feng Ji, Jingyang Dai, Jiaze Ma, Keyue Jiang, Kai Zhao, Wee Peng Tay Abstract Graph contrastive learning (GCL) learns node and graph representations by contrasting multiple views of the same graph. Existing methods typically rely on fixed, handcrafted views-usually a local and a global perspective—which limits their ability to capture multi-scale structural patterns. We present an augmentation-free, multi-view GCL framework grounded in fractional-order continuous dynamics. By varying the fractional derivative order α ∈ ( 0 , 1 ] \alpha\in(0,1] , our encoders produce a continuous spectrum of views: small α \alpha yields localized features, while large α \alpha induces broader, global aggregation. We treat α \alpha as a learnable parameter so the model can adapt diffusion scales to the data and automatically discover informative views. This principled approach generates diverse, complementary representations without manual augmentations. Extensive experiments on standard benchmarks demonstrate that our method produces more robust and expressive embeddings and outperforms state-of-the-art GCL baselines. I Introduction Contrastive learning is a self-supervised paradigm that trains representations by pulling semantically similar pairs together and pushing dissimilar pairs apart in the embedding space. It uncovers useful structure without labels and has produced strong results in computer vision, natural language processing, and recommendation systems [ 1 , 2 , 3 ] . Applied to graph data, this paradigm is known as Graph Contrastive Learning (GCL) , where positive pairs are typically derived from different views (e.g., node-, subgraph-, or graph-level perturbations) of the same instance and negatives from other, unrelated instances. A central challenge in GCL is how to produce distinct, semantically meaningful views. Prior approaches follow two broad strategies. Augmentation-based methods synthesize multiple views by perturbing the graph (e.g., edge deletion, feature masking), while augmentation-free methods obtain different views by applying distinct encoders to the same input. Despite these differences, most methods still rely on a small set of fixed, handcrafted views—commonly a “local” and a “global” perspective—which constrains their ability to represent multi-scale structure. For example, BGRL [ 4 ] creates two views via structural and feature perturbations, and PolyGCL [ 5 ] constructs low-pass and high-pass views through spectral filtering. Such designs increase view diversity but remain rigid and often require manual tuning. This motivates two questions: Q1 How can we adaptively generate a diverse set of views that capture multi-scale semantics in GCL, moving beyond fixed, handcrafted local and global perspectives? Q2 Can this be achieved without relying on heuristic augmentations? To answer these questions, we propose a novel multi-view augmentation-free framework grounded in fractional-order continuous dynamics. Our key insight is to leverage fractional-order differential equations (FDEs) [ 6 ] to model graph diffusion and generate a continuum of semantically diverse views, each parameterized by a distinct fractional derivative order. Prior works, which rely on ordinary differential equations (ODEs) [ 7 , 8 , 9 , 10 , 11 , 12 , 13 ] , simulate graph diffusion as continuous-time heat flow and serve as smooth analogues of message passing in models like GCN. Unlike such ODE-based approaches, FDEs model graph diffusion by introducing the fractional derivative operator \frac{\,\mathrm{d}^{\alpha}}{\,\mathrm{d}t^{\alpha}} , where \alpha\in(0,1] [ 14 , 15 , 16 , 17 , 18 , 19 ] . When \alpha=1 , the standard ODE is recovered; however, for \alpha<1 , the operator incorporates non-local information through memory effects, allowing the diffusion to reflect long-range temporal dependencies and attenuated propagation. By leveraging FDEs, multi-view GCL emerges naturally: the fractional order \alpha\in(0,1] provides a continuous control of diffusion scale. Varying \alpha yields a continuum of views — small \alpha emphasizes local components, while large \alpha produces broader global aggregation. This gives a principled, augmentation - free mechanism to generate diverse and complementary views without handcrafted filters (e.g., filter - based methods such as PolyGCL) or task - specific perturbations (e.g., BGRL). Moreover, \alpha is a learnable continuous parameter, so the model can automatically adapt diffusion scales to dataset heterogeneity. To our knowledge, this is the first work to exploit the multi - scale behaviour of fractional - order dynamics for contrastive learning. Our main contributions are summarized as follows: • We propose a novel multi-view, augmentation-free GCL framework based on neural diffusion encoders governed by fractional-order dynamics . This approach is conceptually simple, computationally efficient, and highly flexible, with each feature view controlled by a continuous parameter \alpha\in(0,1] , naturally spanning a spectrum of diffusion scales. • Our main theoretical result shows that embeddings produced by FDE encoders at different fractional orders are provably distinct, and that the separation between these views grows as the gap between the orders \alpha increases. To our knowledge, this is the first formal analysis of this multi-scale distinguishability in the context of contrastive learning, despite prior empirical use of FDEs in GNNs. • We tackle two core challenges in GCL: (i) dimension collapse — mitigated by including encoders with small fractional orders that yield less energy - concentrated, higher - rank embeddings; and (ii) view collapse — prevented via a regularized contrastive objective that penalizes alignment of dominant directions across views, promoting diverse, complementary representations without requiring negative samples. • The fractional orders \alpha are treated as learnable parameters, allowing the model to discover informative diffusion scales from data instead of relying on manual tuning or grid search. To control complexity, we propose a view - learning strategy that prunes redundant scales while retaining diverse, complementary views. • We present a rigorous stability analysis, deriving explicit perturbation bounds that quantify how input, parameter, and topological disturbances affect encoder outputs. Empirically, our approach consistently outperforms state - of - the - art robust GCL methods under both black - box and white - box attack scenarios. • We evaluate on a broad set of homophilic and heterophilic graph benchmarks. Empirical results demonstrate that our method consistently outperforms state - of - the - art GCL baselines, confirming the effectiveness of the proposed multi - scale view generation mechanism. II Related work GCL methods can be categorized into augmentation-based and augmentation-free approaches. Augmentation-based methods synthesize multiple views by perturbing the input graph (e.g., edge deletion, feature masking) [ 20 , 21 , 22 , 23 , 24 , 25 ] . Augmentation-free methods instead obtain different views by applying distinct encoders or filters to the same graph [ 26 , 27 ] . Many augmentation-free approaches (e.g., GraphACL [ 28 ] , SP-GCL [ 29 ] , GraphECL [ 30 ] , PolyGCL [ 5 ] , LOHA [ 31 ] , AFECL [ 32 ] ) still depend on negative samples for contrastive training. SDMG [ 33 ] follows a diffusion-based, self-supervised design using two low-frequency encoders to emphasize global signals. By contrast, methods such as BGRL [ 4 ] and CCA-SSG [ 34 ] remove negative sampling but keep augmentations, while AFGRL [ 35 ] removes both negatives and augmentations yet can suffer from limited view diversity and fixed propagation depth, which hurts performance on heterophilic graphs. TABLE I : FD-MVGCL (ours) vs. SOTA GCL Methods. Method >2 views Aug-Free Neg-Free Hetero. Adapt. BGRL (’22) ✗ ✗ ✓ ✓ ✓ AFGRL (’22) ✗ ✓ ✓ ✗ ✗ GraphACL (’23) ✗ ✓ ✗ ✓ ✗ GraphECL