GCCM: Enhancing Generative Graph Prediction via Contrastive Consistency Model
Shaozhen Ma, Wei Huang, Hanchen Wang, Dong Wen, Wenjie Zhang · 2026
Read GCCM: Enhancing Generative Graph Prediction via Contrastive Consistency Model by Shaozhen Ma, Wei Huang, Hanchen Wang, Dong Wen, Wenjie Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05689.txt.
Introduction
Diffusion models can predict how a graph will change, but sampling them is slow and sometimes unstable. Shaozhen Ma and four co-authors present GCCM, which pairs generative graph prediction with a contrastive consistency model. Consistency training shortens sampling to few steps, yet the authors find it can collapse into a shortcut that satisfies the constraint without learning the prediction.
Their contrastive component guards against that degenerate solution. The model learns conditional distributions over target graphs given an input graph. The combination aims at competitive accuracy with stable, cheap sampling at inference time.
Catalog record
| CREATOR | Shaozhen Ma, Wei Huang, Hanchen Wang, Dong Wen, Wenjie Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05689
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GCCM: Enhancing Generative Graph Prediction via Contrastive Consistency Model Shaozhen Ma, Wei Huang, Hanchen Wang, Dong Wen, Wenjie Zhang Abstract Conditional generative models, particularly diffusion-based methods, have recently been applied to graph prediction by modeling the target as a conditional distribution given the input graph, yielding competitive results compared to deterministic predictor. However, existing diffusion-based prediction methods typically require expensive iterative denoising at inference and often suffer from unstable sampling, which motivates recent efforts to reduce inference denoising steps and enable stable sampling via techniques such as consistency training. Despite this progress, we find that existing consistency training methods for graph prediction could potentially fall into a shortcut solution: the model may attempt to satisfy the self-consistency constraint by ignoring the noisy target (i.e., assigning it negligible weight), ultimately collapsing into a purely deterministic predictor. To mitigate such shortcut solution, we propose GCCM, a graph contrastive consistency model that goes beyond isolated pairwise matching between the same target at different noise levels by introducing negative pairs into a contrastive consistency objective. This adds an additional separation requirement, making the shortcut solution no longer trivially sufficient to satisfy the proposed objective. Moreover, we apply feature perturbation to the input node/edge features to break identical conditioning on the input graph, so that the shortcut no longer yields the same predictions across noise levels and becomes less attractive. Extensive experiments on benchmark datasets demonstrate that GCCM mitigates the shortcut solution and yields consistent performance improvements in graph prediction compared to deterministic predictors. 1 Introduction Prediction tasks on graphs (e.g., node/graph-level predictions) are fundamental problems in graph machine learning, aiming to predict target variables defined over graph-structured data. Earlier methods for graph prediction [ 14 , 30 , 19 ] mainly focus on a deterministic paradigm, which directly maps an input node or graph to the target. In recent years, generative models, particularly the diffusion-based models, have demonstrated promising performance across a wide range of generation tasks on graphs [ 25 , 28 , 11 , 10 ] . Benefiting from their strong capability in modeling complex data distributions, increasing attention has been paid to extending diffusion-based paradigms to graph prediction tasks. In contrast to deterministic models, diffusion-based approaches reformulate prediction as a conditional generation problem, modeling the full conditional distribution of target variables rather than producing a single point estimate. Despite their potential, applying diffusion-based models to graph prediction tasks remains challenging in two key aspects: (1) Step-Level Inefficiency: diffusion-based methods perform inference through iterative denoising, frequently involving dozens or even hundreds of reverse steps, which introduces substantial computational overhead, limiting their inference efficiency; (2) Sample-Level Inefficiency: predictions obtained from a single noise sample can exhibit high variance, leading to unstable inference. To obtain reliable predictions, generative methods typically require aggregating predictions from multiple noise samples, which further increases inference cost. To address the above challenges, a common strategy is to adopt the consistency training [ 23 , 24 ] to enhance diffusion-based models. Specifically, PCL [ 16 ] proposes a predictive consistency framework to train the diffusion-based graph prediction model by enforcing consistency mapping across different noise levels, which enables stable sampling and one-step inference from a single noise sample. Despite its efficiency, we observe that applying consistency training to graph prediction admits a shortcut solution. When predictions at different noise levels are conditioned on the same underlying input graph and enforced to be matched, the model can trivially satisfy the consistency objective by ignoring the noisy target and relying solely on the conditioning input. This potential shortcut collapses the conditional denoising network into a purely deterministic predictor, thus undermining the goal of conditional generation. Our Contributions. Motivated by the above observation, we propose Graph Contrastive Consistency Models (GCCM) to mitigate such shortcut solution in consistency-based prediction. In particular, (1) instead of treating self-consistency as a purely matching constraint between two denoising predictions of the same underlying instance (i.e., a node of node-level prediction and a graph for graph-level prediction), we incorporate negative pairs across different instances in the mini-batch. This yields a contrastive consistency objective that aligns the target representations of the positive pair while separating them from negatives in the latent space, making it harder to satisfy the contrastive consistency objective by simply ignoring the noisy target. Nevertheless, the proposed contrastive consistency objective alone does not fully eliminate the shortcut solution. When the conditioning node/edge features remains identical across the two noisy views, the model may still attempt to satisfy the positive-pair agreement by relying solely on the identical conditioning input and ignoring the noisy target (i.e., the shortcut solution). (2) To further enhance the proposed contrastive consistency objective, we apply feature perturbation to the input node/edge features to break identical conditioning, making the shortcut solution less attractive. Together, these two components encourage our proposed GCCM to fully leverage the generative formulation to enhance the performance of predictors. Experimental results show that GCCM outperforms the existing diffusion-based graph prediction baselines on wide-range benchmark datasets and prediction tasks. Detailed ablation studies further verify the contribution of each proposed component in mitigating the shortcut solution. 2 Related Works Generative diffusion models for graph prediction. In recent years, diffusion models [ 8 , 22 , 18 , 20 ] have emerged as a powerful framework for a wide range of generation tasks. Motivated by their strong generative capacity, a growing body of work has extended diffusion models to graph-related generation tasks [ 28 , 32 ] . Beyond graph generation tasks, LGD [ 32 ] explores diffusion models for graph prediction by applying diffusion in a latent space to generate latent representations and then mapping them to the target space using a learned decoder. Although effective, it still incurs substantial computational overhead due to iterative denoising at inference time. Building upon diffusion models, consistency models [ 23 , 24 ] eliminate iterative reverse diffusion by directly learning a mapping from noisy samples to clean data through the self-consistency objective, enabling efficient one-step or few-step generation. Inspired by the consistency mapping principle, PCL [ 16 ] further develops a predictive consistency framework for prediction tasks by enforcing consistent predictions across different noise levels. This formulation enables stable sampling and one-step inference in diffusion-based graph prediction models. Due to the space limitations, an extended related work regarding the classical deterministic graph prediction models can be found in Appendix A . 3 Preliminaries In this section, we use \mathbf{Y} to denote the target variable to be generated, and \mathbf{C} to denote the conditioning input for conditional generation. 3.1 Diffusion Models Diffusion models [ 21 , 1 , 9 , 8 , 18 ] define a generative process by gradually transforming the clean target \mathbf{Y}_{0} into noise through a forward process, and learning to recover the clean target progressively through a reverse process. 3.1.1 Forward Process The forward process gradually corrupts the clean target \mathbf{Y}_{0} into a sequence of noisy latent variables \mathbf{Y}_{1:T}=\{\mathbf{Y}_{1},\mathbf{Y}_{2},\ldots,\mathbf{Y}_{T}\} , defined as q(\mathbf{Y}_{1:T}\mid\mathbf{Y}_{0})=\prod_{t=1}^{T}q(\mathbf{Y}_{t}\mid\mathbf{Y}_{t-1}) . Discrete targets. For discrete targets, the clean target is represented in one-hot form as \mathbf{Y}_{0}=\mathbf{Y}\in\{0,1\}^{n\times K} , where n is the number of target variables and K is the number of categories. The forward process is defined as q(\mathbf{Y}_{t}\mid\mathbf{Y}_{t-1})=\mathrm{Cat}\left(\mathbf{Y}_{t};\;\mathbf{p}=\mathbf{Y}_{t-1}\mathbf{Q}_{t}\right) , where \mathrm{Cat}(\mathbf{Y}_{t};\mathbf{p}) denotes a categorical distribution over K one-hot