Improving Graph Few-shot Learning with Hyperbolic Space and Denoising Diffusion
Yonghao Liu, Jialu Sun, Wei Pang, Fausto Giunchiglia, Ximing Li, Xiaoyue Feng, Renchu Guan · 2026
Read Improving Graph Few-shot Learning with Hyperbolic Space and Denoising Diffusion by Yonghao Liu, Jialu Sun, Wei Pang, Fausto Giunchiglia, Ximing Li, Xiaoyue Feng, Renchu Guan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27462.txt.
Introduction
Liu and six others present IMPRESS, a tool that lifts graph few-shot learning, where models must adapt to tasks from only a few labeled nodes. Current methods learn node vectors in Euclidean space, which misses layered structure, and fit a target spread from few support samples even when it drifts. IMPRESS instead learns vectors in hyperbolic space, which suits layers, and grows the support spread through denoising diffusion. The authors prove a tighter general bound, and in tests IMPRESS beats rivals across benchmark data.
Catalog record
| CREATOR | Yonghao Liu, Jialu Sun, Wei Pang, Fausto Giunchiglia, Ximing Li, Xiaoyue Feng, Renchu Guan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58265 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.27462
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Graph Few-shot Learning with Hyperbolic Space and Denoising Diffusion Yonghao Liu, Jialu Sun, Wei Pang, Fausto Giunchiglia, Ximing Li, Xiaoyue Feng, Renchu Guan Abstract Graph few-shot learning, which focuses on effectively learning from only a small number of labeled nodes to quickly adapt to new tasks, has garnered significant research attention. Despite recent advances in graph few-shot learning that have demonstrated promising performance, existing methods still suffer from several key limitations. First, during the meta-training phase, these methods typically perform node representation learning in Euclidean space, which often fails to capture the inherently hierarchical structure existing in real-world graph data. Second, during the meta-testing phase, they usually fit an empirical target distribution derived from only a few support samples, even when this distribution significantly deviates from the true underlying distribution. To address these issues, we propose IMPRESS , a novel framework that IM proves gra P h few-shot learning with hype R bolic spac E and denoi S ing diffu S ion. Specifically, our model learns node representations in a hyperbolic space and enriches the support distribution through denoising diffusion mechanisms. Theoretically, IMPRESS achieves a tighter generalization bound. Empirically, IMPRESS consistently outperforms competitive baselines across multiple benchmark datasets. 1 Introduction Graph Neural Networks (GNNs) have become the de facto standard for modeling graph-structured data due to their unique advantages in capturing complex relational structures ( 40 ; 22 ) . However, most existing GNN models heavily rely on a large amount of labeled data to fully unleash their potential ( 12 ; 21 ) . This requirement is often impractical in real-world scenarios, where obtaining high-quality annotations can be prohibitively expensive or even infeasible ( 18 ; 20 ) . For example, in the field of bioinformatics, accurately annotating unknown genes requires deep expertise in molecular biology, posing a significant challenge even for seasoned researchers ( 11 ) . Given these challenges, graph few-shot learning (FSL) has emerged as a promising solution. By requiring only a few labeled nodes, graph FSL enables models to rapidly adapt to new tasks, making it an attractive research direction ( 46 ; 23 ) . Most existing graph FSL models follow a two-stage paradigm: during the meta-training phase, they perform node representation learning and capture generalizable knowledge across multiple tasks; during the meta-testing phase, they leverage this prior knowledge to adapt quickly to target tasks using only limited labeled data ( 47 ; 15 ) . Despite the remarkable progress made in recent years, current graph FSL methods still face several notable limitations that hinder their performance. First, current graph FSL models typically perform node representation learning in Euclidean space during the meta-training phase. While these operations are more straightforward in Euclidean space—benefiting from well-established operators and computational efficiency—real-world graph-structured data often exhibit hierarchical or tree-like distributions ( 28 ; 43 ) . For example, as shown in Fig. 1 (a), a company’s organizational structure can be modeled as a graph, with employees being represented as nodes and departments or teams as edges. The hierarchy from top management ( e.g. , CEO) to mid-level managers ( e.g. , directors) and staff forms a hierarchical graph structure that reflects decision-making processes and task delegation. Moreover, we visualize the hierarchical structure of academic research topics in Fig. 1 (b). Specifically, the research area of artificial intelligence typically encompasses subfields such as natural language processing and computer vision, which in turn contain more specialized topics such as text generation and image classification. Under such hierarchical organization, Euclidean embeddings often suffer from significant distortion, making it difficult to faithfully capture the underlying structural relationships. (a) Company Orinization (b) Research Topic Figure 1: Examples of hierarchical structures in graph data. Second, in the meta-testing phase, existing graph FSL models typically perform parameter fine-tuning using only a small set of labeled support nodes. These models implicitly assume that the distribution of the support set can serve as a reliable proxy for the true class distribution, and that training a classifier directly on these samples will yield accurate decision boundaries. However, this assumption introduces two critical issues. On the one hand , the support set often fails to capture the true data distribution due to its extremely limited size, leading to biased and unrepresentative distributions. To support our claim, we visualize the distributional discrepancy between the support set and the query set in a randomly sampled task from the Cora and CiteSeer datasets ( 44 ) using a histogram-based density plot. As shown in Fig. 2 , the support set clearly exhibits a biased distribution, which deviates from that of the query set. On the other hand , training the downstream classifier directly on such sparse data is highly susceptible to overfitting, which significantly impairs the model’s generalization ability. (a) Cora (b) CiteSeer Figure 2: Data Distribution of randomly selected support set and query set from the Cora and CiteSeer datasets. To address the aforementioned issues, we propose a novel framework named IMPRESS that IM poves gra P h few-shot learning with hype R bolic spac E and denoi S ing diffu S ion. Specifically, during the meta-training phase, we first train a hyperbolic variational graph autoencoder to explicitly capture the hierarchical structure inherent in graph data. In the meta-testing phase, inspired by the powerful generative capabilities of latent diffusion models ( 30 ) , we aim to leverage them to generate a large number of support node embeddings in the latent space, thereby enabling a more accurate approximation of the class decision boundaries. However, a major challenge arises: due to the limited number of labeled support samples in few-shot scenarios, it is impractical to train a diffusion model solely on the support set. To address this, we leverage the abundant data available during meta-training to train the diffusion model. Nevertheless, this introduces another challenge—since the class labels in meta-training and meta-testing are disjoint, the diffusion model trained on base classes may fail to generate samples that align with the novel class distributions. To overcome this issue, we incorporate class prototype information as a conditioning signal during the diffusion training process. This guidance helps the model generate embeddings that better align with the target class, under the supervision of its corresponding prototype. Theoretically, our method achieves a tighter generalization bound compared to prior approaches. Empirically, it consistently outperforms existing models across multiple benchmark datasets. In summary, our contributions are as follows. (I) We propose a novel framework, namely IMPRESS, which improves graph FSL with hyperbolic space and denoising diffusion. (II) We theoretically elucidate the underlying mechanisms that contribute to the effectiveness of our method. (III) We empirically demonstrate that our approach achieves superior performance across multiple evaluation datasets. 2 Preliminary Study Experimental Setting. Given a graph \mathcal{G}=\{\mathcal{V},\mathcal{E},X,A\} , where \mathcal{V}=\{v_{1},\cdots,v_{n}\} and \mathcal{E}=\{e_{1},\cdots,e_{m}\} represent the sets of nodes and edges, respectively. X\in\mathbb{R}^{n\times d} denotes the node feature matrix, and A\in\mathbb{R}^{n\times n} is the adjacency matrix. In this work, we focus on the widely studied few-shot node classification problem in graph FSL setting to assess model performance. In conventional few-shot node classification , the meta-training task set \mathcal{D}_{\text{tra}} comprises a collection of tasks \mathcal{T}_{\text{tra}}=\{\mathcal{S}_{\text{tra}},\mathcal{Q}_{\text{tra}}\} , where \mathcal{S}_{\text{tra}}=\{(v^{\text{tra}}_{i},y^{\text{tra}}_{i})\}_{i=1}^{NK} denotes the support set, and \mathcal{Q}_{\text{tra}}=\{(v^{\text{tra}}_{i},y^{\text{tra}}_{i})\}_{i=1}^{NQ} denotes the corresponding query set. Each label y^{\text{tra}}_{i} belongs