Generalizing Graph Foundation Models via Hyperbolic Retrieval-Augmented Generation Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3817750 ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3817750 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking

Yifan Jin, Qirui Ji, Bin Qin, Jiangmeng Li, Lixiang Liu, Fuchun Sun, Changwen Zheng · 2026

Read Generalizing Graph Foundation Models via Hyperbolic Retrieval-Augmented Generation Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3817750 ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3817750 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking by Yifan Jin, Qirui Ji, Bin Qin, Jiangmeng Li, Lixiang Liu, Fuchun Sun, Changwen Zheng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03307.txt.

Introduction

Jin and co-authors add hyperbolic retrieval to graph foundation models. Such models pretrain on graphs at scale for cross-domain use. Their stored knowledge still fails under distribution shift. Retrieval-augmented generation can add outside knowledge at run time. But Euclidean retrieval has a geometric flaw: its volume growth is polynomial, while knowledge bases grow like trees.

The mismatch blurs fine detail in retrieval and breeds a hubness problem. Their framework, HyRAG, indexes the knowledge base in hyperbolic space, which fits tree shape. A retrieval module then fetches knowledge at two grains: broad anchors and local nuance. A dual-path fusion module merges the finds at feature and structure levels. Tests on many graph benchmarks show clear gains in the zero-shot setting. The authors present HyRAG as a way to make graph foundation models generalize with more grace.

Catalog record

CREATORYifan Jin, Qirui Ji, Bin Qin, Jiangmeng Li, Lixiang Liu, Fuchun Sun, Changwen Zheng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03307

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Generalizing Graph Foundation Models via Hyperbolic Retrieval-Augmented Generation Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3817750 ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3817750 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking Yifan Jin, Qirui Ji, Bin Qin, Jiangmeng Li, Lixiang Liu, Fuchun Sun, Changwen Zheng Abstract . Graph foundation models (GFMs) emerged as a dominant paradigm in graph representation learning by leveraging large-scale pre-training for cross-domain inference. However, the parameterized knowledge encoded within these models is insufficient to cope with distribution shifts, limiting their generalization ability. To mitigate this issue, retrieval-augmented generation (RAG) has been introduced to incorporate external knowledge at inference time. Nevertheless, existing RAG frameworks operating in Euclidean space suffer from a fundamental geometric limitation: the polynomial volume growth of Euclidean space is inherently mismatched with the tree-structured external knowledge bases. This mismatch leads to the loss of semantic granularity in retrieval and gives rise to the hubness phenomenon. To address this limitation, we propose a Hy perbolic R etrieval- A ugmented G eneration (HyRAG) framework designed to enhance the generalization capabilities of GFMs. Specifically, the introduced Hyperbolic Knowledge Indexing module retains the tree-like hierarchies of the external knowledge base by modeling them within hyperbolic space. The Multi-granularity Retrieval module then provides GFMs with the global semantic anchors and local semantic nuances through coarse-grained and fine-grained knowledge retrieval, respectively. Finally, the Dual-path Fusion module achieves effective knowledge integration for graph tasks at both the feature and structural levels. Experiments on multiple graph benchmarks demonstrate significant improvements in the zero-shot setting, highlighting the generalization of our method for robust GFMs inference. † † cc-license: by Resource Availability: The source code of this paper has been made publicly available at https://doi.org/10.5281/zenodo.20501234 . 1. Introduction Graph foundation models (GFMs) have emerged as a dominant paradigm for graph representation learning, enabling unified pre-training and transfer across diverse graph tasks such as node classification ( 28 ; 9 ; 18 ; 44 ) , link prediction ( 28 ; 3 ) , and graph-level reasoning ( 18 ; 9 ) . By leveraging pre-training on large-scale datasets, GFMs demonstrate impressive generalization capabilities. Despite these advances, the knowledge internalized by GFMs is inherently bounded by the distribution of the pre-training data ( 39 ; 42 ) . When distributional shifts arise at inference time, the parameterized knowledge may fail to generalize, leading to degraded and unreliable inference performance ( 16 ) . To mitigate this limitation, recent studies have explored retrieval-augmented generation (RAG) paradigms that allow GFMs to dynamically access external knowledge at inference time without retraining ( 14 ; 34 ) . For instance, RAGRAPH ( 14 ) performs retrieval over a toy graph vector library and integrates the retrieved instances through a message-passing prompting mechanism to enrich the learning context. RAG4GFM ( 34 ) introduces a multi-level indexing architecture together with a task-aware retriever to extract structurally and semantically relevant subgraphs. RAG-GFM ( 40 ) incorporates retrieval during pre-training to align semantic and structural priors. However, we argue that RAG frameworks operating in Euclidean space face an inherent geometric limitation: the polynomial volume growth of Euclidean space is inherently mismatched with the tree-structured external knowledge bases, leading to the following two issues: Figure 1. Comparison of Euclidean space and hyperbolic space.(a) In Euclidean space (left), the query node exhibits similar distances to both coarse-grained and fine-grained concepts. Hyperbolic space (right) naturally embeds the tree-like hierarchies. (b) Node frequency distribution in top- k retrieval results on the Cora dataset across Euclidean space and hyperbolic space, the x-axis shows the co-occurrence frequency of the entity, and the y-axis shows the number of entities (log scale). 1) Loss of semantic granularity. External knowledge bases are commonly organized as tree-structured hierarchies with exponential growth, where root nodes represent coarse-grained concepts and leaf nodes correspond to fine-grained concepts. These two levels of granularity provide complementary information for graph tasks. Specifically, for the classification of the query node in Figure 1 (a), the coarse-grained concept “computational learning theory” situates the semantic context within the theoretical domain, serving as a global semantic anchor. In contrast, the fine-grained concept “PAC learning” offers local semantic nuances by specifying the concrete learning paradigm, thereby distinguishing the query from other theoretical branches. However, Euclidean representation spaces exhibit only polynomial volume growth with respect to the radius, which fundamentally mismatches the exponential expansion of hierarchical knowledge and inevitably compresses concepts from different hierarchical depths into proximal regions of the embedding space. As a consequence, Euclidean-based RAG struggles to distinguish between coarse-grained and fine-grained concepts, collapsing rich hierarchical semantics into undifferentiated similarity signals. As illustrated in Figure 1 (a), the query node may appear at similar Euclidean distances to both coarse-grained and fine-grained concepts, causing them to be treated as equally informative during retrieval and fusion. Such granularity-agnostic aggregation blurs semantic roles and weakens the reliability of downstream reasoning. In contrast, the intrinsic geometry of hyperbolic space naturally accommodates tree-structured hierarchies, where coarse-grained concepts are embedded near the origin and fine-grained concepts reside closer to the boundary, effectively preserving granularity-sensitive semantic distinctions. 2) Emergence of hubness. Owing to the limited representational capacity induced by the polynomial volume growth of Euclidean space, a large number of entities are forced to crowd into a relatively small region of the embedding space. This geometric crowding gives rise to the hubness phenomenon ( 24 ; 37 ) : certain entities (i.e., hubs) frequently appear in the nearest neighbor sets of other entities. Such hubs tend to be repeatedly retrieved across diverse queries, leading to frequent co-occurrence across retrieval results and reducing retrieval diversity, as shown in Figure 1 (b). As a consequence, Euclidean-based retrieval struggles to return query-specific and discriminative knowledge. In contrast, hyperbolic space exhibits exponential volume growth that naturally accommodates the expansion of hierarchical knowledge, alleviating geometric crowding. As illustrated in Figure 1 (b), the number of high-frequency entities in hyperbolic retrieval is significantly reduced, demonstrating effective mitigation of the hubness problem. To address these limitations, we propose a Hy perbolic R etrieval- A ugmented G eneration (HyRAG) framework to enhance the generalization capability of graph foundation models. Specifically, to model the tree-like hierarchies of the external knowledge base, we introduce the Hyperbolic Knowledge Indexing (HKI) module. This module pre-trains a hyperbolic semantic encoder via an unsupervised optimization paradigm, incorporating both the distance-based objective and the angular constraint to align with the geometric properties of hyperbolic entailment cones. To mitigate the loss of semantic granularity inherent in Euclidean-based retrieval, we develop a Multi-granularity Retrieval (MR) strategy, in which coarse-grained retrieval emphasizes diversity to capture global semantic anchors, whereas fine-grained retrieval focuses on capturing local semantic nuances. Subsequently, tailored to the unique topology of graph data, we propose a Dual-path Fusion (DF) mechanism to effectively integrate knowledge at both the feature and structural levels. Extensive experiments across multiple graph benchmarks demonstrate that our method yields significant improvements in the inference accuracy of GFMs in the zero-shot setting. In summary, our main contributions are as follows: 1)

Read the complete text