Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligence DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 9–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Data mining CCS: Computing methodologies Neural networks CCS: Computing methodologies Unsupervised learning CCS: Mathematics of computing Topology

Philip S. Yu, Li Sun · 2026

Read Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligence DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 9–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Data mining CCS: Computing methodologies Neural networks CCS: Computing methodologies Unsupervised learning CCS: Mathematics of computing Topology by Philip S. Yu, Li Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21601.txt.

Introduction

Yu and Sun argue that graph foundation models should be built on Riemannian geometry rather than on graph neural networks or language models. Neural networks struggle with memory and interpretability across domains, while text serializations lose graph structure. Geometry, they contend, captures structure directly and still fits semantic learning. Their proposed Riemannian Foundation Model centers on intrinsic graph geometry, with built-in structural inference and generation. They sketch a staged agenda toward general-purpose graph intelligence driven by such models. The piece is a position paper, not an experimental study.

Catalog record

CREATORPhilip S. Yu, Li Sun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28464
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21601

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Riemannian Geometry Speaks Louder Than Words: From Graph Foundation Model to Next-Generation Graph Intelligence DOI: XXXXXXX.XXXXXXX Conference: 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 9–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Data mining CCS: Computing methodologies Neural networks CCS: Computing methodologies Unsupervised learning CCS: Mathematics of computing Topology Philip S. Yu, Li Sun Abstract . Graphs provide a natural description of the complex relationships among objects, and play a pivotal role in communications, transportation, social computing, the life sciences, etc. Currently, there is strong agreement that Graph Foundation Models (GFMs) are essential for advancing graph learning, yet considerable disagreement persists on how to build a powerful, general-purpose GFM analogous to Large Language Models (LLMs). Graph Neural Networks (GNNs) exhibit limitations in memory retention and principled interpretability when confronted with multi-domain pretraining and adaptation. The challenge of graph serialization hinders the direct application of LLMs, as the words struggle to capture the structural complexity and diversity inherent in graphs. In contrast, Riemannian geometry offers an elegant mathematical framework for modeling structures, while remaining compatible with graph semantic learning, even with LLMs. In this paper, we argue that, for graphs, Riemannian geometry speaks louder than words , and lay out the foundational principles for GFM. Reimagining with Riemannian geometry, we introduce a blue sky idea– Riemannian Foundation Model (RFM)–that opens a new pathway for capturing complex structural patterns and uncovering cross-domain generalities. RFM emphasizes intrinsic graph geometry and embodies endogenous capacities for structural inference and generation, moving beyond mere representation-space switching. Accordingly, we outline a progressive agenda that begins with universal structural understanding through intrinsic geometry, and then rebuilds LLM with a Riemannian engine for general-purpose graph modeling and beyond. Thus, RFM enables a paradigm shift from designing graph models to solving graph-structured applications with RFM agents, unlocking the next-generation graph intelligence. Figure 1 . Left: Google Trends for Graph Foundation Model and Graph Pre-training. Right: Proportion of existing graph foundation model papers by architecture type. Table 1 . Capability Matrix of Graph Foundation Models (GFMs) across Diverse Tasks OpenGraph ( Xia et al. 2024 ) OFA ( Liu et al. 2024a ) GraphAny ( Zhao et al. 2025b ) RAGraph ( Jiang et al. 2024 ) GCOPE ( Zhao et al. 2024 ) GRAVER ( Yuan et al. 2025a ) GIT ( Wang et al. 2025c ) RiemannGFM ( Sun et al. 2025a ) BRIDGE ( Yuan et al. 2025b ) GraphGPT ( Tang et al. 2024a ) AnyGraph ( Xia and Huang 2024 ) AutoGFM ( Chen et al. 2025 ) SA 2 GFM ( Shi et al. 2025 ) MDGPT ( Yu et al. 2024 ) SAMGPT ( Yu et al. 2025 ) FedGFM+ ( Zhu et al. 2025a ) FedBook ( Wu et al. 2025 ) UniGraph ( He and Hooi 2024 ) MDGCL ( Zhao et al. 2025a ) GFT ( Wang et al. 2024 ) Node Classification ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ Link Prediction ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ Graph-level Task ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ Graph Generation 1. Introduction Graphs are ubiquitous, and graph learning is pivotal to the advancement of data mining and artificial intelligence. The emergence of Large Language Models has catalyzed a profound paradigm shift in this domain, driving the field from specialized, fragmented models toward universal foundation models. Recent efforts to replicate the success of foundation models in graph learning have ignited growing interest in Graph Foundation Models —a class of expressive, general-purpose, pretrainable neural architectures for graphs, as illustrated in Figure 1 . Unlike texts and images, the non-Euclidean nature of graphs charts a distinct developmental course. The road to GFM is currently divided as in Figure 1 , with both prevailing approaches facing inherent challenges. One line of work extends Graph Neural Networks via multi-domain pretraining ( Xu et al. 2024 ; Lachi et al. 2024 ) . However, these models are fundamentally constrained by local message passing and fixed inductive biases, such as Euclidean representation spaces, failing to capture structural diversity. Their limitation in memory retention also impedes the discovery of cross-domain generalities. Another line of work leverages LLMs as the cornerstone, demonstrating initial success primarily on text-attributed graphs ( Liu et al. 2024a ) . This paradigm focuses on devising word-like graph serialization techniques to accommodate LLMs, yet it inherently struggles to traverse the vast structural diversity inherent in graphs ( Yuan et al. 2025a ; Zhang 2023 ) . Also, representing graphs as “word” sequences poses a fundamental challenge in capturing their intricate structural complexity ( Zhou et al. 2025 ) . We argue that, for graphs, Riemannian geometry speaks louder than words. To date, neither LLM-based nor GNN-based approaches have identified the graph generalities or invariances that underpin universal graph modeling. Standing at a crossroads, we return to the essence of graphs—the discrete analogs of manifolds—and thereby illuminate a new direction: a Riemannian geometry approach. Indeed, Riemannian geometry provides a rigorous foundation for graph modeling. In this elegant framework, there exists a powerful toolkit to build GFMs, including: 1) a rich family of manifolds to capture structural diversity, 2) the concept of curvature to delve into structural complexity, 3) the moving frame method ( Sun et al. [n. d.] ) to transfer knowledge across domains, and 4) the construction of vector bundles ( Tu 2011 ) to integrate graph structure and semantics, creating a synergistic interface to integration with LLMs. Grounded in Riemannian geometry, we put forward a blue—sky idea of Riemannian Foundation Model , aimed at general-purpose graph learning and beyond. While a significant body of work on non-Euclidean graph learning exists, it typically focuses on selecting extrinsic representation spaces, such as hyperbolic spaces, tailored to specific graphs ( Sun et al. 2021 ; Sun et al. 2024 ; Wang et al. 2020 ) . Moving beyond the mere switching of representation spaces, RFM emphasizes graph intrinsic geometry such as flatness, symmetry, connectivity, and anisotropy. It offers a principled framework to uncover graph generalities, interpret knowledge transfer across domains, and endow models with endogenous capacities for structural inference and generation. To realize this vision, we outline a progressive agenda toward RFM, thereby opening the next-generation graph intelligence. Analogous to agents for LLMs, RFM agents are envisioned as the key to solving graph-structured applications, from code generation to drug design. (a) vector bundle (b) Parallel Transport Figure 2 . Illustration of parallel transport and vector bundle. 2. Current Challenges 2.1. Are GNNs Generalizable? Graph Neural Networks, powered by the message-passing mechanism, have become the dominant solution for graph representation learning ( Kipf and Welling 2016 ; Hamilton et al. 2017 ; Veličković et al. 2018 ; Chen et al. 2020 ) . Recently, a surge of research has sought to extend GNNs into the realm of foundation models ( Xia et al. 2024 ; Liu et al. 2024a ; Zhao et al. 2024 ; Liu et al. 2024a ) , yet a fundamental mismatch persists between the two. While GNNs are typically trained on specific

Read the complete text