Feature-aware Hypergraph Generation via Next-Scale Prediction

Dorian Gailhard, Enzo Tartaglione, Lirida Naviner, Jhony H. Giraldo · 2025

Read Feature-aware Hypergraph Generation via Next-Scale Prediction by Dorian Gailhard, Enzo Tartaglione, Lirida Naviner, Jhony H. Giraldo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01467.txt.

Introduction

Dorian Gailhard and co-authors present a stepwise generator for graphs and hypergraphs that keeps node and link features, in a paper from two thousand twenty-five. Graph generators handle small structures well but stall on large, complex ones. Layered methods scale better, yet often drop the features that real uses need.

Their frame grows a sample scale by scale, through local expansion and polish. A node budget knob controls grain and keeps scales consistent with each other. Tests spanned fake data, three-dimensional meshes, and point clouds. Scores matched or beat the best rivals, while scaling to far larger featured structures.

Catalog record

CREATORDorian Gailhard, Enzo Tartaglione, Lirida Naviner, Jhony H. Giraldo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-01467

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Feature-aware Hypergraph Generation via Next-Scale Prediction Dorian Gailhard, Enzo Tartaglione, Lirida Naviner, Jhony H. Giraldo Abstract Hypergraphs generalize traditional graphs by allowing hyperedges to connect multiple nodes, making them well-suited for modeling complex structures with higher-order relationships, such as 3D meshes, molecular systems, and electronic circuits. While topology is central to hypergraph structure, many real-world applications also require node and hyperedge features. Existing hypergraph generation methods focus solely on topology, often overlooking feature modeling. In this work, we introduce FAHNES ( f eature- a ware h ypergraph generation via ne xt - s cale prediction), a hierarchical approach that jointly generates hypergraph topology and features. FAHNES builds a multi-scale representation through node coarsening, then learns to reconstruct finer levels via localized expansion and refinement, guided by a new node budget mechanism that controls cluster splitting. We evaluate FAHNES on synthetic hypergraphs, 3D meshes, and molecular datasets. FAHNES achieves competitive results in reconstructing topology and features, establishing a foundation for future research in featured hypergraph generative modeling. 1 Introduction Figure 1: Examples of generated featured hypergraphs by a sequential disjoint generation baseline and our model (FAHNES). Hypergraphs extend traditional graphs by allowing edges—called hyperedges —to connect more than two nodes, enabling a natural representation of complex, multi-way interactions. This expressiveness makes hypergraphs well-suited for modeling systems in molecular chemistry, electronic circuit design, and 3D geometry. As a result, they have been applied in diverse areas such as drug discovery [ 1 ] , contagion modeling [ 2 ] , recommendation systems [ 3 ] , molecular biology [ 4 ] , and urban planning [ 5 ] . Despite their wide applicability, generative models for hypergraphs remain relatively underexplored. Existing approaches primarily focus on generating topology alone [ 6 ] , neglecting the generation of node and hyperedge features. As shown in Figure 1 , the sequential generation of topology followed by features is ineffective. Joint generation is particularly challenging for hypergraphs due to their variable-size hyperedges and higher structural complexity. Moreover, existing methods for featured graph generation use flat, non-hierarchical architectures, which scale poorly [ 7 , 8 , 9 ] . In this work, we introduce a f eature- a ware h ypergraph generation via ne xt - s cale prediction (FAHNES) model, a novel hierarchical approach for jointly generating hypergraph topology and features. Inspired by multi-scale generative strategies in image synthesis [ 10 ] , FAHNES leverages a coarsening-expansion strategy [ 6 , 11 ] : during training, it merges nodes based on connectivity to build a hierarchical representation, then learns to progressively recover finer-scale hypergraphs. A key contribution is the use of a budget mechanism that tracks the number of permissible expansions per cluster. This enables global structural constraints to influence local generation, helping to mitigate the limited receptive fields of deep models. Additionally, we adapt flow-matching optimal transport (OT) coupling techniques [ 12 , 13 ] to learn straighter and more consistent flows during generation. Our main contributions are: • We introduce the first hierarchical model for joint generation of hypergraph topology and features targeting specific data distributions, such as 3D meshes and molecules. • We propose a novel budget-based mechanism that improves global consistency during generation for hierarchical methods. • We generalize minibatch OT-coupling to our hypergraph generative setting. • We validate our approach on both synthetic and real-world datasets, including molecular structures and 3D meshes, showing promising results for hierarchical generative methods. 2 Related Work Graph and hypergraph generation using deep learning . Graph generation has seen significant advances in recent years. Early approaches, such as GraphVAE [ 14 ] , employed autoencoders to embed graphs into latent spaces for sampling. Subsequent models leveraged recurrent neural networks to sequentially generate adjacency matrices, improving structural fidelity [ 15 ] . More recently, diffusion-based methods have enabled permutation-invariant graph generation [ 16 , 7 ] , with extensions incorporating structural priors such as node degrees [ 17 ] . Many of these previous methods jointly model node features and topology, but are limited to small graphs due to scalability challenges. For example, diffusion-based models [ 7 , 8 , 9 ] operate over entire graphs by gradually corrupting structures and features, then training models to denoise them. However, their scalability is constrained by the combinatorial nature of edge prediction in large graphs. To mitigate this, hierarchical methods have been proposed. For example, Bergmeister et al . [ 11 ] introduced a scalable graph generation framework based on a coarsen-then-expand approach, merging nodes to form coarse representations and progressively reconstructing finer details. This framework was extended to hypergraphs by Gailhard et al . [ 6 ] , which allows edges to connect more than two nodes. However, both methods focus exclusively on topology generation, neglecting node and hyperedge features essential for many applications. Applications of hypergraph generation . Generative models that capture both higher-order structure and node/hyperedge features are critical in numerous domains. In molecular design, regular graph generative models struggle to accurately represent rings and scaffolds [ 7 ] , which naturally correspond to hyperedges involving multi-atom interactions rather than pairwise bonds. Similarly, 3D shape modeling involves surfaces such as triangles, quads, or general polygons that extend beyond simple pairwise connectivity. Conventional approaches often rely on fixed topology, quantization, or autoregressive sequence modeling with transformers [ 18 , 19 ] , limiting their flexibility and scalability. Hypergraphs provide a more expressive framework by treating faces as hyperedges, enabling the joint generation of topology and features. In contrast to previous approaches that either target hypergraph topology alone or feature-aware graph generation, we introduce the first method that jointly models both hypergraph structure and features within a unified and scalable framework. FAHNES extends hierarchical generative methods with feature-aware expansions, a novel node budget mechanism, and flow-matching training adapted to our strategy. This combination enables effective generative modeling for featured hypergraphs. 3 Feature-aware Hypergraph Generation via Next - scale Prediction ((a)) Hypergraph ((b)) Clique expansion ((c)) Star expansion Figure 2: Comparison of a hypergraph and its clique and star expansions. Notations . Throughout this paper, we use calligraphic letters, like \mathcal{V} , to represent sets, with their cardinality denoted by |\mathcal{V}| . Matrices are represented by bold uppercase letters ( e . g ., \mathbf{A} ), while vectors are indicated by bold lowercase letters ( e . g ., \mathbf{x} ). The transpose and point-wise multiplication operations are denoted by (\cdot)^{\top} and \odot , respectively. \lceil\cdot\rfloor denotes rounding to the nearest integer. Basic definitions . We define a graph G=(\mathcal{V},\mathcal{E}) as a pair consisting of a set of vertices \mathcal{V} and a set of edges \mathcal{E}\subseteq\mathcal{V}\times\mathcal{V} . Graphs may also carry node and edge features, represented by matrices \mathbf{F}_{\mathcal{V}}\in\mathbb{R}^{|\mathcal{V}|\times m} and \mathbf{F}_{\mathcal{E}}\in\mathbb{R}^{|\mathcal{E}|\times l} , where m and l denote the dimensionality of the features. Each edge e\in\mathcal{E} corresponds to a pair (u,v) , indicating a connection between nodes u and v . A bipartite graph B=(\mathcal{V}_{L},\mathcal{V}_{R},\mathcal{E}) is a special case where the vertex set is split into two disjoint subsets \mathcal{V}_{L} and \mathcal{V}_{R} , and edges exist only between the two parts, i . e ., \mathcal{E}\subseteq\mathcal{V}_{L}\times\mathcal{V}_{R} . The full set of nodes is \mathcal{V}=\mathcal{V}_{L}\cup\mathcal{V}_{R} . In this work, we consider node features for bipartite graphs, denoted by \mathbf{F}_{L}

Read the complete text