EquiHGNN: Scalable Rotationally Equivariant Hypergraph Neural Networks

Tien Dang, Truong-Son Hy · 2025

Read EquiHGNN: Scalable Rotationally Equivariant Hypergraph Neural Networks by Tien Dang, Truong-Son Hy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05650.txt.

Introduction

Tien Dang and Truong-Son Hy build neural networks that respect both many-way links and rotational symmetry in molecules. Their paper appeared in two thousand twenty-five. Most molecule models link atoms in pairs only. Real chemistry, though, often binds several atoms at once. Hypergraphs can hold those group links.

Their framework, EquiHGNN, makes the network's outputs turn in step when the molecule turns. That rule keeps the learned shapes true to physics. Tests on small and large molecules split the verdict. Group links added little for small molecules but beat plain graphs on large ones. Adding shape facts on top of the group links helped further. The authors share the code in public. The work guides when the extra structure is worth its cost in drug and materials research.

Catalog record

CREATORTien Dang, Truong-Son Hy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-05650

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EquiHGNN: Scalable Rotationally Equivariant Hypergraph Neural Networks Tien Dang, Truong-Son Hy Abstract Molecular interactions often involve high-order relationships that cannot be fully captured by traditional graph-based models limited to pairwise connections. Hypergraphs naturally extend graphs by enabling multi-way interactions, making them well-suited for modeling complex molecular systems. In this work, we introduce EquiHGNN , an Equi variant H yper G raph N eural N etwork framework that integrates symmetry-aware representations to improve molecular modeling. By enforcing the equivariance under relevant transformation groups, our approach preserves geometric and topological properties, leading to more robust and physically meaningful representations. We examine a range of equivariant architectures and demonstrate that integrating symmetry constraints leads to notable performance gains on large-scale molecular datasets. Experiments on both small and large molecules show that high-order interactions offer limited benefits for small molecules but consistently outperform 2D graphs on larger ones. Adding geometric features to these high-order structures further improves the performance, emphasizing the value of spatial information in molecular learning. Our source code is available at https://github.com/HySonLab/EquiHGNN/ . 1 Introduction Molecular systems exhibit complex, high-order interactions, including conjugated \pi -systems, hydrogen bonding networks, and ring strain effects [ 1 , 2 ] . Taking advantage of the inherent benefits of graph-based representations, Graph Neural Networks (GNNs) have been widely used to model molecular interactions [ 3 ] due to their ability to efficiently learn relational structures. GNNs leverage message passing mechanisms to aggregate information from neighboring atoms, making them well suited to encode local connectivity and bond-based interactions [ 4 , 5 ] . However, standard GNNs primarily model pairwise relationships between nodes, limiting their ability to represent the multi-body dependencies inherent in molecular interactions. Furthermore, they often lack explicit geometric information, such as spatial coordinates, bond angles, and torsional relationships, that is crucial for accurately capturing the three-dimensional structure and properties of molecules. Figure 1: a) Illustration of a hypergraph constructed from a molecule, where vertices represent atoms and hyperedges represent conjugated bonds, highlighted in blue and orange. b) Hypergraph to Bipartite representations. Topological Deep Learning (TDL) [ 6 , 7 , 8 ] offers a robust framework to overcome the limitations of GNN by integrating higher-order structures that extend beyond simple node-to-node connections. Techniques such as simplicial complexes [ 9 ] , cell complexes [ 10 ] , combinatorial complexes [ 6 , 11 ] and hypergraphs [ 12 , 13 , 14 ] enrich traditional graph representations by capturing complex multi-body interactions intrinsic to molecular systems. By embedding these topological structures within deep learning architectures, we can achieve a more holistic and principled understanding of molecular interactions. This approach has already led to state-of-the-art performance in a variety of machine learning tasks [ 12 , 15 , 11 , 16 ] , and holds significant promise to advance research and applications in the applied sciences and beyond. In addition to topological considerations, molecular interactions are inherently governed by geometric constraints. Geometric Deep Learning (GDL) [ 17 ] incorporates geometric priors, such as structural and symmetry information about the input space, which are essential to maintain spatial symmetries and to ensure that the learned representations accurately reflect the physical properties of molecules. A key requirement in molecular modeling is the equivariance to transformations such as rotations, translations, and reflections. Recent advancements in equivariant architectures enable the integration of geometric constraints into deep learning models, ensuring that molecular representations align with the principles of three-dimensional spatial organization [ 18 , 19 , 20 , 21 , 22 , 23 , 24 ] . Although previous work has explored integrating symmetry into simplicial [ 25 ] and combinatorial complexes [ 26 ] , incorporating equivariant features into hypergraphs offers a more expressive and adaptable framework for modeling complex multi-body interactions in molecular systems. Unlike other complex-based representations, hypergraphs provide a more direct and scalable approach to capturing these interactions, enabling more intuitive molecular modeling. Given these advantages, in this study we focus on hypergraphs to model high-level interactions in molecular systems. We introduce EquiHGNN, a unified framework that seamlessly integrates topological and geometric learning to model molecular interactions while preserving geometric consistency. Instead of designing a complex message-passing framework, we initialize the hypergraph features with symmetry-aware geometric representations and invariant scalar information, enabling the model to effectively capture structural and functional properties without sacrificing equivariance. Compared to baseline models that do not incorporate symmetry into hypergraph representations, our approach encodes both scalar and geometric features within a unified framework. We evaluated our model on QM9 [ 27 ] , OPV [ 28 ] , PCQM4Mv2 [ 29 ] , and Molecule3D [ 30 ] to assess both accuracy and scalability. While QM9 and OPV contain small molecules, PCQM4Mv2 and Molecule3D test performance on large-scale graphs. Our model achieved competitive results across all datasets, demonstrating strong generalization and scalability to complex molecular structures. Our contributions are as follows. • We propose Equivariant Hypergraph Neural Network (EquiHGNN) for molecular property prediction that effectively captures both scalar and geometric features through hypergraph representations. Its modular and intuitive design enables seamless integration with existing frameworks and allows reuse of publicly available models. • We conducted an empirical study to analyze the impact of various architectural choices and configurations, exploring different equivariant approaches. Specifically, we examine the use of EGNN [ 31 ] in the Euclidean domain, Equiformer [ 32 ] in the Fourier domain, and FAFormer [ 24 ] in the frame domain. • We observe that high-order interactions in hypergraphs, although slightly less effective on small molecules, consistently enhance performance on large-scale graphs. Additionally, integrating 3D geometric information into the hypergraph significantly improves the accuracy of the model. 2 Related Work 2.1 Graph Neural Network Graph Neural Networks (GNNs) have been widely developed to improve representation learning in graph-structured data, enabling effective modeling of relational and structural information [ 33 ] . GraphSAGE [ 34 ] introduced an inductive framework that aggregates information from the local neighborhood of a node, allowing generalization to unseen graphs. More general, Message Passing Neural Networks (MPNNs) [ 3 ] are a foundational class of GNNs that iteratively update node representations by aggregating and transforming information from their neighbors, enabling effective learning on graph-structured data. Graph Convolutional Networks (GCN) [ 35 ] leveraged spectral graph theory to perform efficient message passing through neighborhood-based feature propagation. Graph Isomorphism Networks (GIN) [ 36 ] maximized expressive power by using sum aggregation, making them as discriminative as the Weisfeiler-Lehman test for graph isomorphism. Graph Attention Networks (GAT) [ 37 ] integrated attention mechanisms to dynamically weight neighbor contributions, improving the model’s ability to capture important structural dependencies. However, these models operate on discrete graph structures, lack inherent equivariance or invariance to geometric transformations such as rotations, translations, and reflections, and can only model pairwise interactions, making them impractical for capturing high-order molecular interactions such as conjugate bonds. This work addresses these limitations by proposing EquiHGNN, a framework that incorporates both geometric awareness and higher-order interaction modeling. 2.2 Geometric Graph Neural Networks Geometric graph [ 17 ] is a special kind of graph with geometric information, e.g. the positions of the atoms in 3D coordinates, encapsulating rich directional information that depicts the geometry of the system, making the

Read the complete text