Universal and efficient graph neural networks with dynamic attention for machine learning interatomic potentials
Shuyu Bi, Zhede Zhao, Qiangchao Sun, Tao Hu, Xionggang Lu, Hongwei Cheng · 2026
Read Universal and efficient graph neural networks with dynamic attention for machine learning interatomic potentials by Shuyu Bi, Zhede Zhao, Qiangchao Sun, Tao Hu, Xionggang Lu, Hongwei Cheng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22810.txt.
Introduction
Bi and co-authors present MLANet, a graph neural network for machine learning interatomic potentials. Such potentials aim for near-quantum accuracy at far lower cost than first-principles methods. MLANet uses a dual-path dynamic attention scheme for geometry-aware message passing. A multi-view pooling step builds rich system summaries. Tests span organic molecules, crystals, two-dimensional materials, surface reactions, and charged systems. Accuracy stays competitive with top models. Compute cost is markedly lower, and long simulations stay stable.
Catalog record
| CREATOR | Shuyu Bi, Zhede Zhao, Qiangchao Sun, Tao Hu, Xionggang Lu, Hongwei Cheng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40772 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22810
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Universal and efficient graph neural networks with dynamic attention for machine learning interatomic potentials Shuyu Bi, Zhede Zhao, Qiangchao Sun, Tao Hu, Xionggang Lu, Hongwei Cheng Abstract The core of molecular dynamics simulation fundamentally lies in the interatomic potential. Traditional empirical potentials lack accuracy, while first-principles methods are computationally prohibitive. Machine learning interatomic potentials (MLIPs) promise near-quantum accuracy at linear cost, but existing models still face challenges in efficiency and stability. We presents Machine Learning Advances Neural Network (MLANet), an efficient and robust graph neural network framework. MLANet introduces a dual-path dynamic attention mechanism for geometry-aware message passing and a multi-perspective pooling strategy to construct comprehensive system representations. This design enables highly accurate modeling of atomic environments while achieving exceptional computational efficiency, making high-fidelity simulations more accessible. Tested across a wide range of datasets spanning diverse systems, including organic molecules (e.g., QM7, MD17), periodic inorganic materials (e.g., Li-containing crystals), two-dimensional materials (e.g., bilayer graphene, black phosphorus), surface catalytic reactions (e.g., formate decomposition), and charged systems, MLANet maintains competitive prediction accuracy while its computational cost is markedly lower than mainstream equivariant models, and it enables stable long-time molecular dynamics simulations. MLANet provides an efficient and practical tool for large-scale, high-accuracy atomic simulations. Introduction Molecular dynamics (MD) simulations have emerged as a cornerstone methodology for investigating dynamical processes across a wide spectrum of scientific disciplines, including chemistry, biology, physics, and materials science, effectively bridging atomic-scale interactions to macroscopic functional properties MD1 . At the heart of MD resides the calculation of interatomic potentials, which has traditionally relied on empirical potential functions MD2 ; MD3 ; MD4 ; MD5 ; MD6 ; MD7 ; MD8 ; MD9 . While these classical force fields offer O(N) computational efficiency, their accuracy is fundamentally limited by predefined functional forms and manual parameterization, often failing to capture complex many-body interactions unke_machine_2021 ; mueller_machine_2020 ; shapeev_moment_2016 ; Stocker_2022 . To achieve quantum-mechanical accuracy, ab initio molecular dynamics (AIMD) methods based on density functional theory (DFT) have been extensively utilized and applied kohn_self-consistent_nodate . Although DFT provides rigorous first-principles precision, its prohibitive O(N³) computational scaling restricts simulations to systems below 1,000 atoms and picosecond timescales, making large-scale phenomena like defect dynamics or catalytic reactions computationally intractable Plimpton_1993 ; niethammer_ls1_2014 . For such cases, parallelized domain decomposition and specialized algorithms can extend the accessible scale of classical MD , albeit without quantum accuracy. The advent of machine learning interatomic potentials (MLIPs) has revolutionized this landscape, offering near-DFT accuracy with linear computational scaling. By training on ab initio datasets, MLIPs infer energies and forces through data-driven representations, bypassing explicit electronic structure calculations reiser_graph_2022 ; jmi.2025.17 . Early invariant MLIPs like CGCNN xie_crystal_2018 , SchNet schutt_schnet_2018 and DimeNet gasteiger_directional_2022 relied on handcrafted geometric features (e.g., interatomic distances, angles), but their fixed descriptors struggled to distinguish configurations with identical local geometries unke_physnet_2019 ; lu_pre-training_2024 . Subsequent advances in MLIPs, such as ALIGNN choudhary_atomistic_2021 and M3GNet chen_universal_2022 , incorporated higher-body terms like dihedral angles, improving angular resolution while maintaining E(3) invariance . A paradigm shift occurred with the introduction of SE(3)-equivariant architectures, which explicitly preserve rotational and translational symmetries through tensor representations . Models like Allegro musaelian_learning_2023 , NequIP batzner_e3-equivariant_2022 and MACE Batatia2022mace leverage spherical harmonics and irreducible representations (irreps) to encode atomic environments, achieving sub-meV/atom errors on benchmarks through tensor product operations. These equivariant MLIPs demonstrate superior data efficiency, requiring orders of magnitude fewer training samples than invariant counterparts. Recent extensions, such as eSCN, reduce the computational overhead of high-order irreps (Lmax) from O(L^{6}) to O(L^{3}) , enabling maximum rotation order up to l_{max}=8 while retaining quantum accuracy fu2025learningsmoothexpressiveinteratomic . Despite these advances, critical challenges persist: Computational complexity remains a significant barrier, as high-order tensor products in equivariant models incur substantial costs, limiting practical l_{max} values and forcing trade-offs between angular resolution and speed Plimpton_1993 ; niethammer_ls1_2014 . This computational burden mirrors the traditional trade-offs seen in classical force field development, where higher accuracy typically came at the expense of performance slim_toward_2008 ; liu_large-scale_2023 . Parallelization bottlenecks further compound these issues - the message-passing mechanism in MLIPs expands the effective communication radius to r c × N layers in spatial decomposition schemes, causing redundant computations and poor scaling beyond 32,000 atoms even on 64 GPUs batatia2025foundationmodelatomisticmaterials . In this work, we propose the MLANet framework. The model employs a geometry-aware dual-path dynamic attention mechanism within its equivariant message-passing layers, which adaptively modulates interatomic interactions based on both geometric and chemical features, alongside a physics-informed multi-perspective pooling strategy that mitigates information loss by combining complementary pooling operations. These designs are engineered to balance high accuracy with superior computational efficiency, addressing a central challenge in modern equivariant graph neural networks. The following sections systematically demonstrate its performance: validating its accuracy and stability in predicting energies and forces on organic molecular datasets such as QM7 blum ; rupp and MD17 MD17 ; examining its fitting and generalization capabilities for energy-volume relationships, atomic pair interactions, and long-range van der Waals forces in inorganic material systems including SiO 2 erhard_machine-learned_2022 , Ge-Sb-Te zhou_device-scale_2023 , and black phosphorus deringer_general-purpose_2020 ; and assessing its application potential in systems such as two-dimensional materials (e.g., bilayer graphene ying_effect_2024 ) and surface catalysis (e.g., formic acid decomposition batzner_e3-equivariant_2022 ). In addition, the model demonstrates competitive performance in charged systems and quantum chemical property predictions for organic molecules ramakrishnan2014quantum ; zou_deep_2023 ; ko_fourth-generation_2021 . Our results show that while maintaining accuracy comparable to mainstream equivariant models, MLANet achieves a significant improvement in computational efficiency, providing an efficient and reliable solution for high-accuracy atomic simulations across scales. Figure 1: The architecture of MLANet. a Overall Model Architecture. b Internal Structure of MLANet. c Message Passing Layer of MLANet. Results Model Architecture The core of our framework builds upon an equivariant graph neural network with two specialized components (Fig. 1 ): Equivariant Message Passing with geometry-aware dual-path dynamic Graph Attention that combines tensor products with spherical harmonics to maintain SE(3) -equivariance during neighbor aggregation and adaptively modulate message flows based on both geometric distances and chemical embeddings; multi-perspective Pooling that concatenate additive, mean, and max graph-level features before final prediction. Graph Construction The atomic system is represented as a graph G=(V,E,C) , where: V=\{v_{i}\}_{i=1}^{N} is the node feature vector formed by concatenating atomic type embeddings: v_{i}=\operatorname{Embedding}(z_{i}) (1) where z_{i} denotes the atomic type. E=\{e_{i,j}\} represents edge features, and the Bessel function basis is defined as: \operatorname{RBF}_{n}(x)=\sqrt{\frac{2}{r_{\text{cut}}}}\frac{j_{n}\left(\frac{\alpha_{n,m}x}{r_{\text{cut}}}\right)}{|j_{n}(\alpha_{n,m})|} (2) where j_{n} is the n -th order Bessel function. \alpha_{n,m} is the m -th root of j_{n} . r_{\text{cut}} is the cutoff radius. The normalization ensures orthonormality within the cutoff radius. The edge construction method accounts for periodic boundary conditions, where C\in\mathbb{R}^{3\times 3} is the optional unit cell matrix. We do not explicitly provide the unit cell as model input; it is implicitly considered through the edge construction process. Equivariant Message Passing and Update The message passing layer in MLANet implements a geometry-aware dual-path dynamic attention mechanism. Its operation proceeds through the following sequence of mathematical operations: The spherical harmonics up to maximum rotation order l_{max} are computed for the normalized direction vectors \hat{r}_{ij} between neighboring atoms: Y_{1}(\hat{r}_{ij})=\operatorname{SH}(\hat{r}_{ij}) (3) Edge features are transformed by processing raw edge attributes through head-specific linear layer W_{\text{edge\_raw}} , processing spherical harmonics through separate