Accelerating Moment Tensor Potentials through Post-Training Pruning

Zijian Meng, Karim Zongo, Matthew Thoms, Ryan Grant, Laurent Karim Béland · 2025

Read Accelerating Moment Tensor Potentials through Post-Training Pruning by Zijian Meng, Karim Zongo, Matthew Thoms, Ryan Grant, Laurent Karim Béland (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19737.txt.

Introduction

Zijian Meng and four co-authors speed up Moment Tensor Potentials, machine-learning models that predict forces between atoms in materials simulations. These potentials choose their basis functions by a level scheme that ignores the actual data, leaving expensive functions in place even when they contribute little. The authors add a pruning step that runs after training.

Their cost-aware strategy removes the priciest basis functions while barely denting accuracy, and it needs no new training data. Applied to nickel and to silicon-oxygen systems, the pruned potentials ran up to seven times faster than standard ones. Because the method stays compatible with existing implementations, practitioners can adopt it without rebuilding their simulation workflows.

Catalog record

CREATORZijian Meng, Karim Zongo, Matthew Thoms, Ryan Grant, Laurent Karim Béland
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-19737

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Accelerating Moment Tensor Potentials through Post-Training Pruning Zijian Meng, Karim Zongo, Matthew Thoms, Ryan Grant, Laurent Karim Béland Abstract Moment Tensor Potentials (MTPs) are machine-learning interatomic potentials whose basis functions are typically selected using a level-based scheme that is data-agnostic. We introduce a post-training, cost-aware pruning strategy that removes expensive basis functions with minimal loss of accuracy. Applied to nickel and silicon–oxygen systems, it yields models up to seven times faster than standard MTPs. The method requires no new data and remains fully compatible with current MTP implementations. keywords American Chemical Society, L a T e X † † email: [email protected]; [email protected] † † affiliation: Department of Mechanical and Materials Engineering, Queen’s University, Kingston, ON Canada † † affiliation: Department of Electrical and Computer Engineering, Queen’s University, Kingston, ON Canada † † affiliation: Department of Mechanical and Materials Engineering, Queen’s University, Kingston, ON Canada † † abbreviations: IR,NMR,UV † † suppinfo: C Machine-learning interatomic potentials (MLIPs) offer a tunable compromise between the accuracy of first-principles methods and the efficiency of empirical potentials. MLIP frameworks include neural network potentials, Bayesian approaches, and linear regression on systematically constructed basis functions. The latter category provides a practical balance between accuracy and efficiency, encompassing established formalisms such as the Spectral Neighbor Analysis Potential (SNAP) Thompson et al. 2015 , the Moment Tensor Potential (MTP) Shapeev 2016 , and the Atomic Cluster Expansion (ACE) Drautz 2019 . Efforts to improve the efficiency of MLIPs have been made on several fronts. On the training side, one major direction has been to reduce the cost of generating high-quality data, which depends on expensive quantum-mechanical calculations. Active learning strategies Podryabinkin and Shapeev 2017 ; Zhang et al. 2019 and automated data-driven generation Poul et al. 2023 ; Karabin and Perez 2020 have lowered the cost of curating effective training datasets. Some of our recent work has shown that smaller training configurations can capture essential physics while substantially reducing data-generation costs Luo et al. 2023 ; Meziere et al. 2023 ; Sun et al. 2024 ; Meng et al. 2025 . As machine-learning potentials are increasingly applied in large-scale MD, the computational cost of evaluating atomic energies and forces can become a limiting factor. On the hardware side, several efforts have focused on high-performance implementations using GPU acceleration through Kokkos-based backends in the LAMMPS Thompson et al. 2022 MD engine Nguyen-Cong et al. 2021 ; Lysogorskiy et al. 2021 . We recently contributed an efficient GPU-enabled MTP implementation in LAMMPS Meng et al. 2025 . A complementary direction for improving efficiency lies in the algorithmic design of the basis set itself. For example, Thompson et al. used the DAKOTA optimization framework Adams et al. 2011 to tune hyperparameters in SNAP, such as the bispectrum components and cutoff radius Thompson et al. 2015 . In ACE, users specify hyperparameters such as the correlation order ( \nu ), the maximum radial index ( n_{\text{max}} ), and the maximum angular momentum ( l_{\text{max}} ), which together define the basis. The basis can then be systematically expanded using a hierarchical ladder fitting scheme Lysogorskiy et al. 2021 ; Bochkarev et al. 2022 . By contrast, the MTP basis is governed by a single level parameter that counts combinations of radial and angular indices with fixed weights. This design is straightforward and systematic, but it implicitly assumes that all tensor contractions contribute equally to the balance between accuracy and computational cost. In practice, the basis functions are evaluated through a recursive style compute tree that is highly cost-asymmetric: different contractions can differ in cost by more than an order of magnitude. Recently, Wang et al. proposed alternative level definitions that increase the number of radial basis functions, leading to improved performance Wang et al. 2025 . Here, we introduce a post-training pruning strategy for the MTP basis that explicitly accounts for computational cost. Starting from a fully trained base potential, we apply a multiobjective evolutionary algorithm (EA) to identify subsets of basis functions that jointly optimize accuracy and cost. Accuracy is estimated by refitting the linear coefficients while keeping the radial components fixed, and cost is evaluated heuristically by traversing the compute tree. The procedure yields a family of potentials distributed along a cost–accuracy Pareto front. The resulting pruned MTPs can be used directly with existing implementations, including MLIP-2 Novikov et al. 2020 , MLIP-3 Podryabinkin et al. 2023 , and our LAMMPS implementation Meng et al. 2025 , without code modification. Although pruning was tuned for the CPU implementation, the resulting models remain compatible with GPU backends with potentially different scaling behavior. Additional details are provided in the Supporting Information. The optimization workflow was implemented in Python using the pymoo framework Blank and Deb 2020 , primarily employing the Non-dominated Sorting Genetic Algorithm II (NSGA-II) Deb et al. 2002 , with limited tests using the Multiobjective Evolutionary Algorithm based on Decomposition (MOEA/D) Zhang and Li 2007 . Numerical operations relied on NumPy Harris et al. 2020 , and compute-tree traversal was accelerated with Numba Lam et al. 2015 . Parallel evaluations were performed using mpi4py Dalcín et al. 2005 ; Dalcin and Fang 2021 , replacing pymoo ’s built-in parallel backend. While strong scaling remains bounded by serial components of the evolutionary algorithm, this approach enables efficient exploration of the Pareto front. The code is open-source and available as a pip-installable package from GitHub Meng 2025 . We demonstrate our pruning strategy on two representative systems: nickel, using the dataset of Andolina et al. Andolina and Saidi 2023 from ColabFit Vita et al. 2023 as an example of a simple face-centered-cubic metal, and silicon–oxygen, using the 1159-structure dataset of Zongo et al. Zongo et al. 2024 as a complex covalent–ionic system. For both materials, reference MTPs were trained using MLIP-3 across levels 6–28 following the standard level definitions of the MLIP code. Each level was fitted 32 times with randomized initial parameters, and the model with the lowest training loss was retained for further evaluation. The level-28 MTP served as the base potential for subsequent pruning. The resulting cost–accuracy Pareto fronts are shown in Fig. 1 , from which twelve representative potentials were selected, taking the better-performing results from either of the two evolutionary algorithms. Figure 1: Left: Nickel. Right: Silicon–oxygen. Cost–accuracy Pareto fronts obtained from the pruning process using NSGA-II and MOEA/D, each normalized to the base potential (MTP level 28). Twelve representative potentials, labeled A–L, were selected to span the Pareto fronts and illustrate the range of achievable cost–accuracy tradeoffs. NSGA-II consistently identified models with lower computational cost and higher accuracy compared with MOEA/D. To assess how initialization affects the fitting of the pruned potentials, we compared two strategies: random initialization and parameter inheritance from the base level-28 MTP. In the random initialization strategy, the twelve representative MTPs (A–L) were fitted from scratch using MLIP-3, following the same random seeding protocol as for the level-based potentials. The inherited initialization refitted MTPs (A-L) with MLIP-3 using the base potential’s parameters as a starting point. Fig. 2 compares the better-performing initialization for each pruned model against the original MTP levels in terms of training loss, energy per atom mean absolute error (MAE), and force MAE. In both material systems, inherited initialization generally yielded

Read the complete text