Beyond Force Metrics: Pre-Training MLFFs for Stable MD Simulations
Shagun Maheshwari, Janghoon Ock, Adeesh Kolluru, Amir Barati Farimani, John R. Kitchin · 2025
Read Beyond Force Metrics: Pre-Training MLFFs for Stable MD Simulations by Shagun Maheshwari, Janghoon Ock, Adeesh Kolluru, Amir Barati Farimani, John R. Kitchin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-14850.txt.
Introduction
Shagun Maheshwari and co-authors show that a low error score is no pledge of a sound run in a 2025 paper. Their tools learn the push on each atom in a brew, to speed up runs that trace how drugs and stuffs move.
Two runs of the same net went head to head. One learned from a small set cold. The next first learned from a huge set of burnt-fuel scenes, then tuned on the small set. Both called the push with like small error. Yet the pre-taught net held its runs three times as long before they flew apart. Its inner maps came out more cleanly shaped, and its push bent more smoothly as shapes shifted. The authors urge the field to grade such tools by run health, not by error alone.
Catalog record
| CREATOR | Shagun Maheshwari, Janghoon Ock, Adeesh Kolluru, Amir Barati Farimani, John R. Kitchin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-14850
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Force Metrics: Pre-Training MLFFs for Stable MD Simulations Shagun Maheshwari, Janghoon Ock, Adeesh Kolluru, Amir Barati Farimani, John R. Kitchin Abstract Machine-learning force fields (MLFFs) have emerged as a promising solution for speeding up ab initio molecular dynamics (MD) simulations, where accurate force predictions are critical but often computationally expensive. In this work, we employ GemNet-T, a graph neural network model, as an MLFF and investigate two training strategies: (1) direct training on MD17 (10K samples) without pre-training, and (2) pre-training on the large-scale OC20 dataset followed by fine-tuning on MD17 (10K). While both approaches achieve low force mean absolute errors (MAEs), reaching 5 meV/Å per atom, we find that lower force errors do not necessarily guarantee stable MD simulations. Notably, the pre-trained GemNet-T model yields significantly improved simulation stability, sustaining trajectories up to three times longer than the model trained from scratch. These findings underscore the value of pre-training on large, diverse datasets to capture complex molecular interactions and highlight that force MAE alone is not always a sufficient metric of MD simulation stability. keywords American Chemical Society, L a T e X † † affiliation: Department of Materials Science Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA † † affiliation: Department of Chemical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA † † affiliation: Department of Chemical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA † † affiliation: Department of Mechanical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA † † email: [email protected] † † affiliation: Department of Chemical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA † † email: [email protected] † † abbreviations: IR,NMR,UV 1 Introduction Molecular dynamics (MD) simulation is a computational method used to analyze the physical movements of atoms and molecules over time, enabling the exploration of molecular interactions, structural rearrangements, and thermodynamic properties at the atomic scale. The primary aim of MD simulations is to provide insights into atomistic processes that are challenging or impossible to observe experimentally. Typical examples include folding pathways of small proteins and peptides Lindorff-Larsen et al. 2011 , ligand binding kinetics in drug discovery campaigns Nunes-Alves et al. 2020 , ion transport in solid-state battery electrolytes Mabuchi et al. 2021 , crack propagation in structural alloys Lee et al. 2023 , and nucleation events in super-cooled liquids Sosso et al. 2016 . Density functional theory (DFT) plays a critical role in molecular dynamics (MD) simulations by providing quantum mechanical calculations of interatomic forces derived from the electronic structure. While DFT yields highly accurate forces by explicitly accounting for electron interactions, its computational cost scales poorly with system size and simulation time, limiting its applicability to large-scale or long-timescale simulations Unke et al. 2021 . This limitation renders DFT impractical for long MD trajectories involving hundreds of thousands of time-steps or for simulations of systems with thousands of atoms. Consequently, classical MD simulations often rely on empirical force fields that approximate these interactions, sacrificing some accuracy to achieve feasible simulation durations and system sizes. Smith et al. 2017 Gunceler et al. 2023 To address the computational limitations of ab initio methods like DFT, MLFFs have emerged as promising alternatives for MD simulations Unke et al. 2021 . MLFFs are data-driven models trained to approximate the potential energy surface (PES) and interatomic forces of atomistic systems based on reference calculations from quantum mechanical methods like DFT. By learning the mapping from atomic configurations to energies and forces, MLFFs enable simulations that approach quantum-level accuracy while being orders of magnitude faster than traditional ab initio approaches. As a result, they allow the exploration of larger systems and longer timescales that would otherwise be intractable using direct quantum mechanical methods. Significant advancements have been made in the field of MLFFs, primarily through graph neural network (GNN) models such as SchNet Schütt et al. 2017 , DimeNet Gasteiger et al. 2020 , PaiNN Schütt et al. 2021 , DeepPot-SE Zhang et al. 2018 , NequIP Batzner et al. 2022 , and GemNet Gasteiger et al. 2021 . These models leverage graph-based representations where atoms are treated as nodes and atomic interactions as edges. SchNet introduced continuous convolutional filters to model atomic interactions, while DimeNet extended these ideas by explicitly incorporating angular information. PaiNN further refined the approach by utilizing equivariant message-passing layers that respect rotational symmetries. GemNet advanced this by incorporating directional embeddings to better capture radial and angular geometric features, providing superior handling of directional information crucial for accurate molecular force prediction. Despite their successes, MLFFs exhibit notable shortcomings, particularly regarding simulation stability and extrapolation behavior. A benchmark study conducted by Fu et al. Fu et al. 2023 emphasizes the limitations of force prediction metrics alone, demonstrating that high accuracy in force prediction does not always correlate with stable, realistic MD trajectories. They observed that models frequently failed simulations due to instability caused by extrapolation errors, where models predicted extreme, non-physical forces for configurations inadequately represented in training datasets. This instability often resulted in catastrophic trajectory divergence, bond breakage, and unrealistic configurations, even if models initially exhibited low force prediction errors. Fu et al. Fu et al. 2023 highlighted that these failures predominantly occur in simulations requiring long timescales or involving systems with complex interactions not well captured by the training data. These findings highlight stability and comprehensive configurational space coverage as critical metrics, suggesting that the development of robust MLFFs requires training on diverse molecular configurations to improve both simulation stability and accuracy. Motivated by these limitations, we explored pre-training strategies for improving MLFF performance and stability. Prior studies have shown substantial benefits of pre-training, where initial training on large and diverse datasets enhances the transferability and robustness of MLFFs. For example, pre-training has been shown to significantly enhance the generalizability and stability of models, allowing them to better capture complex molecular interactions encountered in extended simulations Chanussot et al. 2021 ; Raja et al. 2025 ; Wang et al. 2025 ; Guntuboina et al. 2023 . Additionally, recent work has shown that pretrained models, such as EquiformerV2, can be fine-tuned to achieve state-of-the-art performance even on challenging, out-of-domain systems like high-entropy alloys, significantly accelerating atomistic discovery in materials science Clausen et al. 2024 . More broadly, various forms of pre-training allow graph neural networks to develop transferable atomic representations across diverse domains. These include small molecules, catalysts, and inorganic crystals, fostering more universal chemical understanding Wang et al. 2022 ; Magar et al. 2022 ; Ock et al. 2024 . In this study, we investigate how pre-training an MLFF, specifically GemNet-T, on large-scale datasets impacts the stability of MD simulations. We show that pre-training on diverse atomic systems, including catalyst datasets, followed by fine-tuning on smaller molecular datasets, effectively reduces overfitting and enhances generalizability. These results underscore the significance of comprehensive, large-scale pre-training in capturing complex molecular interactions and provide a foundational framework for developing robust MLFFs for MD simulations. 2 Methods 2.1 Molecular Dynamics Simulation MD simulation is a computational method used to model the physical movements of atoms and molecules over time by solving Newton’s equations of motion Frenkel and Smit 2001 . The MD simulation follows the Newtonian equation of motion,