Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions
Paul Fuchs, Julija Zavadlav · 2025
Read Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions by Paul Fuchs, Julija Zavadlav (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03974.txt.
Introduction
Machine-learned force fields promise fast simulations with near-quantum quality, yet they often miss the temperatures at which real materials change phase. Paul Fuchs and Julija Zavadlav propose a repair strategy in a 2025 computational physics preprint. Their complaint is specific: biased training data can shift predicted transition points by several hundred kelvin, far too much for practical design work.
Instead of retraining on more reference data, the method learns top-down from experiment. A differentiable trajectory reweighting algorithm adjusts the model until the free energy difference between phases vanishes at the true pressure and temperature. On pure titanium, the corrected model matched the true transition points within tenths of a kelvin up to five gigapascals, and liquid diffusion improved too. The method is model-blind, extends to systems with several elements, and can target other known properties.
Catalog record
| CREATOR | Paul Fuchs, Julija Zavadlav |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-03974
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions Paul Fuchs, Julija Zavadlav Abstract Foundational Machine Learning Potentials can resolve the accuracy and transferability limitations of classical force fields. They enable microscopic insights into material behavior through Molecular Dynamics simulations, which can crucially expedite material design and discovery. However, insufficiently broad and systematically biased reference data affect the predictive quality of the learned models. Often, these models exhibit significant deviations from experimentally observed phase transition temperatures, in the order of several hundred kelvins. Thus, fine-tuning is necessary to achieve adequate accuracy in many practical problems. This work proposes a fine-tuning strategy via top-down learning, directly correcting the wrongly predicted transition temperatures to match the experimental reference data. Our approach leverages the Differentiable Trajectory Reweighting algorithm to minimize the free energy differences between phases at the experimental target pressures and temperatures. We demonstrate that our approach can accurately correct the phase diagram of pure Titanium in a pressure range of up to 5 GPa, matching the experimental reference within tenths of kelvins and improving the liquid-state diffusion constant. Our approach is model-agnostic, applicable to multi-component systems with solid-solid and solid-liquid transitions, and compliant with top-down training on other experimental properties. Therefore, our approach can serve as an essential step towards highly accurate application-specific and foundational machine learning potentials. 1 Introduction Molecular Dynamics (MD) is an important tool to discover new alloys for catalysis and manufacturing, understand their behavior, and optimize production processes. For example, MD simulations provide microscopic insights into the thermal stability of high-entropy alloys [ 1 ] or how crystallization affects microstructure and mechanical properties [ 2 , 3 ] . Efficient high-throughput MD simulations enable active-learning guided search of high-temperature alloys [ 4 ] . However, the typically employed classical potentials model interactions through simple functional forms with only a few tunable parameters. Therefore, these potentials may fail to accurately reproduce multiple material properties with the same parametrization [ 5 ] . More critically, parametrizations are not necessarily transferable across allotropes of the same element [ 6 ] . Thus, they can significantly fail to describe phase stability [ 6 , 7 ] and consequently the chemical potential important for crystallization [ 8 ] . Machine Learning Potentials (MLPs) promise to overcome the limitations of classical force fields. MLPs offer significantly improved accuracy, closely reproducing costly ab initio computations [ 9 , 10 , 11 ] , while remaining scalable to million-atom systems [ 12 , 10 ] . Many MLPs have been tailored to specific metals and alloys [ 7 , 13 ] through a typical workflow of dataset generation, parameter optimization, and model validation [ 14 ] . To cover a broad range of relevant system conformations, the datasets contain relaxed, stressed, and defective samples from multiple crystal structures, often generated with active learning and MD simulations at a wide range of temperatures [ 7 , 13 ] . Still, when subsequently validated on phase stability predictions, the trained models only qualitatively reproduce experimental measurements but fail to match them closely within a magnitude of tens to hundreds of kelvins [ 7 , 13 , 14 ] . Foundational MLP approaches aim to extend property prediction through MD simulation to a much wider class of chemically diverse materials by training on even more diverse and extensive datasets [ 15 , 16 , 17 ] . However, these models can exhibit significant deviations from experimental measurements [ 18 ] . For example, melting temperatures are sometimes underestimated by several hundreds of kelvins [ 17 ] .The reasons for the deviation of application-specific and foundation MLPs from experimental results are multifaceted. Especially for foundational models, biases in the dataset towards specific structures or compounds can manifest as model bias [ 18 ] . Moreover, even carefully created and extensive datasets might omit important system conformations related to rare events [ 19 ] or might suffer from systematic computational errors [ 20 ] . Even if these errors are addressed through extensive benchmarks [ 18 , 19 ] , practically affordable density-functional theory calculations are often insufficiently accurate to describe experimental measurements of complex material properties [ 14 , 13 , 21 ] . For example, different DFT functionals significantly over- or underestimate melting temperatures of many pure metals and semiconductors, sometimes in magnitudes up to hundreds of kelvins [ 22 , 23 , 24 ] . In principle, transfer learning strategies that extend the DFT dataset with more accurate electronic structure methods could further increase the accuracy of the MLPs [ 25 ] . However, such methods significantly increase computational costs, which potentially render dataset generation, especially for foundational models or bulk systems, computationally intractable. Instead of improving the underlying data quality, so-called top-down learning approaches ensure consistency with experiments by directly training MLPs to match experimental measurements [ 26 , 27 , 28 ] . However, experimentally observable quantities are not direct outputs of the MLP, unlike force and energy, but are typically obtained by averaging system properties over long MD simulations. Thus, top-down training requires more advanced algorithms, as directly applying automatic differentiation to such simulations does not guarantee meaningful gradients and might suffer from high memory requirements [ 26 ] . The model-agnostic DiffTRe [ 26 ] algorithm leverages statistical mechanics reweighting approaches [ 29 , 30 ] to efficiently compute gradients for equilibrium observables. This computation remains efficient even when observables, such as fluctuation-based stiffness constants [ 26 , 27 ] or free energies [ 28 ] , require extensive sampling. For only a few specified experimental data points, top-down learning of complex MLPs is ill-posed. Purely top-down learned MLPs predict off-target properties with high uncertainty [ 26 ] . On the other hand, top-down training can be used to regularize or refine MLPs trained via Force Matching rather than for training MLPs from scratch. This combination can correct pretrained MLPs for discrepancies with experimental data without inducing a large deviation from the underlying reference data [ 27 ] . Previous work has shown that MLPs can be refined top-down to predict solid-solid phase transitions at a target temperature [ 31 ] . However, this approach is restricted to matching the free energy of linear models and is not directly applicable to solid-liquid phase transitions. In this paper, we propose the model-agnostic Differentiable Transition Temperature Correction (DiffTTC) method to correct MLPs towards accurate predictions of phase diagrams. The DiffTTC method adjusts the MLP using the model-agnostic and flexible DiffTRe algorithm such that the free energy difference between pairs of phases at target temperatures and pressures fulfills the thermodynamic criterion of phase coexistence. As an example of titanium, we demonstrate that our algorithm can simultaneously correct for solid-solid and solid-liquid phase transitions. Moreover, we assess that the procedure does not degrade the MLP performance on out-of-target properties and can be applied with other previously reported DiffTRe training targets [ 27 ] . We evaluate our findings in the light of current foundational models, providing a path towards general-purpose MLPs that can predict complex material properties with high accuracy. 2 Methods 2.1 Transition Temperature Computation We compute transition temperatures for the phase diagram using the thermodynamic theory of phase transitions and direct solid-liquid interface simulations.