LightPFP: A Lightweight Route to Ab Initio Accuracy at Scale

Wenwen Li, Nontawat Charoenphakdee, Yong-Bin Zhuang, Ryuhei Okuno, Yuta Tsuboi, So Takamoto, Junichi Ishida, Ju Li · 2025

Read LightPFP: A Lightweight Route to Ab Initio Accuracy at Scale by Wenwen Li, Nontawat Charoenphakdee, Yong-Bin Zhuang, Ryuhei Okuno, Yuta Tsuboi, So Takamoto, Junichi Ishida, Ju Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23064.txt.

Introduction

Wenwen Li leads a team of eight researchers with LightPFP, a method to reach quantum-level accuracy in atom simulations at far lower cost. Machine-learned potentials can mimic quantum results, but task-specific ones need costly quantum data for each new material. Universal ones are flexible yet heavy to run at scale.

LightPFP uses knowledge distillation to train light models from a teacher, cutting the quantum data needed. The resulting potentials aim for ab initio accuracy with the speed large simulations demand. Modelers could study bigger systems for longer times, from batteries to catalysts, without giving up trustworthy forces.

Catalog record

CREATORWenwen Li, Nontawat Charoenphakdee, Yong-Bin Zhuang, Ryuhei Okuno, Yuta Tsuboi, So Takamoto, Junichi Ishida, Ju Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-23064

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LightPFP: A Lightweight Route to Ab Initio Accuracy at Scale Preprint: AIP/123-QED Wenwen Li, Nontawat Charoenphakdee, Yong-Bin Zhuang, Ryuhei Okuno, Yuta Tsuboi, So Takamoto, Junichi Ishida, Ju Li Abstract Atomistic simulation methods have evolved through successive computational levels, each building upon more fundamental approaches: from quantum mechanics to density functional theory (DFT), and subsequently, to machine learning interatomic potentials (MLIPs). While universal MLIPs (u-MLIPs) offer broad transferability, their computational overhead limits large-scale applications. Task-specific MLIPs (ts-MLIPs) achieve superior efficiency but require prohibitively expensive DFT data generation for each material system. In this paper, we propose LightPFP, a data-efficient knowledge distillation framework. Instead of using costly DFT calculations, LightPFP generates a distilled ts-MLIP by leveraging u-MLIP to generate high-quality training data tailored for specific materials and utilizing a pre-trained light-weight MLIP to further enhance data efficiency. Across a broad spectrum of materials, including solid-state electrolytes, high-entropy alloys, and reactive ionic systems, LightPFP delivers three orders of magnitude faster model development than conventional DFT-based methods, while maintaining accuracy on par with first-principles predictions. Moreover, the distilled ts-MLIPs further sustain the computational efficiency essential for large-scale molecular dynamics, achieving 1-2 orders of magnitude faster inference than u-MLIPs. The framework further enables efficient precision transfer learning, where systematic errors from the u-MLIP can be corrected using as few as 10 high-accuracy DFT data points, as demonstrated for MgO melting point prediction. This u-MLIP-driven distillation approach enables rapid development of high-fidelity, efficient MLIPs for materials science applications. I Introduction The development of accurate and computationally efficient atomistic energy methods is critical for enabling large-scale atomistic simulations in materials science, catalysis, and chemistry. The evolution of these methods over several decades can be conceptualized as an ecological “food chain” (Fig. 1 ), where each higher level “feeds on” the computational results of lower levels, gaining efficiency while potentially sacrificing some accuracy in the process. At the bottom of the food chain lie the most accurate but computationally intensive quantum mechanical methods, such as full configuration interaction (FCI) and quantum Monte Carlo (QMC). Although formally exact, they do not have great performance in computational and memory scaling with the number of electrons, and therefore are limited to systems with on the order of ten atoms. The second level is occupied by density functional theory (DFT), which “consumes” the results from lowest-rung, for example, electron gas simulations using QMC Ceperley and Alder 1980 , to parametrize its exchange-correlation functionals (e.g. PBE generalized gradient approximation, or r 2 SCAN meta-GGA approximation). DFT can handle a few hundred atoms, which is the reason it is widely used for crystal structure discovery and property prediction. However, it is computationally challenging to simulate extended defects directly, or even finite-temperature sampling. Moving up the chain, machine learning interatomic potentials (MLIPs) represent the third level, “feeding on” large datasets of DFT calculations. Among these, universal MLIPs (u-MLIPs) have gained significant attention for their broad chemical transferability. They are trained on chemically diverse structures spanning many elements and bonding motifs, and they encode physical symmetries to generalize across the periodic table e.g., Matlantis PFP ( Takamoto et al. 2022 ; mat ) , M3GNet ( Chen and Ong 2022 ) , CHGNet ( Deng et al. 2023 ) , MACE ( Batatia et al. 2022 ; Batatia et al. 2023 ) . In particular, Matlantis PFP is noted for training on a highly complex and diverse DFT database, contributing to its superior robustness. Numerous studies have demonstrated its applicability without fine-tuning across a wide range of materials, including battery Kong et al. 2025 ; Hinuma and Kitta 2025 ; Narumi et al. 2025 ; Son et al. 2024 ; Kwon et al. 2024 ; Du et al. 2023 , MOF Shimada et al. 2024 ; Koh et al. 2024 , ceramics Hinuma 2024 ; Miura et al. 2024 , catalyst Watanabe et al. 2025 , polymer Honbo et al. 2024 , nanotube Hisama et al. 2024 , atomic layer deposition Kim et al. 2024a ; Jin et al. 2024 , Hydrogen storage Kim et al. 2024b , superconductor Ishikawa, Tanaka, and Tsuneyuki 2024 , memristor Bae et al. 2024 . Despite their universality, computational efficiency remains a bottleneck in large-scale simulations. This raises a fundamental question: can we extend this food chain further to achieve even greater computational efficiency? Task-specific MLIPs (ts-MLIPs) with simpler architectures, such as moment tensor potential (MTP), Novikov et al. 2020 DeePMD, Wang et al. 2018 and Allegro, Musaelian et al. 2023 demonstrate that significant speed improvements are possible, but they face a critical bottleneck. These methods still “feed” directly on DFT data—the same food source as universal MLIPs—requiring extensive and time-consuming DFT calculations for each new material system. This training process can take weeks or months, severely limiting their practical deployment despite their superior inference speed. To overcome the bottlenecks of both u-MLIPs and ts-MLIPs, we propose LightPFP, a fast-to-train and fast-to-run framework for constructing ts-MLIPs through knowledge distillation from a u-MLIP. LightPFP achieves a favorable balance between computational efficiency and accuracy while avoiding the prohibitive training costs of traditional ts-MLIPs that arise from DFT calculations. Figure 1 : A standard “food chain” of atomistic calculation methods. To support the assessment of LightPFP’s evolutionary position toward the “apex predator” in the ecosystem of atomistic methods, let us consider different sources of error in a practical atomistic simulation, vis-à-vis the computational cost. For reference, even though Fig. 1 does not show any experimental method, the typical error bars in experimental thermochemical measurements of formation/reaction enthalpies are taken to be 1 kcal/mol, the so-called “chemical accuracy” as named by John Pople, which is 43 meV/atom. The formally exact calculations, when fully converged (a big if) in basis set, etc., should agree with present-day state-of-the-art experiments to much better than the chemical accuracy, so much so that these calculations are sometimes taken to be the ground truth rather than the experiments. But note that in Fig. 1 , the largest error comes from the formally exact \rightarrow DFT, due to the intrinsic limitations of DFT expressivity. The training of DFT \rightarrow PFP took a long time and a lot of resources Takamoto et al. 2023 , but that is already done for each released version of PFP, and the final DFT \rightarrow PFP transfer error is small. As will be shown in the present paper, the PFP \rightarrow LightPFP transfer error is even smaller, and the training is fast (typically overnight). For detailed discussion, see supplementary information I. One should also consider that many practical simulation tasks incur error beyond the intrinsic level-of-theory error. For example, in computing the defect formation energies, if a small calculation supercell with periodic boundary condition (PBC) is used, there will be image interactions Li et al. 2004 both electronically and elastically. Thus, even if DFT is intrinsically more accurate than LightPFP by 30 meV/atom, LightPFP may end up giving more accurate defect formation energy and other defect reaction behaviors, by virtue of using a much larger simulation supercell that greatly reduces the image artifacts. Broadly applicable calculations which are much, much faster to run, and potentially more accurate than DFT in practice, might become really competitive in the atomistic simulator ecosystem. The broad applicability of LightPFP to

Read the complete text