Data Curation for Machine Learning Interatomic Potentials by Determinantal Point Processes
Joanna Zou, Youssef Marzouk · 2026
Read Data Curation for Machine Learning Interatomic Potentials by Determinantal Point Processes by Joanna Zou, Youssef Marzouk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22160.txt.
Introduction
Zou and Marzouk use determinantal point processes to pick training data for machine learning atomic potentials. Labeling atomic setups with quantum methods is costly, so training sets must stay small but diverse. Their method scores candidate setups with kernels built from molecular descriptors. It then selects a compact subset that still spans the space well. Tests on hafnium oxide data show the picks rival current approaches. The resulting models gain in accuracy and robustness. The authors also flag uses in active learning during simulations.
Catalog record
| CREATOR | Joanna Zou, Youssef Marzouk |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33556 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22160
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data Curation for Machine Learning Interatomic Potentials by Determinantal Point Processes Joanna Zou, Youssef Marzouk Abstract The development of machine learning interatomic potentials faces a critical computational bottleneck with the generation and labeling of useful training datasets. We present a novel application of determinantal point processes (DPPs) to the task of selecting informative subsets of atomic configurations to label with reference energies and forces from costly quantum mechanical methods. Through experiments with hafnium oxide data, we show that DPPs are competitive with existing approaches to constructing compact but diverse training sets by utilizing kernels of molecular descriptors, leading to improved accuracy and robustness in machine learning representations of molecular systems. Our work identifies promising directions to employ DPPs for unsupervised training data curation with heterogeneous or multimodal data, or in online active learning schemes for iterative data augmentation during molecular dynamics simulation. 1 Introduction A primary challenge in the development of machine learning interatomic potentials (MLIPs) for atomistic simulation is the high degree of sensitivity of model performance to the choice of training set. In practice, parameters of MLIPs are learned from a training set of atomic configurations labeled with reference ground state energy and force values obtained from higher-order quantum mechanical (QM) calculations such as density functional theory (DFT). Due to the significant cost of QM calculations, training datasets must be limited in size to keep the data generation task computationally tractable and reduce overfitting to redundant data, but also retain representation of conformational diversity in order to produce robust MLIPs capable of capturing chemical processes of interest. In this work, we propose using determinantal point processes (DPPs) for automated training set construction for machine learning-driven atomistic simulation. A DPP is an efficient probabilistic model over subsets of discrete sets which assigns greater likelihood to subsets with diverse elements, as determined by the determinant of a kernel matrix measuring the similarity between elements. Our work is one of the first to compare state-of-the-art data subselection algorithms on the task of training MLIPs, assessed in terms of diversity of atomic environments sampled, accuracy of the MLIP as it varies with training set size, and transferrability of the MLIP to predicting energies of atomic environments unseen during training. 2 Background and Related Work Data subselection is one form of active learning , in which an algorithm queries informative samples from a large pool of unlabeled data to label using a cost-intensive process for regression tasks. For MLIP training, the initial pool of unlabeled data is generally sourced from 1) hand-crafted datasets using expert judgment for each system of study, such as those of the QM9 database ( 23 ) ; or 2) from time steps of molecular dynamics (MD) simulation which are efficiently evaluated using an empirical potential or initial iterate of the MLIP to approximately sample from the Gibbs distribution of the system. However, since the step size must be sufficiently small for stable numerical simulation (on the order of 10^{-12} or 10^{-15} seconds), configurations generated by MD simulation are highly correlated and lead to high redundancy in the dataset. Data subselection techniques seek to assemble compact training sets which improve on hand-crafted datasets as well as the naive approach of uniform sampling from the MD trajectory. In 13 , the descriptor space is partitioned into clusters using Euclidean distances via k -means which are each subsampled randomly. However, the k -means algorithm is sensitive to the geometry of the descriptor space and performs poorly in the high dimensional regime, which is often the setting for molecular descriptors. In 22 ; 20 , the MaxVol algorithm identifies an optimal subset of configurations whose descriptors span the largest volume, based on the D-optimality criterion in linear experimental design. This approach is limited to choosing a fixed number of data, namely the same number as the dimension of the descriptors, to form a square D-optimal matrix. In the entropy-maximization method in 15 ; 7 , local maxima of a chosen entropy function are assumed to be sufficiently non-redundant and included in the training dataset. This method heavily relies on the assumption that the full support of an effective potential function can be adequately sampled such that the local maxima correspond to well-separated modes of the entropy function. Each method utilizes a different similarity metric to compare atomic configurations, summarized in Table 1 in Appendix A.1 , with the aim to reduce redundancy in the training set. In the absence of labels, samples must be selected in an unsupervised manner utilizing only information on the atomic environment, which is summarized using descriptors which characterize multi-body interactions while preserving invariance properties of the representation. Examples of such descriptors include symmetric polynomials (ACE potential, 9 ), bispectrum components (SNAP potential, 25 ), SOAP descriptors (GAP potential, 2 ), atom-centered symmetry functions ( 5 ) , SMILES strings used in graph neural network (NN) potentials ( 29 ) , or other latent representations learned simultaneously by NN potentials such as NequIP ( 4 ) and Allegro ( 3 ) . In principle, the choice of descriptors for active learning may be independent from the choice of MLIP architecture which is trained, though the expressiveness of the descriptor – its ability to distinguish between atomic environments – will affect the efficiency of the data subselection algorithm. Figure 1: Sample subsets drawn with each method from a MD trajectory of alanine dipeptide. To illustrate the data subselection methods, Figure 1 shows subsets of N=5 configurations of alanine dipeptide, taken from a 50-ns Langevin dynamics simulation at 300 K using the AMBER ff-99SB-ILDN force field, sourced from 28 . The subsets are drawn using two collective variables (backbone dihedral angles \phi,\psi ) as the descriptors of the atomic configurations. Unlike the uniform random subset, the subsets drawn with the DPP and k -means more consistently distribute the five selected points to distinct regions of descriptor space, utilizing similarity-based metrics and distance-based clustering respectively. The MaxVol algorithm is limited to selecting 2 points (equal to the collective variable dimension), and these configurations are located at the bounds of the descriptor space in order to maximize the volume enclosed by their span. 3 Methodology DPPs have seen a recent surge of interest in applications to machine learning ( 17 ) , experimental design ( 8 ) , and dimensionality reduction ( 6 ) . This section gives an intuitive introduction to DPPs, with details in Appendix A.4 . If the data pool is modeled by a point process, where each configuration constitutes a point in descriptor space, then a DPP is a type of repulsive point process which favors the sampling of distinctly unique and non-clustered points. Unlike other repulsive point processes, DPPs have several features, including closed-form probabilities and efficient sampling algorithms, which make them attractive in ML applications ( 19 ) . Along this vein, simple random sampling can be interpreted as a homogeneous Poisson process where points are purely independent and uniformly distributed. As a point process model, a DPP places a random measure over all subsets of a discrete dataset \mathcal{Y} of M elements. The degree of repulsion between elements is controlled by a kernel matrix K\in\mathbb{R}^{M\times M} , where K_{ij}=\kappa(Y_{i},Y_{j}) for some positive semidefinite (PSD) kernel