Providing Machine Learning Potentials with High Quality Uncertainty Estimates

Zeynep Sumer, James L. McDonagh, Clyde Fare, Ravikanth Tadikonda, Viktor Zólyomi, David Bray, Edward Pyzer-Knapp · 2025

Read Providing Machine Learning Potentials with High Quality Uncertainty Estimates by Zeynep Sumer, James L. McDonagh, Clyde Fare, Ravikanth Tadikonda, Viktor Zólyomi, David Bray, Edward Pyzer-Knapp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05250.txt.

Introduction

Fast computer models that stand in for slow quantum math now help chemists screen new matter, but a bare number gives no clue how far to trust it. Zeynep Sumer and co-authors tackle that trust gap in a 2025 paper. They swap the usual pack of near-twin models for a single network that also reports its own doubt about each energy it predicts.

Groups of models work, yet they cost time and memory on each run. A network built to weigh its own beliefs gives doubt scores in one pass. Those scores are rich enough to drive a mixed work plan: easy cases stay with the fast model, and hard cases pass to the slow exact method. For labs that run vast screens, knowing when a fast answer is safe can save days of compute time.

Catalog record

CREATORZeynep Sumer, James L. McDonagh, Clyde Fare, Ravikanth Tadikonda, Viktor Zólyomi, David Bray, Edward Pyzer-Knapp
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-05250

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Providing Machine Learning Potentials with High Quality Uncertainty Estimates Zeynep Sumer, James L. McDonagh, Clyde Fare, Ravikanth Tadikonda, Viktor Zólyomi, David Bray, Edward Pyzer-Knapp Abstract Computational chemistry has come a long way over the course of several decades, enabling subatomic level calculations particularly with the development of Density Functional Theory (DFT). Recently, machine-learned potentials (MLP) have provided a way to overcome the prevalent time and length scale constraints in such calculations. Unfortunately, these models utilise complex and high dimensional representations, making it challenging for users to intuit performance from chemical structure, which has motivated the development of methods for uncertainty quantification. One of the most common methods is to introduce an ensemble of models and employ an averaging approach to determine the uncertainty. In this work, we introduced Bayesian Neural Networks (BNNs) for uncertainty aware energy evaluation as a more principled and resource efficient method to achieve this goal. The richness of our uncertainty quantification enables a new type of hybrid workflow where calculations can be offloaded to a MLP in a principled manner. 2021 keywords neural potentials, uncertainty, Bayesian neural networks 1 Introduction In the past half century, chemical sciences have been augmented by the addition of predictive computational tooling; capable of insight at the most fundamental chemical level of electronic interactions. kocer2022neural ; frenkel2023understanding ; sholl2022density Methods in computational chemistry including ab-initio wave function methods and Density Functional Theory (DFT) have enabled molecular and material design applications to become expansive tools used industrially and academically. Recent improvements on computational technologies have helped accelerated the design of chemical compounds to the point that they can be specifically tuned for each application use case. leszczynski2022practical For example, force fields or semi-empirical quantum chemical methods enabled the study of chemical dynamics and this has been very influential in areas such as drug discovery. drug_design ; semi_empirical Nevertheless, these methods are still too computationally costly to deploy on large-scale screening of chemical space necessary for discovery of new materials. unke_machine_2021 Hence, new methods are required that reduce the computational expense while maintaining or improving the accuracy of result. One promising technique is through the combination of fundamental quantum chemical calculation data sets and deep learning. These methods are now commonly referred to as Machine Learning Interatomic Potentials (MLIP). anstine2023machine A subgroup of these potentials, namely Neural Network Potentials (NP), are trained machine learning models which are capable of ingesting chemical information, in the form of a molecular configuration or sum of atomic contributions, and accurately estimating the potential energy of the molecule in seconds as opposed to the hours taken using conventional quantum chemistry techniques. behler_generalized_2007 The NPs have been in the literature for more than two decades and come in a variety of forms, including Gaussian Processes (GP) mcdonagh2019utilizing ; bartok2010gaussian ; deringer2021gaussian ; erhard2022machine and Deep Neural Networks (DNN) smith2017ani ; behler2021four ; schutt2018schnet . There are two main types of NPs, namely descriptor-based and end-to-end NPs, which evaluate the molecular information differently. A detailed history of their evolution can be found elsewhere. behler2021four ; unke_machine_2021 Figure 1: The cost/accuracy trade off in simulation approaches. The ANI potentials family (short for accurate neural network engine for molecular energies ) is an encoder-based NP developed by Isayev et. al. smith2017ani In ANI potentials each element is described by a dedicated neural network where atomic environment vectors (AEVs) determine the potential energy of an atom in given surroundings and the sum of these atomic energies gives the total energy of the molecule. The authors of ANI acknowledge the need to quantify uncertainty, and have achieved this themselves via ensembling. The uncertainty from these ensembles has found utility in identifying areas where the ANI neural potential may need further training. smith2018less In order to make learning more efficient, NPs often exploit the invariances inherent in physical systems. unke_machine_2021 Multiple approaches to uncertainty quantification for neural networks exist, including dropout, wen2020uncertainty single Bayesian layers, fiedler2023improved ensembles, smith2020ani anchored ensembles, pearce2018uncertainty GP Layers, de2024thin neural GPs, lee2017deep and full Bayesian networks. snoek2012practical Table 1: Uncertainty quantification methods, advantages and disadvantages. Method Advantage Disadvantage Ensemble robustness non-informative uncertainty Anchoring ameliorated uncertainty reduced accuracy Dropout prevented over fitting computational cost Bayesian layer last layer uncertainty over fitting of latent layer In the present work, our contribution is to expand this set of methods to Bayesian Neural Networks (BNN). We called our new model variant Modified ANI with Uncertainty Limits (MAUL) following the naming theme of these methods. Utilizing BNNs provides the opportunity to not only train models with excellent mean predictive accuracy but to simultaneously provide well founded uncertainty estimates. Here a BNN allows for a single model to provide both an excellent mean predictive performance together with a well founded uncertainty estimate. We demonstrate that such an uncertainty estimate can be used to successfully bound the overall error from a set of predictions. 2 Results and Discussion 2.1 Energy Calculations We tested both DNN and MAUL by screening a small set of molecules taken from PubChem; in Section 4.2 more information is provided about the selection. Results shown in Figure 2 are the mean and the standard deviation of the predictions by (a) 9 different DNN ensembles, and (b) MAUL results after 20 Monte Carlo samples for single point energies. The coefficient of determination, R^{2} , was 1 in both cases, RMSE values were 1.71 and 1.76 eV, respectively. The RMSE values reflect the difference between the PSI4 optimised calculations, therefore it is expected that for single point energy calculations it is greater compared to optimised geometry results. We also compared the energies of optimised geometries in Figures 2 (c) and (d), calculated by the models with that of PSI4. Results are well correlated for both DNN and MAUL models, both scored R^{2} of 1 and their RMSE values were 0.16 and 0.21, respectively. Both models achieved similar performances and made accurate predictions, particularly with optimisation. Figure 2: a) DNN ensembles’ and b) MAUL predictions of single point energies, and c) DNN ensembles’ and d) MAUL predictions of optimised geomtery energies, as a function of PSI4 calculations for the total of 318 new configurations. Black diagonal line shows where x=y to guide the eye. Figures 3 (a) and (c) depict the standard deviation distribution of each compound in Figure 2 for single point energy and optimised geometry energy, respectively. Although occasionally some DNN ensembles perform poorly, the majority of ensembles produce similar results. Hence, when the ensemble averages are taken the results possess lower standard deviation, on the order of 10 -2 eV. As in the example of 2-Methoxycarbonyloxybenzoic acid and toluene, DNN ensemble model would still yield the average single point energy calculated by all ensembles ( -27080.69\pm 7.19 eV), which is reasonable compared to MAUL results ( -27079.21\pm 0.65 eV) and PSI4 results (-27080.61 eV), yet the uncertainty would yield the differences in ensembles and not the potential energy of the compounds. Figures 3 (b) and (d) show the difference between the PSI4 calculations and the model predictions for single point energy and optimised geometry energy, respectively. Results show that DNN prediction error is higher than the uncertainty in almost all the cases, whereas the other way around is true for MAUL: uncertainties are

Read the complete text