BLIPs: Bayesian Learned Interatomic Potentials
Dario Coscia, Pim de Haan, Max Welling · 2025
Read BLIPs: Bayesian Learned Interatomic Potentials by Dario Coscia, Pim de Haan, Max Welling (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14022.txt.
Introduction
Dario Coscia, Pim de Haan, and Max Welling add honest doubt to computer models of how atoms push and pull on each other. Their paper is from two thousand twenty-five. Such models drive most modern chemistry simulations. But they can be wrong on new kinds of data, and they give no sign of how unsure they are.
Their method, called BLIPs, wraps any such model in a Bayesian layer that reports its own uncertainty. It adds little cost when the model runs. In tests, it improved accuracy and gave doubt levels that matched real errors well. The gains were largest where training data was scarce or new. It could also fine-tune models that were already trained, with the same benefits.
Catalog record
| CREATOR | Dario Coscia, Pim de Haan, Max Welling |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-14022
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BLIPs: Bayesian Learned Interatomic Potentials Dario Coscia, Pim de Haan, Max Welling Abstract Machine Learning Interatomic Potentials (MLIPs) are becoming a central tool in simulation-based chemistry. However, like most deep learning models, MLIPs struggle to make accurate predictions on out-of-distribution data or when trained in a data-scarce regime, both common scenarios in simulation-based chemistry. Moreover, MLIPs do not provide uncertainty estimates by construction, which are fundamental to guide active learning pipelines and to ensure the accuracy of simulation results compared to quantum calculations. To address this shortcoming, we propose BLIPs: Bayesian Learned Interatomic Potentials. BLIP is a scalable, architecture-agnostic variational Bayesian framework for training or fine-tuning MLIPs, built on an adaptive version of Variational Dropout. BLIP delivers well-calibrated uncertainty estimates and minimal computational overhead for energy and forces prediction at inference time, while integrating seamlessly with (equivariant) message-passing architectures. Empirical results on simulation-based computational chemistry tasks demonstrate improved predictive accuracy with respect to standard MLIPs, and trustworthy uncertainty estimates, especially in data-scarse or heavy out-of-distribution regimes. Moreover, fine-tuning pretrained MLIPs with BLIP yields consistent performance gains and calibrated uncertainties. 1 Introduction Deep learning is transforming computational chemistry and materials science, enabling advances in molecular design ( Özçelik et al., 2024 ; Eijkelboom et al., 2024 ; Zeni et al., 2023 ; Merchant et al., 2023 ) , simulation-based modelling ( Batatia et al., 2022 ; Wood et al., 2025 ; Neumann et al., 2024 ) , and particle-based systems ( Kipf et al., 2018 ; Alkin et al., 2024 ; Zhdanov et al., 2025 ) . At the forefront of this progress are Message Passing Neural Networks (MPNNs) ( Scarselli et al., 2008 ; Kipf and Welling, 2016 ; Gilmer et al., 2017 ) , which have emerged as core architectures for learning in atomistic and molecular domains. Their ability to natively incorporate essential physical symmetries, such as translational, rotational, and permutation invariance or equivariance ( Cohen and Welling, 2016 ; Weiler et al., 2023 ; Bronstein et al., 2017 ; Cohen et al., 2019 ) , makes them particularly well-suited for modelling the complex interactions that define atomic-scale systems. Consequently, MPNNs are now widely adopted in the development of Machine Learning Interatomic Potentials (MLIPs), where they serve as efficient and accurate surrogates for quantum and classical simulations. These models enable large-scale atomistic simulations with near ab initio accuracy, dramatically accelerating research in materials discovery, catalysis, and molecular dynamics ( Wood et al., 2025 ; Neumann et al., 2024 ; Batatia et al., 2022 ) . However, like most deep learning models, MLIPs are vulnerable to failure, particularly when faced with out-of-distribution (OOD) data. This issue is further worsened in scientific domains, where generating labelled data often requires expensive and time-consuming simulations ( Papamarkou et al., 2024 ) . Indeed, for simulation-based chemistry, training data is often obtained from Density Functional Theory (DFT) calculations, which scale cubically with system size, making it impractical to generate data for larger molecules or materials. Moreover, the chemical space is vast and inherently undersampled, making distributional shifts inevitable ( Özçelik et al., 2025 ; Tan et al., 2023 ) . These challenges make principled Uncertainty Quantification (UQ) essential for enabling error-aware simulations or guiding active learning pipelines. Among existing approaches, Deep Ensembles ( Lakshminarayanan et al., 2017 ) are commonly used for UQ in MLIPs and have shown strong empirical performance compared to other UQ methods ( Tan et al., 2023 ) . However, they require training and storing multiple models, making them computationally and memory-intensive, particularly in large-scale or high-throughput scientific workflows. Other simpler UQ methods, such as MC Dropout ( Gal and Ghahramani, 2016 ) or mixture models, tend to be less memory-intensive but provide worse uncertainty estimates, and their predictive accuracy may degrade compared to standard deterministic models. To overcome these limitations, we introduce Bayesian Learned Interatomic Potentials (BLIPs) , a general variational Bayesian method that is scalable, accurate, and provides principled, well-calibrated uncertainty estimates for MLIPs. BLIP can be applied both when training or fine-tuning pretrained machine learning interatomic potentials. It builds on an adaptive version of Variational Dropout ( Kingma et al., 2015 ) , where the MPNNs’ weights are stochastically perturbed depending on the network’s input data. BLIP does not depend on the chosen MPNN architecture and seamlessly integrates with a vast family of invariant and equivariant models. Importantly, our approach adds minimal computational overhead compared to deterministic models in both training and predictive inference, while providing well-calibrated uncertainties and improvement in predictive accuracy. We evaluate our approach on various simulation-based chemistry tasks, focusing on small and large-scale systems. In both domains, we show that training with BLIP not only improves predictive performance but also produces meaningful uncertainty estimates. Furthermore, we demonstrate that fine-tuning a single pretrained MLIP with BLIP not only consistently improves predictive performance but also outperforms an ensemble of fine-tuned models, while simultaneously providing reliable uncertainty estimates. The code accompanying this work is available at https://github.com/dario-coscia/blip . Figure 1: Bayesian Learned Interatomic Potentials (BLIPs) for Prediction and Uncertainty Quantification. An atomic structure is encoded as a graph, with initial node features \bm{h}^{0} and edge features a_{ij} , and processed by a standard Message Passing Neural Network (MPNN). BLIP introduces stochasticity into the machine learned interatomic potential (MLIP) by injecting zero-mean Gaussian noise into the message and update functions. Specifically, the deterministic weights \bm{\theta}^{M}_{l} and \bm{\theta}^{U}_{l} are perturbed using perturbation scales \alpha_{l} and \beta_{l} (obtained through an inference network), respectively, yielding stochastic weights \bm{\omega}^{M}_{l} and \bm{\omega}^{U}_{l} . The main weights \bm{\theta}^{M}_{l} and \bm{\theta}^{U}_{l} , and the inference network weights are trained jointly using variational inference. This transforms MLIP into BLIP, a probabilistic model, enabling principled uncertainty quantification and improved predictive accuracy. 2 Background and Related Work In this section, we present the relevant background on message passing neural networks, Bayesian modelling, uncertainty quantification, and machine learning force fields, which will later support the formulation of our proposed method. 2.1 Message Passing Neural Networks Message Passing Neural Networks ( Scarselli et al., 2008 ; Kipf and Welling, 2016 ; Gilmer et al., 2017 ) are a class of (permutation equivariant) neural networks that process graph-structured data. Given a Graph \mathcal{G}=(\mathcal{V},\mathcal{E}) with nodes v_{i}\in\mathcal{V} , and edges e_{ij}\in\mathcal{E} , the MPNNs operations for each layer l=0,\dots,L-1 can be summarised as: \displaystyle\begin{split}\textbf{message + aggregation:}&\quad\bm{m}_{i}^{l+1}=\bigoplus_{j\in\mathcal{N}(i)}M_{l}(\bm{h}_{j}^{l},a_{ij})\\ \textbf{update:}&\quad\bm{h}_{i}^{l+1}=U_{l}(\bm{h}_{i}^{l},\bm{m}_{i}^{l+1})\\ \end{split} (1) where \bm{h}_{i}^{l} is the feature vector for node i at layer l , a_{ij} are the edge attributes, and \bigoplus_{j\in\mathcal{N}(i)} is a permutation invariant pooling operation over the node i neighbors \mathcal{N}(i) (e.g. sum or mean). Finally, M_{l},U_{l} are learnable message and update functions usually approximated with small neural networks. 2.2 Bayesian Models and Uncertainty Quantification Bayesian models have a long history in Deep Learning ( Hinton and Van Camp, 1993 ; Welling and Teh, 2011 ; Graves, 2011 ; Blundell et al., 2015 ; Gal and Ghahramani, 2016 ) , providing a principled framework for modelling uncertainty through probabilistic inference. Instead of treating neural network weights as fixed parameters, Bayesian approaches represent them as probability distributions, \bm{\omega}\sim p(\bm{\omega}) . Given a dataset \mathcal{D}=\{(\mathbf{x}_{i},\mathbf{y}_{i})\}_{i=1}^{N} of N i.i.d. input-output observations, the goal is to infer the posterior distribution over weights, p(\bm{\omega}\mid\mathcal{D}) , using Bayes’ theorem ( Bayes, 1763 ) . Predictive inference is