BOOM: Benchmarking Out-Of-distribution Molecular Property Predictions of Machine Learning Models
Evan R. Antoniuk †, Shehtab Zaman ‡*, Tal Ben-Nun †, Peggy Li †, James Diffenderfer †, Busra Demirci ‡, Obadiah Smolenski ‡, Everett Grethel †, Tim Hsu †, Anna M. Hiszpanski †, Kenneth Chiu ‡, Bhavya Kailkhura †, Brian Van Essen † · 2025
Read BOOM: Benchmarking Out-Of-distribution Molecular Property Predictions of Machine Learning Models by Evan R. Antoniuk †, Shehtab Zaman ‡*, Tal Ben-Nun †, Peggy Li †, James Diffenderfer †, Busra Demirci ‡, Obadiah Smolenski ‡, Everett Grethel †, Tim Hsu †, Anna M. Hiszpanski †, Kenneth Chiu ‡, Bhavya Kailkhura †, Brian Van Essen † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01912.txt.
Introduction
Machine learning models that predict molecule properties work well on familiar chemistry and stumble on new kinds of molecules. Evan Antoniuk and co-authors build BOOM, a benchmark that measures that stumble directly. It tests models on out-of-distribution data, the case that matters when hunting for truly new drugs and materials.
The team ran over 150 model-and-task combinations. No model generalized well everywhere. Even the best had average errors about three times higher on new chemistry than on familiar data. Large chemical foundation models did not extrapolate strongly. Models with strong built-in assumptions did better on simple, specific properties. Side experiments show how data choices, pretraining, and molecular representation move the results. The open benchmark sets a target for the next generation of chemical models.
Catalog record
| CREATOR | Evan R. Antoniuk †, Shehtab Zaman ‡*, Tal Ben-Nun †, Peggy Li †, James Diffenderfer †, Busra Demirci ‡, Obadiah Smolenski ‡, Everett Grethel †, Tim Hsu †, Anna M. Hiszpanski †, Kenneth Chiu ‡, Bhavya Kailkhura †, Brian Van Essen † |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-01912
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BOOM: Benchmarking Out-Of-distribution Molecular Property Predictions of Machine Learning Models Evan R. Antoniuk †, Shehtab Zaman ‡*, Tal Ben-Nun †, Peggy Li †, James Diffenderfer †, Busra Demirci ‡, Obadiah Smolenski ‡, Everett Grethel †, Tim Hsu †, Anna M. Hiszpanski †, Kenneth Chiu ‡, Bhavya Kailkhura †, Brian Van Essen † Abstract Data-driven molecular discovery leverages artificial intelligence/machine learning (AI/ML) and generative modeling to filter and design novel molecules. Discovering novel molecules requires accurate out-of-distribution (OOD) predictions, but ML models struggle to generalize OOD. Currently, no systematic benchmarks exist for molecular OOD prediction tasks. We present BOOM, b enchmarks for o ut- o f- d istribution m olecular property predictions: a chemically-informed benchmark for OOD performance on common molecular property prediction tasks. We evaluate over 150 model-task combinations to benchmark deep learning models on OOD performance. Overall, we find that no existing model achieves strong generalization across all tasks: even the top-performing model exhibited an average OOD error 3 × \times higher than in-distribution. Current chemical foundation models do not show strong OOD extrapolation, while models with high inductive bias can perform well on OOD tasks with simple, specific properties. We perform extensive ablation experiments, highlighting how data generation, pre-training, hyperparameter optimization, model architecture, and molecular representation impact OOD performance. Developing models with strong out-of-distribution (OOD) generalization is a new frontier challenge in chemical machine learning (ML). This open-source benchmark is available at https://github.com/FLASK-LLNL/BOOM . 1 Introduction Molecular discovery pipelines have increasingly relied upon machine learning (ML) models ( Bohacek et al., 1996 ; Reymond, 2015 ; Kailkhura et al., 2019 ) . These models discover new molecules by either screening a list of enumerated molecules or by guiding a generative model towards molecules of interest ( Wang et al., 2023a ) . Molecular discovery is inherently an out-of-distribution (OOD) prediction problem, since the molecules need to either (i) exhibit properties that extrapolate beyond the training dataset, or (ii) possess a previously unconsidered chemical substructure. In either case, success depends on the learned model’s ability to make accurate predictions on samples that are not in the same distribution as the training data. Despite the importance of OOD performance to real-world molecular discovery, the OOD performance of common ML models for molecular property prediction has yet to be systematically explored. Due to the lack of standardized splits for testing models, especially splits based on the data distribution, we believe that current ML models are optimizing in-distribution performance on insufficiently challenging datasets that do not adequately measure real-world performance. Currently, little empirical knowledge exists about how choices regarding the pretraining task, model architecture, and/or dataset diversity impact the generalization performance of chemistry foundation models that are expected to generalize across all chemical systems. In this work, we develop BOOM, b enchmarks for o ut- o f-distribution m olecular property predictions, a standardized benchmark for assessing the OOD generalization performance of molecule property prediction models. Our work consists of the following main contributions: • We develop a general and robust methodology for evaluating the performance of chemical property prediction models for property values beyond their training distribution. We introduce OOD-specific metrics such as binned R^{2} to allow comparisons of OOD performance across all models. • We perform the first large-scale OOD performance benchmarking of state-of-the-art ML chemical property prediction models. Across 10 diverse OOD tasks and 15 models, we do not find any existing models that show strong OOD generalization across all tasks. We therefore put forth BOOM OOD property prediction as a frontier challenge for chemical foundation models. • Our work highlights insights into how pretraining strategies, model architecture, molecular representation, and data augmentation impact OOD performance. These findings point towards strategies for the chemistry community to achieve chemical foundation models with strong OOD generalization across all chemical systems. 2 BOOM Defining Out-of-distribution. Consider a supervised dataset \mathcal{D} with N molecules \mathcal{M}\in\{\mathcal{M}_{1},\mathcal{M}_{2},...,\mathcal{M}_{N}\} and associated labels or properties y\in\{y_{1},y_{2},...,y_{N}\} . The problem of out-of-distribution prediction can be defined as the mismatch in the probability distribution, P of the training and test sets, \mathcal{D}_{\text{train}} and \mathcal{D}_{\text{test}} such that, P(\mathcal{M},y|\mathcal{D}_{test})\neq P(\mathcal{M},y|\mathcal{D}_{train}) (1) The key question is defining the density function P(\mathcal{M},y) over a set of molecules and their respective properties. The density can be defined over the chemical structure or molecule features, or over the properties. Formally, we define out-of-distribution as low-density regions over the property space, such that: 0<P(y_{\text{test}})\leq P(y_{\text{train}}) (2) Farquhar and Gal (2022) define this as a complement distribution conditioned on the targets. This is known as concept or label shift as well ( Liu et al., 2024 ) . While we focus on designing splits with a concept shift, it is important to note that depending on the property, this may result in a covariate shit, resulting in a structural or chemical imbalance. The probability density over the labels is determined using kernel density estimation (KDE), allowing us to generalize to multimodal distributions. The split strategy algorithm for each dataset is detailed in Appendix A.1 . The lowest probability samples from the KDE estimated distribution are held-out (see Fig. 1 ) to evaluate the consistency of ML models to discover molecules with state-of-the-art properties that extrapolate beyond the training data. Datasets. BOOM consists of 10 quantum chemical molecular property datasets derived from QM9 ( Ramakrishnan et al., 2014 ) and the 10k Dataset ( Antoniuk et al., 2025 ) , derived from the Cambridge Structural Database. The 10k Dataset was sourced from 10,206 experimentally synthesized, small organic molecules and contains the density functional theory calculated values of their molecular density and solid heat of formation (HoF). We collect 8 molecular property datasets from the QM9 Dataset: isotropic polarizability ( \alpha ), heat capacity ( C_{v} ), highest occupied molecular orbital (HOMO) energy, lowest unoccupied molecular orbital (LUMO) energy, HOMO-LUMO gap, dipole moment ( \mu ), electronic spatial extent ( \left<R^{2}\right> ), and zero point vibrational energy (ZPVE). We also select a random subset of the dataset to serve as the ID test set, detailed in Appendix A . To further expand the application space of BOOM, we also perform benchmarking on the Lipophilicity dataset ( Wu et al., 2018 ) of 4,200 experimental measurements of the octanol/water distribution coefficient, which is of relevance for drug compounds. The inclusion of the Lipophilicity dataset serves as an exemplary dataset for performing OOD evaluations on experimentally measured properties, rather than only computed physicochemical properties (See Table 9 ). Figure 1 : (Left) An example OOD dataset included in the BOOM benchmark. To assess OOD performance, we split each chemical property dataset into an out-of-distribution (OOD) Test Set (blue), an in-distribution (ID) Test Set (orange) and a Train Set (green), as described in Section 2. (Right) Example model predictions on this task exhibiting weak correlation on the OOD samples. Metrics. We also propose standardized metrics over the ID and OOD to compare models. We use root mean square error (RMSE) over respective data splits. Models achieving OOD RMSE comparable to ID RMSE show strong generalization. Short of achieving strong OOD generalization, the next-best case is for the model to achieve a strong correlation on the OOD samples. As OOD predictions span disparate ranges in the prediction space by design, the sample mean is far