Bayesian Optimization in Chemical Compound Sub-Spaces using Low-Dimensional Molecular Descriptors

Yun-Wen Mao, Roman V. Krems · 2026

Read Bayesian Optimization in Chemical Compound Sub-Spaces using Low-Dimensional Molecular Descriptors by Yun-Wen Mao, Roman V. Krems (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02605.txt.

Introduction

Yun-Wen Mao and Roman Krems optimize molecules with very little data in this 2026 paper. Chemical space is vast and discrete, so finding molecules with target properties is hard. Standard machine learning optimizers need large data sets to model that space. Their Bayesian framework works inside a subspace of well over a hundred thousand molecules.

Fewer than two thousand training points suffice for precise optimization. The key is a low-dimensional descriptor that encodes real physics of each molecule. A reliable inverse map turns optimized descriptor points back into valid molecules. On a standard benchmark, entropy targets were hit every time in their tests. Most runs needed under a thousand evaluations to succeed. Zero-point energy targets also scored high success for larger molecules.

Catalog record

CREATORYun-Wen Mao, Roman V. Krems
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44330
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02605

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bayesian Optimization in Chemical Compound Sub-Spaces using Low-Dimensional Molecular Descriptors Yun-Wen Mao, Roman V. Krems Abstract Efficient optimization of molecules with targeted properties remains a significant challenge due to the vast size and discrete nature of chemical compound space. Conventional machine-learning-based optimization approaches typically require large datasets to construct accurate surrogate models, limiting their applicability in data-scarce settings. In this study, we present a Bayesian optimization (BO) framework that identifies optimal molecular structures with high precision using fewer than 2,000 training data points within a chemical subspace containing more than 133,000 molecules. The framework employs a low-dimensional and physics-informed molecular descriptor vector that facilitates data-efficient surrogate modeling and optimization. A key innovation of the proposed framework is a reliable inverse mapping scheme that translates optimized points in the descriptor space back into chemically valid molecular structures, thereby bridging continuous optimization and discrete molecular design. We demonstrate the effectiveness of our approach on the QM9 benchmark dataset, where the framework successfully identifies organic molecules with the target entropy and zero-point vibrational energy (ZPVE) values. For entropy optimization, our approach achieves a 100 % \% success rate while requiring fewer than 1,000 molecular evaluations in more than 80 % \% of test cases. For ZPVE, the success rate exceeds 80 % \% for molecules containing more than two heavy atoms. These results highlight the critical role of low-dimensional, interpretable descriptors in enabling data-efficient optimization and robust inverse molecular design, and establish Bayesian optimization as a practical tool for molecular discovery in small-data regimes. Keywords Bayesian Optimization \cdot Inverse molecular design \cdot Gaussian Process Regression \cdot Chemical compound space optimization 1 Introduction The chemical compound space is vast due to the combinatorial nature of molecular structures. The number of molecules suitable for medical applications is estimated to range from 10^{23} to 10^{60} [ 48 ] . Combined with the high cost of experimental screening and quantum-chemistry calculations, the size of the chemical compound space makes the search for molecules with desired physical and chemical properties extremely challenging. To address this challenge, data-driven approaches— including machine learning (ML)— have emerged as important tools. ML models can serve as surrogates for experiments or quantum-chemistry computations, enabling efficient screening of chemical compound sub-spaces, such as sets of structural isomers or specific classes of ligands. Various ML methods have been employed for molecular property predictions, including feed-forward neural networks (NNs) [ 62 , 60 , 20 ] , large language models (LLMs) [ 7 , 1 , 65 , 70 , 17 , 71 ] , generative adversarial networks (GANs) [ 73 , 34 , 74 , 38 ] , variational autoencoders (VAEs) [ 21 , 40 , 31 , 28 , 15 ] , kernel methods [ 14 , 32 , 43 , 5 ] , random forests [ 51 ] , and reinforcement learning (RL) [ 75 ] . These approaches have demonstrated remarkable success in accelerating molecular discovery. However, high-throughput screening often trades accuracy for speed, and may therefore overlook important molecules. An alternative strategy is direct optimization within chemical compound sub-spaces to identify specific molecules with high precision. High-precision optimization of molecular properties should be validated using experiments or quantum-chemical calculations to confirm the candidates proposed by the optimizer. This requires efficient optimization schemes, capable of converging to optimal solutions in complex molecule spaces with a small number of confirmations. The development of such efficient optimizers faces two challenges: (i) molecules are complex and generally require high-dimensional numerical descriptors, which leads to high-dimensional optimization problems; and (ii) optimization requires the inverse mapping from numerical descriptors to molecules. A great variety of molecular descriptors have been developed to encode compositional, structural, and electronic property information into numerical features suitable for learning algorithms. It has been established that physics-based descriptors generally yield more data-efficient models than, for example, descriptors derived from tokenized SMILES strings processed as text [ 47 , 66 , 12 , 45 ] . Examples of molecular descriptors that incorporate physical features include the Behler-Parrinello symmetry functions (ACSF) [ 3 , 18 ] , smooth overlap of atomic positions (SOAP) [ 2 ] , local many-body tensor representation (LMBTR) functions [ 27 ] , Faber-Christensen-Huang-Lilienfeld (FCHL19) [ 10 ] , convolutional many-body distribution functionals (cMBDF) [ 33 ] , Coulomb matrices [ 55 ] , bag of bonds (BoB) features [ 23 ] , and spectrum of London and Axilrod-Teller-Muto (SLATM) [ 26 ] . While these descriptors have enabled accurate ML predictions for a wide range of molecular properties, optimization within the high-dimensional chemical compound space represented by such descriptors remains highly challenging. This difficulty arises from the fundamentally non-smooth nature of the objective landscape, as molecules are inherently discrete graphs of atoms and bonds. Thus, even small structural modifications, such as functional group substitutions, can lead to abrupt changes in molecular properties [ 69 ] . One way to circumvent this problem is to construct smooth and continuous latent spaces using models such as VAEs [ 21 , 40 , 31 , 28 , 15 ] , GANs [ 22 , 11 ] , or diffusion models [ 37 , 57 , 30 ] , enabling gradient-based optimization. However, training such generative models typically requires large datasets. Therefore, data-efficient and gradient-free methods are needed to allow direct optimization in chemical sub-spaces, especially when data are scarce. A possible approach to reduce the data requirements for molecular property discovery is Bayesian optimization (BO). BO is particularly well suited for expensive evaluations (i.e. experimental or quantum-chemical confirmation of molecular properties), gradient-free settings, and global optimization. In chemistry and materials science, BO has been applied to diverse optimization problems, including catalyst discovery [ 42 , 68 , 63 , 16 ] , molecular docking [ 4 , 8 ] , and material property optimization [ 24 , 35 , 36 , 49 ] . However, Bayesian optimization is particularly sensitive to the dimensionality problem and, as other optimization approaches, requires overcoming the inverse problem. High dimensionality of the input space limits the probabilistic surrogate models underlying BO. Although probabilistic models provide uncertainty estimates that guide the search, their predictive performance deteriorates rapidly in high-dimensional spaces [ 9 ] . This issue is especially pronounced in chemistry, where high-quality data are scarce, yet molecular descriptor spaces are often high-dimensional in order to capture subtle structural variations and complex chemical features. Prior work [ 67 ] has shown that reducing descriptor dimensionality can significantly improve both ML model accuracy and computational efficiency. Furthermore, other studies have demonstrated that physically grounded descriptors result in more robust and generalizable models [ 47 , 5 ] . Our previous work [ 43 ] introduced physically motivated and low-dimensional molecular descriptor vectors that preserve essential chemical information while substantially reducing dimensionality. This representation enables accurate Gaussian process regression (GPR) interpolation even with limited data and provides the foundation for the optimization framework developed here. In the present work, we exploit these low-dimensional descriptors to explore the feasibility of BO in chemical compound spaces. To achieve this, we develop and demonstrate an inverse-mapping scheme that converts molecular descriptor vectors back into molecules. Inverse design requires mapping points in descriptor space back to chemically valid molecular structures, a key step in

Read the complete text