Towards Efficient Molecular Property Optimization with Graph Energy Based Models
Luca Miglior 1, Lorenzo Simone 1, Marco Podda 1 and Davide Bacciu 1 1 - University of Pisa - Department of Computer Science Largo Bruno Pontecorvo 3, Pisa, Italy · 2025
Read Towards Efficient Molecular Property Optimization with Graph Energy Based Models by Luca Miglior 1, Lorenzo Simone 1, Marco Podda 1 and Davide Bacciu 1 1 - University of Pisa - Department of Computer Science Largo Bruno Pontecorvo 3, Pisa, Italy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12219.txt.
Introduction
Luca Miglior, Lorenzo Simone, Marco Podda, and Davide Bacciu search for better molecules with a generative model in a 2025 paper. Chemical space is vast, so testing compounds one by one is far too slow.
Their model learns an energy score over molecule graphs. Low-energy molecules are then drawn from the model, which steers the search toward compounds with the wanted traits. The training needs no labels for those traits, and the method does not spell out the target as an input when it creates a molecule. On standard chemical test sets, the approach beat the leading methods. The authors present it as a robust and efficient route toward designing new drugs.
Catalog record
| CREATOR | Luca Miglior 1, Lorenzo Simone 1, Marco Podda 1 and Davide Bacciu 1 1 - University of Pisa - Department of Computer Science Largo Bruno Pontecorvo 3, Pisa, Italy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-12219
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Efficient Molecular Property Optimization with Graph Energy Based Models Luca Miglior 1, Lorenzo Simone 1, Marco Podda 1 and Davide Bacciu 1 1 - University of Pisa - Department of Computer Science Largo Bruno Pontecorvo 3, Pisa, Italy Abstract Optimizing chemical properties is a challenging task due to the vastness and complexity of chemical space. Here, we present a generative energy-based architecture for implicit chemical property optimization, designed to efficiently generate molecules that satisfy target properties without explicit conditional generation. We use Graph Energy Based Models and a training approach that does not require property labels. We validated our approach on well-established chemical benchmarks, showing superior results to state-of-the-art methods and demonstrating robustness and efficiency towards de novo drug design. 1 Introduction Generating molecules that satisfy specific chemical constraints is crucial in modern de novo drug design. Traditional generative approaches for property optimization generally involve training deep learning models on large datasets as general-purpose molecule generators. Prior works explored property optimization using Reinforcement Learning (RL) methods to guide molecular generation, such as GraphDF [ 7 ] and GraphAF [ 8 ] , or Bayesian Optimization (BO) on the latent space as proposed in JT-VAE [ 4 ] . MoFlow [ 10 ] uses Classifier-Based (CB) guidance to direct the generation towards specific objectives. GraphEBM [ 6 ] tackles molecular generation with energy-based models (EBM), but the results of property optimization remain unclear, as it restricts to optimizing numerically quantifiable properties and exhibits high variance in generation, which affects consistency and reliability of generated molecules. Despite their advancements, the methodologies referenced above present several limitations: RL methods are known to be unstable and computationally demanding, while BO and CB methods rely on supervised learning and require large labeled datasets to work properly, which are rarely available in the chemical domain. Motivated by the need of overcoming existing limitations in optimization methods, especially in real-world scenarios where labeled data is scarce and computational efficiency is crucial, we present a novel Unspervised Energy-based Molecule Optimization (UEMO) capable of implicitly learning chemical properties and efficiently generating molecular graphs without the need of labeled data or explicit optimization strategies. Our method leverages the capabilities of Graph Neural Networks (GNNs) [ 1 ] to process molecular graphs and utilizes Langevin dynamics [ 2 ] at sampling time to generate new molecules. We tested our approach on ZINC-250K [ 3 ] , evaluating its performance in optimizing QED and LogP chemical properties, and providing results on the constrained optimization of existing compounds. 2 Methodology Whilst most models are trained as general-purpose generators, with property-specific optimization treated as a separate post hoc task, we exceed such limitations by proposing a novel method that implicitly embeds a strong bias toward the desired objective directly in the generative model, eliminating the need for supervision. Given a molecular input space \mathcal{X} , let \mathcal{S}\subseteq\mathcal{X} the subset of molecules that satisfy given property constraints. The goal is to train the generative model that maximizes the probability of generating samples coming from \mathcal{S} . Such a result can be pursued by resorting to domain-specific datasets guaranteed to reflect the targeted property (e.g., binding affinity to a specific property), or by employing off-the-shelf property predictors to filter molecules that satisfy desired constraints from existing datasets. This concept-based approach is versatile and applicable to any desired chemical objective. In contrast to baseline methods – GraphEBM [ 6 ] in particular, whose optimization strategy is limited by numerical property estimates to scale the energy term – we provide a generalizable setting that allows for the optimization of arbitrary properties without requiring explicit values or labeled data. This is particularly advantageous when dealing with complex or non-numerical targets, such as binding affinity or toxicity. Let g=(\mathbf{A},\mathbf{X}) be a molecular graph, consisting of n atoms and m atom types, where \mathbf{A}\in\mathbb{R}^{n\times n\times(e+1)} is the adjacency tensor describing chemical bonds 1 1 1 e is the number of bond types, with an additional type to indicate the absence of a bond. , and \mathbf{X}\in\mathbb{R}^{n\times m} is the one-hot-encoded atom representation. The energy function is defined as a function E_{\theta}(g):\mathcal{X}\rightarrow\mathbb{R} with learnable parameters \theta that assigns a scalar value to each molecule in the input space. The probability distribution over the input space is given by: p_{\theta}(g)=\frac{1}{Z}\exp(-E_{\theta}(g)), where Z=\int_{\mathcal{X}}\exp(-E_{\theta}(g))\,dg is the intractable marginalization term. In this work, we model the energy function E_{\theta} using a Graph Convolutional Network (GCN) [ 5 ] . The GCN consists of L message-passing layers, after which a graph-level embedding \mathbf{z}\in\mathbb{R}^{d_{L}} is computed by applying a mean-pooling operation on the L -th node representations as follows: \mathbf{z}=\text{MeanPooling}(\mathbf{H}^{(L)}) . Finally, the energy value is obtained by passing \mathbf{z} through J Fully Connected (FC) layers: E_{\theta}(g)=\text{EnergyHead}(\mathbf{z})=FC_{J}(FC_{J-1}(\ldots FC_{1}(\mathbf{z}))) The schematic representation of the proposed architecture is shown in Figure 1 . Figure 1: UEMO architecture. In the example, n=7,m=4, and e=3 . Given the energy E_{\theta}(g)\in\mathbb{R} , generating samples from the associated probability distribution is not trivial due to the intractability of the marginalization term. In this work, we use Langevin dynamics which directly uses the gradient of the energy function to generate samples: g_{i+1}=g_{i}-\frac{\epsilon}{2}\nabla_{g}E_{\theta}(g_{i})+\omega_{i},\,\omega_{i}\sim\mathcal{N}(0,\epsilon), where \epsilon is the step size. For i\rightarrow\infty and \epsilon\rightarrow 0 , this process is guaranteed to generate samples from the true distribution p_{\theta} . UEMO is trained by modeling the energy of the space of the molecules \mathcal{X} through the distribution implicitly defined by E_{\theta} . This is achieved by minimizing the negative log likelihood \mathcal{L}(\theta)=-\mathbb{E}_{g\sim\mathcal{S}}[\log p_{\theta}(g)] , under the empirical distribution of the dataset \mathcal{S} . This objective is known to have the formulation: \nabla_{\theta}\mathcal{L}(\theta)=\mathbb{E}_{g^{+}\sim\mathcal{S}}\left[\nabla_{\theta}E_{\theta}(g^{+})\right]-\mathbb{E}_{g^{-}\sim p_{\theta}}\left[\nabla_{\theta}E_{\theta}(g^{-})\right], here we rely on Langevin dynamics to generate negative samples g^{-}\sim p_{\theta} . Initial sampling hyperparameters for Langevin dynamics were chosen according to [ 2 , Appendix A.11] . As initial configuration for the chain g_{1},\ldots g_{i}\ , we leverage Persistent Contrastive Divergence (PCD) [ 9 ] , by implementing a limited-size replay buffer \mathcal{B} to store samples generated in previous iterations: in our implementation 95% of the initializations are drawn from \mathcal{B} and 5% from standard Gaussian noise. New molecules are sampled from the trained model by initializing the Langevin dynamics with molecular graphs g drawn from Gaussian noise, such that \mathbf{A}_{0},\mathbf{X}_{0}\sim\mathcal{N}(0,1) . At each step of the sampling chain, the generated adjacency tensor is symmetrized to ensure consistency and used as initialization for the next step, following \mathbf{A}_{i+1}=\frac{1}{2}(\mathbf{A}_{i}+\mathbf{A}^{T}_{i}) . Additionally, we compute the target property of the intermediate molecule at every step of the chain to maintain stability and prevent the local representation from collapsing. 3 Experiments We evaluated UEMO in two different property optimization tasks: Quantitative Drug Likeliness (QED) and Octanol-Water Partition Coefficient (LogP). To perform these experiments, we used the publicly available dataset ZINC-250k, which consists of 250,000 chemical compounds annotated with the above-mentioned properties. To facilitate implicit optimization, we divided the dataset in two partitions, each one reflecting a desired property constraint. Specifically, our partition matched high QED score ( \geq 0.75) and high LogP coefficient ( \geq 3) constraints. The partitioning was chosen to reflect real-world scenarios, where datasets targeting specific molecular properties are often small. The final partitions consisted of 54k and 34k molecules for QED and LogP, respectively. In addition to property evaluation, we performed benchmarks