Multi-domain Distribution Learning for De Novo Drug Design
Arne Schneuing, Ilia Igashov, Adrian W. Dobbelstein, Thomas Castiglione, Michael Bronstein & Bruno Correia · 2025
Read Multi-domain Distribution Learning for De Novo Drug Design by Arne Schneuing, Ilia Igashov, Adrian W. Dobbelstein, Thomas Castiglione, Michael Bronstein & Bruno Correia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17815.txt.
Introduction
Arne Schneuing and co-authors present DrugFlow, a generative model for designing new drugs in a paper from 2025. The model builds drug molecules that fit a protein's three-dimensional pocket. It must learn chemistry, geometry, and physics at once, a hard mix.
DrugFlow joins two math tools: smooth flow matching for positions and Markov bridges for discrete choices. It also gives an uncertainty score that flags odd samples. A preference step steers sampling toward regions with better scores. The model can even adjust the protein's side chains as it builds the drug. Top results on standard tests are claimed. The tool may shorten the hunt for fresh drug candidates.
Catalog record
| CREATOR | Arne Schneuing, Ilia Igashov, Adrian W. Dobbelstein, Thomas Castiglione, Michael Bronstein & Bruno Correia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-17815
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-domain Distribution Learning for De Novo Drug Design Arne Schneuing, Ilia Igashov, Adrian W. Dobbelstein, Thomas Castiglione, Michael Bronstein & Bruno Correia Abstract We introduce DrugFlow , a generative model for structure-based drug design that integrates continuous flow matching with discrete Markov bridges, demonstrating state-of-the-art performance in learning chemical, geometric, and physical aspects of three-dimensional protein-ligand data. We endow DrugFlow with an uncertainty estimate that is able to detect out-of-distribution samples. To further enhance the sampling process towards distribution regions with desirable metric values, we propose a joint preference alignment scheme applicable to both flow matching and Markov bridge frameworks. Furthermore, we extend our model to also explore the conformational landscape of the protein by jointly sampling side chain angles and molecules. 1 Introduction Small molecules are the predominant class of FDA-approved drugs with a share of 85%, and more than 95% of known drugs target human or pathogen proteins ( Santos et al. 2017 ) . At the same time, the cost and duration of the development of new drugs are skyrocketing ( Simoens & Huys 2021 ) . This sparks increasing interest in the computational design of small molecular compounds that bind specifically to disease-associated proteins and thus reduce the amount of costly experimental testing. In recent years, the machine learning community has contributed a plethora of generative tools addressing drug design from various angles ( Du et al. 2024 ) . Some methods directly optimize specific drug properties, using techniques such as reinforcement learning ( Popova et al. 2018 ; Gottipati et al. 2020 ) or search-based approaches ( Gómez-Bombarelli et al. 2018 ; Swanson et al. 2024 ) . However, these methods typically require careful tuning of the objective function to avoid exploiting imperfect computational oracles and overly maximizing one desired property (e.g. binding affinity) at the expense of another (e.g. oral bioavailability). Additionally, one often aims to design a suitable 3D binding pose along with the chemical structure of the molecule, which substantially increases the degrees of freedom. Many optimization algorithms struggle to efficiently navigate such vast design spaces. Following a different approach, probabilistic generative models learn to generate drug-like molecules directly from data ( Hoogeboom et al. 2022 ; Vignac et al. 2022 ) . Here, the design objectives are implicitly encoded in the training data set. While these methods may not outperform direct optimization on isolated metrics, they are well suited for the multifaceted nature of drug design as they learn “what a drug looks like” in a more general way. Once trained on sufficient high-quality data, these models can capture a more holistic picture of the molecular space compared to models optimized for a limited set of target metrics. Figure 1: Method overview. DrugFlow operates on continuous ligand atom coordinates x_{t} , discrete atom types h_{t} , and bond types e_{t} . Its extension FlexFlow additionally operates on continuous side chain angles \chi_{t} . As shown on the left, coordinates and angles are sampled from a Gaussian prior in 3D and a uniform prior on the torus, respectively. Discrete types are sampled from categorical prior distributions (uniform or marginal). Denoising schemes for continuous and discrete data types are based on conditional flow matching (top) and Markov bridge models (bottom). As shown in the middle, at time step t , we process the noisy data to obtain the 3D graph: side chain angles are transformed into vector features pointing to atom positions using NERF, and three types of edges are introduced using different distance cutoffs—edges between ligand atoms e_{t}^{\text{L}\triangleright\text{L}} , edges between ligand and protein \text{C}_{\alpha} atoms e_{t}^{\text{P}\triangleright\text{L}} , and edges between protein \text{C}_{\alpha} atoms e_{t}^{\text{P}\triangleright\text{P}} . The graph is processed by a neural network \theta which outputs velocities v_{\theta}(x_{t},t) , v_{\theta}(\chi_{t},t) and type predictions \hat{h}_{t} , \hat{e}_{t} which are fed into the generative modeling framework. The model can adapt the size of the molecule during sampling and label excessive atoms that will be eventually removed (shown as crosses on the right). Additionally, DrugFlow outputs per-atom uncertainty values \hat{\sigma}_{\text{tot}} . The strength of generative modeling lies in its ability to reproduce patterns seen in the training data. However, many prior works on generative molecular design have focused on absolute metric values in baseline comparisons (e.g. identifying the best docking scores or synthetic accessibility estimates), even though the proposed models did not directly optimize these quantities. For example, Table 6 from the recent survey on generative structure-based drug design methods by Zhang et al. 2023b highlights a common evaluation strategy used in this context. We argue that the evaluation of generative models for drug design should instead be centered around their ability to represent the training distribution accurately – analogous to how image generation methods are typically assessed ( Heusel et al. 2017 ) . Without additional fine-tuning or sampling strategies, it is unreasonable to expect a model to substantially improve any score compared to the training set. In this work, we present DrugFlow , a new generative model for structure-based drug design, that simultaneously learns the distribution of protein-binding molecules in three data domains. DrugFlow generates discrete atom and bond types as well as atom coordinates in the Euclidean space. Its extended version, FlexFlow , additionally samples side chain configurations of the binding pocket represented as angles on a hypertorus. This allows us to sample probabilistic ensembles of possible binding modes and enables drug design for targets in unbound conformations. Both DrugFlow and FlexFlow are conditioned on fixed protein backbone coordinates and amino acid types, which are used as context for denoising. We further introduce a virtual node type to allow the model to dynamically add or remove atoms and thus learn about the distribution of ligand sizes rather than requiring it to be pre-specified. Finally, we add an uncertainty head to our model that is trained in an end-to-end fashion to identify out-of-distribution samples and rank molecules at inference time. Based on our observations, we focus our evaluation primarily on the distribution learning capabilities of the proposed generative model, comparing it to established baselines. To this end, we assess molecular properties and structural features using distance functions between distributions derived from generated samples and training data points, and demonstrate that DrugFlow molecules closely match the data distribution across a broad range of metrics. This suggests that DrugFlow can be retrained on curated datasets to steer the generation of samples towards desired regions of the chemical space for various practical applications. However, recognizing that excessive filtering may lead to insufficient training data, we present an alignment strategy which allows us to update a pre-trained model based on user preferences. We summarize the main contributions of this work as follows. Conceptual novelty We present DrugFlow and FlexFlow , new generative models for structure-based drug design, and introduce three conceptually new features: (1) and end-to-end trained uncertainty estimate that successfully detects out-of-distribution samples, (2) an adaptive size selection method that discards excessive atoms during sampling, and (3) a protein conformation sampling module that samples realistic side chain rotamers. Performance We propose to evaluate generative models in a way that better captures their training objective, and use the new benchmarking framework to show that DrugFlow is a state-of-the-art distribution learner for structure-based drug design. Practical relevance