Similarity-Quantized Relative Difference Learning for Improved Molecular Activity Prediction
Karina Zadorozhny, Kangway V. Chuang, Bharath Sathappan, Vishnu Sresht, Colin A. Grambow · 2025
Read Similarity-Quantized Relative Difference Learning for Improved Molecular Activity Prediction by Karina Zadorozhny, Kangway V. Chuang, Bharath Sathappan, Vishnu Sresht, Colin A. Grambow (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-09103.txt.
Introduction
Zadorozhny and co-authors present in 2025 a learning method that improves guesses of how active a drug compound will be. Drug hunts suffer from small, noisy datasets, which makes direct training weak. Their method learns from gaps between pairs of like compounds, not from single values alone.
Known likeness scores between compounds guide the training of graph networks and other models. Learning the gap for close pairs proved more robust when data was scarce. Tests on public and in house drug data showed broad gains in accuracy and reach. The approach offers a practical route to better early screening in drug discovery.
Catalog record
| CREATOR | Karina Zadorozhny, Kangway V. Chuang, Bharath Sathappan, Vishnu Sresht, Colin A. Grambow |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-09103
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Similarity-Quantized Relative Difference Learning for Improved Molecular Activity Prediction Karina Zadorozhny, Kangway V. Chuang, Bharath Sathappan, Vishnu Sresht, Colin A. Grambow Abstract Accurate prediction of molecular activities is crucial for efficient drug discovery, yet remains challenging due to limited and noisy datasets. We introduce Similarity-Quantized Relative Learning (SQRL), a learning framework that reformulates molecular activity prediction as relative difference learning between structurally similar pairs of compounds. SQRL uses precomputed molecular similarities to enhance training of graph neural networks and other architectures, and significantly improves accuracy and generalization in low-data regimes common in drug discovery. We demonstrate its broad applicability and real-world potential through benchmarking on public datasets as well as proprietary industry data. Our findings demonstrate that leveraging similarity-aware relative differences provides an effective paradigm for molecular activity prediction. 1 Introduction and Background The ability to predict molecular activity is critical for small molecule drug discovery. However, experimental data for training machine learning models are often limited and noisy, making robust generalization challenging. While deep learning approaches have enabled rich representations from chemical structures [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 ] , most focus on predicting absolute property values, ignoring valuable information in relationships between structurally similar molecules. Drawing inspiration from medicinal chemists [ 14 ] , who examine how specific structural modifications influence properties relative to a parent compound or a matched molecular pair [ 15 ] , we introduce S imilarity- Q uantized R elative L earning ( SQRL )—a training and evaluation framework that reformulates property prediction as learning relative differences between nearby compounds. The key contributions of our work are: • We introduce a robust similarity-thresholded learning approach that significantly enhances model performance by focusing on predicting property differences between the most informative compound pairs . This allows effective learning from limited and noisy data. • Our analysis across molecular distance metrics and thresholds demonstrates that similarity-aware dataset matching outperforms indiscriminate pairing of all inputs , as it more effectively leverages local structural information. • Extensive benchmarking demonstrating the benefits of SQRL across diverse state-of-the-art network architectures and multiple activity prediction datasets, including publicly available activity cliff prediction tasks and real-world industry datasets. 2 Related Work Molecular property prediction. Significant research has focused on methods for molecular property and activity prediction, including recent work on graph neural networks (GNNs) [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] along with chemical language models [ 8 , 9 , 10 , 11 , 12 ] that learn meaningful molecular representations from molecular data [ 13 ] . Despite these advances, simpler tree-based models often outperform more complex neural approaches due to limited data availability and inherent modeling challenges [ 16 , 17 ] . Activity cliff prediction. Activity cliffs refer to pairs of molecules with high structural similarity but significantly different activity levels. Previous approaches have addressed this challenging problem by representing molecular graphs as images [ 18 , 19 ] , applying graph convolutional networks (GCNs) to matched molecular pairs [ 20 ] , or using chemical reaction information [ 21 ] . Many of these methods have formulated the problem as a classification task, aiming to identify whether a given molecular pair exhibits an activity cliff [ 22 ] or as a standard regression task that relies on learning the discontinuous chemical space directly from the data [ 23 ] . Our approach focuses on predicting the difference in potency values between any pair of similar molecules, providing a more versatile solution that can also be applied to standard potency prediction. Metric, similarity, and few-shot learning. Pairwise learning approaches have been widely adopted in fields like ranking, metric, and similarity learning [ 24 , 25 ] . Notably, few-shot learning approaches have been developed for molecular property prediction for improving generalization in low-data regimes [ 26 , 27 , 28 ] . Additionally, pairwise data matching has proven effective in implicit guidance of generative models for drug design. [ 29 ] . Relative prediction. Recently, pairwise learning has been applied to regression tasks. Wetzel et al. 2022a used Siamese networks to predict differences between all data points in both supervised and unsupervised settings as a way of producing ensembles of predictions and uncertainty estimates [ 30 , 31 ] . This approach has been extended to classification tasks for tree-based models [ 32 ] . Tynes et al. 2021 applied the concept of pairwise learning to computational chemistry, analyzing the performance of random forest models trained on all pairs of inputs points [ 33 ] . Similarly, Fralish et al. 2023 trained a D-MPNN model on paired compounds and observed improvements in ADME property predictions [ 34 ] and molecule selection in an active learning setting [ 35 ] . Unlike previous approaches that primarily focus on absolute property predictions or indiscriminate pairwise learning, our work introduces a similarity-thresholded framework that emphasizes learning from the most informative compound pairs. 3 Similarity-Thresholded Relative Representation Problem formulation. We formulate the relative prediction task as follows. Given a dataset of molecular structures \mathcal{D}=\{(x_{i},y_{i})\}_{i=1}^{N} , where x_{i} represents molecule i and y_{i}\in\mathbb{R} denotes its corresponding property value, our goal is to learn a function f:\mathcal{X}\times\mathcal{X}\rightarrow\mathbb{R} that predicts the relative difference in property values between two molecules. Formally, for any pair of molecules (x_{i},x_{j}) , we aim to predict the relative difference \Delta y_{ij}=y_{i}-y_{j} . Dataset matching. To train models on the relative prediction task, we construct a new dataset \mathcal{D}_{\text{rel}} by considering pairs of molecules in the original dataset \mathcal{D} . To focus on the most informative comparisons, we restrict the pairs to those within a certain threshold of structural similarity, as measured by a predefined similarity metric (e.g., Tanimoto similarity). This allows models to learn from local differences in chemical space where relative changes in property values are most meaningful. We define \mathcal{D}_{\text{rel}} as: \mathcal{D}_{\text{rel}}=\left\{\left((x_{i},x_{j}),\Delta y_{ij}\right)\mid x_{i},x_{j}\in\mathcal{D},d(x_{i},x_{j})\leq\alpha\right\} (1) where d:\mathcal{X}\times\mathcal{X}\rightarrow\mathbb{R}_{\geq 0} is a distance function in the input space \mathcal{X} and \alpha\in\mathbb{R}_{>0} is a distance threshold. See Appendix A.4 for examples of paired structures. The choice of \alpha is critical, as it involves a trade-off between the quantity and relevance of generated pairs. We propose selecting \alpha based on the distribution of distances in the training data, specifically by choosing a threshold smaller than the average pairwise distance. This approach can help form more informative pairs by focusing on molecules with greater structural similarity and relevance. Relative representation. We define g:\mathcal{X}\rightarrow\mathbb{R}^{d} as a mapping function that converts a molecular compound from the input space \mathcal{X} into a d -dimensional real-valued vector. This can be either a learnable model (such as a graph neural network), a pre-trained model, or a fixed molecular fingerprinting algorithm. Next, a machine learning model f:\mathbb{R}^{d}\rightarrow\mathbb{R} uses the difference between molecular representations generated by g to predict the relative differences in properties. We optimize parameters \theta of f and g (if learnable) by minimizing: \min_{\theta}\mathcal{L}(\theta)=\min_{\theta}\sum_{((x_{i},x_{j}),\Delta y_{ij})\in\mathcal{D}{\text{rel}}}\ell\big(f\left(g(x_{i})-g(x_{j})\right),\Delta y_{ij}\big) (2) where \ell is mean squared error loss. For a new molecule x_{\text{new}} , we compute the prediction \hat{y}_{\text{new}} as: \hat{y}_{\text{new}}=\frac{1}{n}\sum_{x_{i}\in\text{NN}_{n}(x_{\text{new}})}y_{i}+f\left(g(x_{i})-g(x_{\text{new}})\right) (3) where \text{NN}_{n}(x_{\text{new}}) denotes the set of n molecules from the