On Improving Graph Neural Networks for QSAR by Pre-training on Extended-Connectivity Fingerprints

Sam Money-Kyrle, Markus Dablander, Thierry Hanser, Stephane Werner, Charlotte M. Deane, Garrett M. Morris · 2026

Read On Improving Graph Neural Networks for QSAR by Pre-training on Extended-Connectivity Fingerprints by Sam Money-Kyrle, Markus Dablander, Thierry Hanser, Stephane Werner, Charlotte M. Deane, Garrett M. Morris (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10722.txt.

Introduction

Money-Kyrle and five colleagues test whether graph neural networks, a machine-learning tool for molecules, beat older methods for predicting how active a compound is. They pre-train the networks to predict Extended-Connectivity Fingerprints, compact codes for molecular shape. Across five of six Biogen benchmarks the pre-trained networks improved scores significantly, though on mixed data and harder targets such as binding strength they fell behind on new distributions.

Catalog record

CREATORSam Money-Kyrle, Markus Dablander, Thierry Hanser, Stephane Werner, Charlotte M. Deane, Garrett M. Morris
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62441
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10722

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On Improving Graph Neural Networks for QSAR by Pre-training on Extended-Connectivity Fingerprints Sam Money-Kyrle, Markus Dablander, Thierry Hanser, Stephane Werner, Charlotte M. Deane, Garrett M. Morris Abstract Molecular Graph Neural Networks (GNNs) are increasingly common in drug discovery, particularly for Quantitative Structure-Activity Relationship (QSAR) studies; yet, their superiority compared to classical molecular featurisation approaches is disputed. We report a general strategy for improving GNNs for QSAR by pre-training to predict Extended-Connectivity Fingerprints (ECFP). We validate our approach with statistical tests and challenging out-of-distribution (OOD) splits. Across five out of six Biogen benchmarks, we observed a statistically significant improvement in standard performance metrics over all evaluated baselines when using ECFP pre-trained GNNs. However, for more heterogeneous datasets and more complex endpoints, such as binding affinity prediction, pre-trained GNNs underperformed in OOD settings. Importantly, we investigated the impact of substructure-level data leakage during pre-training on downstream performance. While we identified scenarios where pre-training on ECFPs was less effective, our findings show that ECFP-based pre-training can enhance downstream OOD performance on a diverse set of practically relevant QSAR tasks. keywords Extended-connectivity fingerprints, Molecular property prediction, Graph neural networks, Pre-training, QSAR, Out-of-distribution generalisation, molecular substructures 1 Introduction Machine learning (ML) has become a prominent method for accelerating therapeutic drug discovery research 31 . An example of this is Quantitative Structure-Activity Relationship (QSAR) studies, where computational models are used to predict molecular properties. QSAR studies are useful for profiling and filtering candidate drugs before clinical trials. In drug discovery, after binding affinity, molecular properties primarily relate to absorption, distribution, metabolism, excretion, and toxicity (ADMET). Numerous methods have pushed state-of-the-art performance forward on ADMET benchmarks, e.g., 37 ; 28 ; 59 ; 25 ; 23 ; 22 ; 53 ; 60 . However, attrition rates in small molecule drug discovery have increased in recent years 1 , suggesting benchmark performance does not reflect impact. This is partly due to a key limitation in drug discovery; experimental datasets for training and benchmarking are typically small, noisy, and heterogeneous, leading to biased models and inaccurate performance estimates 12 ; 32 ; 50 . To overcome the limitations in QSAR, we need robust molecular representations that reduce bias and capture relevant task-specific information. Classical representations include topological fingerprints, e.g., Extended-Connectivity Fingerprints (ECFP) 44 , where substructure or pharmacophore presence is encoded by bits in a binary vector 36 . Differentiable representations based on deep learning are a more recent approach which utilise forward- and back-propagation to extract meaningful features from the input data in a latent embedding space. The ability to automatically derive abstract, non-linear patterns from non-tabular data should make differentiable approaches particularly useful in complex domains like chemistry. One such differentiable approach is graph-based representation learning, which is an intuitive choice for molecular featurisation; molecules can be easily represented as graphs, with atoms as nodes and bonds as edges. Graph neural networks (GNNs), which operate on molecular graphs and learn task-specific molecular embeddings, have been applied to QSAR, showing promising performance as a featurisation method 28 ; 59 ; 22 ; 60 , but other results suggest GNN-based methods struggle to outperform classical approaches 14 ; 26 ; 57 . Self-supervised pre-training has been proposed as a solution for improving GNN performance and overcoming dataset constraints 48 ; 37 ; 61 ; 10 . Implemented strategies include pre-training on context prediction and attribute masking 23 , self-supervised pre-training via contrastive learning 53 , a disentangled transformer approach pre-trained on topological substructure environments 37 , and pre-training on physicochemical descriptor vectors (PDV) 10 . Although pre-training GNNs for QSAR, both supervised and self-supervised, has been investigated and shown promise, there are limitations with how some methods have been assessed. Firstly, there is a lack of statistical testing against baselines, such as models trained from scratch on benchmark data represented via commonly used static fingerprints 5 ; 55 . Secondly, benchmark comparisons between learned representations pre-trained on different datasets do not provide a picture of architectural superiority. Thirdly, the interpretability of pre-trained models is rarely explored beyond nearest-neighbour analyses of learned embeddings. Finally, data leakage between pre-training and benchmark datasets is often overlooked, particularly at the substructural level. Méndez-Lucio et al. excluded molecules with identical Tanimoto similarities to benchmark molecules from pre-training data 37 . More recently, van Tilborg et al. used a 0.7 Tanimoto similarity threshold of between Bemis–Murcko scaffolds to filter pre-training data 49 We propose a more stringent similarity threshold of 0.5 to filter pre-training data, and investigate the impact of substructure-level data leakage on downstream performance. Data leakage is especially concerning in supervised pre-training, where benchmark and pre-training datasets can overlap at both task and molecule levels due to limited open-source experimental data. Generalisation in the form of robust out-of-distribution (OOD) performance is essential for identifying novel areas of chemical space with therapeutic potential and validating in-distribution performance 7 ; 30 . Therefore, consideration of potential data leakage between pre-training and benchmark datasets is essential in QSAR model development. We investigate the impact of data leakage on downstream performance by applying similarity filtering to pre-training data. In addition to data leakage, the choice of benchmark splits is essential for evaluating OOD performance, as in-distribution splitting can exacerbate benchmark bias 20 ; 30 . Since exploring novel chemical space is important for developing new drugs, ML models should be evaluated for robust OOD performance using benchmark splits with minimal molecular overlap. Commonly used OOD splitting by molecular scaffolds is vulnerable to information leakage and performance overestimation 20 ; 30 . Hierarchical clustering on UMAP projections of molecular fingerprints produces challenging OOD splits; however, train-test split sizes tend to vary 21 , which could increase the variance in performance estimates. On the other hand, Butina clustering on topological fingerprints is a fast, distance-based method that forms evenly sized clusters 11 . Here we opt for the latter approach to generate many evenly-sized OOD splits. Despite using a consistent splitting strategy, test set performance is variable between splits; this volatility can obscure whether differences between ML approaches are meaningful. To validate whether these differences are statistically significant, repeated cross-validation (CV) combined with statistical testing and effect size estimation is recommended 5 . However, robust effect size estimation can be challenging in cases where differences are expected to be subtle, or for tasks where performance is highly variable (e.g., highly imbalanced classification tasks). Moreover, as folds within each k-fold split are mutually exclusive, fold-level metrics within a CV repeat are not independent and should be averaged before statistical testing. We therefore use a high number of repetitions ( 200\times 5 CV) to generate many OOD train-test splits for robust statistical comparison. Here, we explore self-supervised pre-training on topological fingerprints as a general method for improving GNN predictive performance in QSAR. We also include an exploratory analysis of substructure importance in Supplementary Information Section 1.3, facilitated by our multi-radius substructure tokenisation approach. Finally, we investigate the impact of substructure data leakage between pre-training and benchmark datasets, finding that the impact with our pre-training strategy is limited. 2 Results Graph Isomorphism Networks (GINs) 58 pre-trained to predict topological fingerprints (PT-GIN), showed statistically significant improvements over baseline methods on challenging OOD splits in five out of six Biogen regression tasks. We also

Read the complete text