SPADE : Fast Drug Discovery by Learning from Sparse Data

Rahul Nandakumar, Ben Fauber, Deepayan Chakrabarti · 2026

Read SPADE : Fast Drug Discovery by Learning from Sparse Data by Rahul Nandakumar, Ben Fauber, Deepayan Chakrabarti (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05370.txt.

Introduction

Finding a good drug candidate usually means testing huge numbers of molecules, most of which fail. Rahul Nandakumar, Ben Fauber, and Deepayan Chakrabarti present SPADE, an algorithm that learns from sparse test results. It is built for new proteins where no earlier data exists to guide the search.

SPADE picks which candidates to test next so that strong binders turn up fast. On average it needs only about forty tests to find ten high-quality molecules. Against deep learning and Bayesian methods it won on more proteins, worked faster, and used far fewer tests to reach the same quality.

Catalog record

CREATORRahul Nandakumar, Ben Fauber, Deepayan Chakrabarti
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.05370

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SPADE : Fast Drug Discovery by Learning from Sparse Data Rahul Nandakumar, Ben Fauber, Deepayan Chakrabarti Abstract Drug discovery seeks molecules (ligands) that bind strongly and selectively to a target protein. However, fewer than 5 % 5\% of candidate ligands pass the bar for even the early stages of drug discovery. Furthermore, we want methods that work for novel proteins for which we have no prior data. Starting from scratch, we have to iteratively select and test candidate ligands such that we find enough ligands of the desired quality in as few tests as possible. Our proposed algorithm, named SPADE , introduces a novel approach to ligand selection that requires only 40 40 tests on average to find 10 10 high-quality ligands. In one-vs-one comparisons, SPADE outperforms deep learning and Bayesian optimization methods on more proteins, achieving median improvements of 7 % − 32 % 7\%-32\% in sample efficiency. SPADE is also 10x faster than its closest competitor at scoring candidate drugs. Dataset and code is available at https://anonymous.4open.science/r/SPADE_Fast_Drug_Discovery_by_Learning_from_Sparse_Data-F028/README.md 1 Introduction Proteins regulate nearly all biological processes in the human body, and disruptions to their activity can lead to disease. A central goal of drug discovery is therefore to design small molecules (ligands) that bind strongly and selectively to a target protein [ 18 , 44 ] . Despite decades of progress, this process remains highly inefficient: fewer than 5% of candidate ligands succeed even in early-stage screening. The challenge is particularly acute for novel proteins, where little or no prior data is available. In early-stage drug discovery, researchers iteratively run design-make-test-analyze (DMTA) cycles [ 31 ] . In each cycle, a small number of ligands are selected, synthesized, and experimentally evaluated. The outcome of interest is the ligand’s binding affinity, typically measured via the pIC50 (PIC) value [ 40 ] , where higher values indicate stronger binding. Since experimental tests are slow and expensive, the key objective is to identify a small number of (say, 5 ) high-quality ligands (e.g., PIC \geq 8 ) using as few tests as possible. We refer to this objective as a race-to- k problem, that is: find k ligands with PIC above a desired threshold in as few DMTA cycles as possible. A PIC of 8 or 8.5 is often a favorable starting point for the later stages of drug discovery [ 22 ] . Hence, we focus on the race-to-8 and race-to-8.5 problems. This setting presents several fundamental challenges. First, the search space is vast, consisting of millions of candidate ligands represented by high-dimensional embeddings. Second, the signal is extremely sparse: only a small fraction of ligands meet the desired affinity threshold (e.g., only 7% of candidates have PIC \geq 8 , and just 2.7% have PIC \geq 8.5 ). Third, we start with no labeled data and must learn entirely from sequential, adaptively collected observations. These properties make standard machine learning approaches difficult to apply effectively. Recent work approaches this problem using active learning and Bayesian optimization. These methods estimate the PIC of each candidate ligand and combine it with an uncertainty estimate (e.g., from a Gaussian process) to guide selection [ 11 ] . However, in our setting, accurate estimation is difficult due to extreme data sparsity and high dimensionality: we begin with no data, and each ligand is represented by a 2{,}048 -dimensional embedding. Moreover, most ligands fail to meet the desired threshold. As a result, estimating PICs is both difficult and unnecessary for the race-to- k objective. Another line of work constructs protein embeddings [ 33 , 30 ] . However, directly predicting affinity using such embeddings achieves limited accuracy [ 9 , 6 ] . Since we focus on novel proteins, we assume that no similar proteins are available, and thus do not rely on protein embeddings. If such information is available, it can be incorporated as a preprocessing step to filter the candidate ligand set (we show such an experiment in Appendix B ). Finally, we emphasize that our work focuses on ligand affinity, which is fundamentally distinct from molecular docking [ 38 ] . Our approach is binding-mode agnostic and focuses on continuous affinity (PIC) values. In contrast, datasets such as DUD-E [ 26 ] provide only docking scores, while LIT-PCBA [ 42 ] offers binary active/inactive labels. Neither dataset captures the continuous affinity information essential for ranking and prioritizing ligands, rendering them unsuitable for our objective. Our contributions: • Problem formulation: We cast early-stage drug discovery for novel proteins as a sparse, sequential race-to- k problem, where the objective is to identify k high-affinity ligands using as few DMTA cycles as possible. • Classification-based selection (Sec. 3): We propose SPADE ( S parse-data P redictions for A ccelerating D rug E xploration), which replaces full PIC estimation with the simpler task of predicting whether a ligand can outperform the current k^{th} -best ligand. Thus, SPADE focuses directly on improving the top- k set. • Robust learning under extreme sparsity (Sec. 3): Since the positive class contains only k\!-\!1 ligands, standard classifiers struggle. Instead, we introduce a robust classifier that minimizes the expected loss over a Gaussian centered at each positive example, reducing overfitting to noise. We derive a closed-form expression for the expected loss to avoid sampling. We then combine these classifiers to efficiently identify the best candidate ligands. • Large-scale dataset (Sec. 4): We built a new 1.5 M-entry PubChem-derived dataset, complementary to existing datasets, to test sequential ligand discovery under realistic sparsity. • Empirical evaluation (Sec. 4): Across 100 proteins, SPADE consistently outperforms state-of-the-art baselines, requiring 7\%\!-\!32\% fewer ligand tests to reach target PICs and achieving a 10\times speedup in scoring ligands. 2 Related Work We review prior work on Ligand-Protein Interaction affinity (LPI) prediction, protein and ligand embeddings, and active-learning for drug discovery. LPI prediction: Several papers cast LPI prediction as a binary classification task. Then, they apply machine learning models to learn affinities [ 27 , 17 , 24 , 25 , 23 , 47 , 7 ] . Deep learning models have also been developed for this task [ 13 , 14 , 21 , 28 , 46 , 19 , 20 , 45 ] . However, simple binary labels, such as active/inactive, oversimplifies the continuous nature of binding affinities. Hence, these methods have been less useful for ranking ligands for drug screening [ 36 ] . In contrast, SPADE considers only the current top- k ligands as the positive class, so the labels shift over the DMTA cycles. Another approach is to use physics-based methods like free-energy perturbation. These methods attempt to mimic the protein-ligand binding interactions via computational simulations. They can offer more precise results but are computationally intensive [ 43 , 35 , 37 ] . Hence, even if these methods are used instead of lab tests in DMTA cycles, we still need to minimize the number of cycles. Protein and ligand embeddings: Existing approaches try to predict ligand-protein interaction affinity using vector embeddings [ 17 , 15 ] and graph-based models [ 39 , 2 , 41 , 17 ] for protein and ligand embeddings. Several specialized embeddings also exist for proteins [ 30 , 33 ] and for ligands [ 34 , 5 ]

Read the complete text