Do Larger Models Really Win in Drug Discovery? A Benchmark Assessment of Model Scaling in AI-Driven Molecular Property and Activity Prediction
Jinjiang Guo · 2026
Read Do Larger Models Really Win in Drug Discovery? A Benchmark Assessment of Model Scaling in AI-Driven Molecular Property and Activity Prediction by Jinjiang Guo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26498.txt.
Introduction
Guo and Ding benchmarked whether bigger models truly win in drug discovery, testing scale against compact cheminformatics across 26 endpoints and over 165,000 compound-label records. Classical machine learning took the largest share of best results at about 47 percent, ahead of pretrained sequence models and graph networks, with LLM-based baselines far behind. Classical methods dominated random-split interpolation, while graph and sequence models contended only on harder splits. Small gaps between models rarely counted as decisive wins, and fit among model, task, and validation mattered more than scale.
Catalog record
| CREATOR | Jinjiang Guo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45950 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.26498
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Do Larger Models Really Win in Drug Discovery? A Benchmark Assessment of Model Scaling in AI-Driven Molecular Property and Activity Prediction Jinjiang Guo Abstract The rapid growth of molecular foundation models and general-purpose large language models has encouraged a scale-centric view of artificial intelligence in drug discovery, in which larger pretrained models are expected to supersede compact cheminformatics models and task-specific graph neural networks (GNNs). We test this assumption on 22 molecular property and activity endpoints, including public ADMET and Tox21 benchmarks and two internal anti-infective activity datasets. Across 167,056 held-out task–molecule evaluations under structure-similarity-separated five-fold cross-validation (37,756 ADMET, 77,946 Tox21, 49,266 anti-TB and 2,088 antimalaria), classical machine-learning (ML) models such as RF(ECFP4) and ExtraTrees(RDKit descriptors) win ten primary-metric tasks, GNNs such as GIN and Ligandformer win nine, and pretrained molecular sequence models such as MoLFormer and ChemBERTa2 win three. Rule-based SAR reasoning baselines, represented by GPT5.5-SAR and Opus4.7-SAR, do not win under the prespecified primary metrics, although train-fold-derived SAR knowledge provides measurable but uneven gains for SAR reasoning and interpretation. These results indicate that compact, specialized models remain highly effective for molecular property and activity prediction. The performance differences among classical ML, GNN and pretrained sequence models are often modest and endpoint-dependent, whereas larger or more general models do not provide a universal predictive advantage. Large models may still add value for zero-shot reasoning, SAR interpretation and hypothesis generation, but the results suggest that predictive performance depends on the alignment among molecular representation, inductive bias, data regime, endpoint biology and validation protocol. Keywords: molecular property prediction; ADMET; Tox21; anti-TB; antimalarial activity; QSAR; graph neural networks; molecular language models; large language models; model scaling. 1 Introduction AI-driven drug discovery has entered a scale-conscious phase. Molecular graph neural networks (GNNs), pretrained SMILES transformers, molecular foundation models and general-purpose large language models (LLMs) now coexist with classical machine-learning (ML) models for quantitative structure–activity relationship (QSAR) modelling, built from fingerprints and physicochemical descriptors. This expansion has broadened the modelling toolkit. Pretrained models can encode regularities across large chemical corpora. GNNs can learn task-specific structural representations. LLMs can express medicinal-chemistry reasoning in a flexible natural-language interface. Yet this progress has also sharpened a practical question: do larger models reliably yield better molecular predictions? For small-molecule property and activity prediction, a universal scaling answer is unlikely. Many drug-discovery datasets are small, noisy, imbalanced, endpoint-specific and chemically clustered. A model pretrained on millions or billions of molecules may still be asked to predict a narrow assay readout from a few hundred to a few thousand labelled compounds. Conversely, a random forest or ExtraTrees model using extended-connectivity fingerprints (ECFPs) or RDKit descriptors can align closely with local SAR patterns. Previous benchmarks and few-shot molecular-learning resources have similarly shown that learned representations do not automatically dominate classical molecular representations under data scarcity or distribution shift [ 31 , 15 , 26 , 8 , 32 , 18 ] . Here we turn this critique into a benchmark assessment of model scaling in molecular property and activity prediction. We do not ask whether any model family is globally superior. Instead, we ask where fingerprint ML models, GNNs, pretrained molecular sequence models and LLM-SAR reasoning baselines are useful, and where they fail. The central hypothesis is intentionally conservative: Larger models can be useful, but scale alone may not explain predictive performance in drug discovery. Endpoint-level performance may instead reflect model–task fit: the alignment among molecular representation, inductive bias, training strategy, endpoint biology, data regime and validation setting. The models span several orders of magnitude in effective complexity: tree ensembles with hundreds of decision trees, GCN/GAT/GIN and Ligandformer-style graph models with approximately 10^{5} – 10^{6} learned parameters, ChemBERTa/ChemBERTa2 checkpoints with 77M/10M parameters, and MoLFormer with approximately 47M parameters pretrained on large SMILES corpora [ 6 , 1 , 25 ] . The LLM-SAR baselines represent a different scaling regime: GPT5.5-SAR and Opus4.7-SAR use frontier LLM-scale chemical reasoning to author and refine endpoint-specific SAR rules, but the held-out predictions are produced by rule application rather than by fine-tuning or directly querying a local parameterized predictor. This range supports four questions. Does parameter count predict endpoint-level performance? Does pretraining corpus size predict winning? When do fingerprints, graphs, SMILES tokens or explicit SAR rules provide the most useful inductive bias? Where does LLM-assisted SAR reasoning help, and where can it mislead? 2 Benchmark Scope The comparison covers four task families: public ADMET endpoints from the Therapeutics Data Commons [ 15 ] , Tox21 toxicity assays [ 27 , 22 ] , an anti-TB cellular-activity dataset against Mycobacterium tuberculosis H37Rv at a 1 \mu M threshold, and a GHDDI historical antimalarial cellular-activity dataset against Plasmodium falciparum 3D7 and Dd2 parasites at a 100 nM threshold. The completed ADMET/Tox21 benchmark contains 20 tasks: eight ADMET endpoints and twelve Tox21 single-task assays. The anti-infective extension includes ML, GNN, sequence, GPT5.5-SAR, Opus4.7-SAR and Ligandformer self-attention graph results under the same structure-separated five-fold cross-validation protocol. The benchmark tasks are grouped as follows. • ADMET endpoints. The public ADMET panel contains eight TDC-derived local tasks: five binary classification endpoints and three regression endpoints. Per-task molecule counts range from 475 to 12,328. The classification endpoints have positive rates of approximately 41–76%. The regression endpoints cover Caco2 permeability, lipophilicity and aqueous solubility. • Tox21 toxicity assays. The Tox21 panel contains twelve single-task binary toxicity assays. Per-assay molecule counts range from 5,810 to 7,265. These assays are substantially more imbalanced than the ADMET classification tasks, with positive rates of approximately 2.9–16.2%. PR-AUC and class-specific recall are therefore essential complements to ROC-AUC. • Anti-TB cellular activity. The anti-TB extension contains one binary cellular-activity endpoint for M. tuberculosis H37Rv growth inhibition, with compounds treated as active at a minimum inhibitory concentration (MIC) threshold of 1 \mu M. H37Rv is the canonical virulent laboratory reference strain for tuberculosis biology and remains central to phenotypic anti-TB screening and genome-referenced interpretation [ 5 ] . The current dataset contains 49,266 molecules with an approximate positive rate of 16.3%. It was assembled from GSK and GHDDI high-throughput screening sources, GTBactive/GHDDI internal pipeline annotations, and literature-derived activity records including the Lane–Ekins M. tuberculosis machine-learning dataset [ 21 , 20 ] . This is a whole-cell pharmacological endpoint rather than a single-target assay. Active molecules must penetrate or perturb the mycobacterial cell envelope, avoid assay artefacts and inhibit pathways required for H37Rv growth under the assay conditions. Source-level assay metadata and publication permissions must be completed before external submission. • Antimalarial activity. The antimalarial extension contains GHDDI historical cellular-activity data against P. falciparum 3D7 and Dd2 parasites, using EC {}_{50}\leq 100 nM as the active cutoff. The 3D7 strain is widely used as a drug-sensitive laboratory reference. Dd2 is a drug-resistant line used to probe resistance liabilities; for example, Dd2 carries chloroquine-resistance biology linked to mutated pfcrt , whereas 3D7 provides a sensitive comparator [ 16 ] . This paired-strain context matters because antimalarial discovery must balance potency against sensitive parasites with activity against resistant backgrounds. The dataset contains 2,088 molecules with an approximate positive rate of 30.8%. As with the anti-TB dataset, final assay metadata and publication permissions are required before journal submission. Together, the current evidence package covers 22 endpoints: 19 classification tasks and three regression tasks. The completed