Beyond Affinity: A Benchmark of 1D, 2D, and 3D Methods Reveals Critical Trade-offs in Structure-Based Drug Design
Kangyu Zheng [email protected], Kai Zhang [email protected], Jiale Tan [email protected], Xuehan Chen [email protected], Yingzhou Lu [email protected], Zaixi Zhang [email protected], Lichao Sun [email protected], Marinka Zitnik [email protected], Tianfan Fu [email protected], Zhiding Liang · 2026
Read Beyond Affinity: A Benchmark of 1D, 2D, and 3D Methods Reveals Critical Trade-offs in Structure-Based Drug Design by Kangyu Zheng [email protected], Kai Zhang [email protected], Jiale Tan [email protected], Xuehan Chen [email protected], Yingzhou Lu [email protected], Zaixi Zhang [email protected], Lichao Sun [email protected], Marinka Zitnik [email protected], Tianfan Fu [email protected], Zhiding Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14283.txt.
Introduction
Kangyu Zheng, Kai Zhang, Jiale Tan, and a team across several labs compare drug design methods in this 2026 paper. The field is structure-based drug design, where new drug candidates are shaped to fit a target protein. Three kinds of algorithms lead the field. They are search-based methods, deep generative models, and reinforcement learning.
Most past studies compare models inside one kind only. Cross-kind comparisons are rare, so no one knows the true trade-offs. The team built a benchmark that runs all three kinds on shared ground. Its title says the results expose key trade-offs among 1D, 2D, and 3D methods. Readers get a fair map of what each approach does best.
Catalog record
| CREATOR | Kangyu Zheng [email protected], Kai Zhang [email protected], Jiale Tan [email protected], Xuehan Chen [email protected], Yingzhou Lu [email protected], Zaixi Zhang [email protected], Lichao Sun [email protected], Marinka Zitnik [email protected], Tianfan Fu [email protected], Zhiding Liang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 96 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-14283
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Affinity: A Benchmark of 1D, 2D, and 3D Methods Reveals Critical Trade-offs in Structure-Based Drug Design Kangyu Zheng [email protected], Kai Zhang [email protected], Jiale Tan [email protected], Xuehan Chen [email protected], Yingzhou Lu [email protected], Zaixi Zhang [email protected], Lichao Sun [email protected], Marinka Zitnik [email protected], Tianfan Fu [email protected], Zhiding Liang [email protected] Abstract Currently, the field of structure-based drug design is dominated by three main types of algorithms: search-based algorithms, deep generative models, and reinforcement learning. While existing works have typically focused on comparing models within a single algorithmic category, cross-algorithm comparisons remain scarce. In this paper, to fill the gap, we establish a benchmark to evaluate the performance of fifteen models across these different algorithmic foundations by assessing the pharmaceutical properties of the generated molecules and their docking affinities and poses with specified target proteins. We highlight the unique advantages of each algorithmic approach and offer recommendations for the design of future SBDD models. We emphasize that 1D/2D ligand-centric drug design methods can be used in SBDD by treating the docking function as a black-box oracle, which is typically neglected. Our evaluation reveals distinct patterns across model categories. 3D structure-based models excel in binding affinities but show inconsistencies in chemical validity and pose quality. 1D models demonstrate reliable performance in standard molecular metrics but rarely achieve optimal binding affinities. 2D models offer balanced performance, maintaining high chemical validity while achieving moderate binding scores. Through detailed analysis across multiple protein targets, we identify key improvement areas for each model category, providing insights for researchers to combine strengths of different approaches while addressing their limitations. All the code that are used for benchmarking is available in https://github.com/zkysfls/2025-sbdd-benchmark 1 Introduction Novel types of safe and effective drugs are needed to meet the medical needs of billions worldwide and improve the quality of human life. The process of discovering a new drug candidate and developing it into an approved drug for clinical use is known as drug discovery ( 41 ) . This complex process is fundamental to the development of new therapies that can manage, cure, or alleviate the symptoms of various health conditions. Structure-based drug design (SBDD) ( 4 ) is a core strategy that accelerates this process by using the three-dimensional (3D) structures of disease-related proteins to develop drug candidates. This approach is grounded in the "lock and key" model ( 44 ) , where molecules that bind more effectively to a target protein are more likely to modulate its function, a principle validated by numerous experimental studies ( 22 ; 3 ; 32 ) . Currently, three main algorithmic approaches dominate the drug design field ( 5 ; 17 ; 11 ) : search-based algorithms like genetic algorithms (GA) ( 25 ; 42 ; 45 ; 14 ) , deep generative models such as variational autoencoder (VAE) ( 18 ) and autoregressive models ( 33 ; 35 ; 50 ) , and reinforcement learning (RL) models ( 34 ; 52 ) . While these models, particularly those using 3D protein representations ( 50 ; 33 ; 14 ; 35 ) , are considered state-of-the-art for generating valid and diverse molecules, a clear comparative understanding across these different algorithmic foundations is lacking. Existing benchmarks often focus on comparing models within the same category (typically deep generative models) and prioritize molecular properties over the crucial evaluation of protein-ligand interactions. ( 11 ; 5 ; 17 ) . A preliminary study first highlighted that 1D/2D models can achieve competitive performance against 3D methods in structure-based drug design ( 51 ) . Our work substantially extends these initial findings by introducing a more rigorous and multi-faceted evaluation framework. We curates a comprehensive benchmark that encompasses fifteen models spanning all three algorithmic approaches. We assess model performance through multiple dimensions: traditional heuristic molecular property oracles, docking scores, and pose evaluations - all critical metrics for understanding the quality of protein-ligand interactions in the context of drug discovery. Our analysis reveals a notable dichotomy in 3D models’ performance: while they excel in docking score optimization, achieving consistently superior binding affinity predictions, they show comparable or sometimes inferior performance in pose quality assessments and other heuristic property evaluations. These findings highlight the need for future structure-based models to better balance docking score optimization with other crucial molecular properties and structural validity metrics. Table 1 : Representative structure-based drug design methods, categorized based on the molecular assembly strategies and the optimization algorithms. Columns are various molecular assembly strategies while rows are different optimization algorithms. 1D SMILES/SELFIES 2D Molecular Graph 3D Structure-based Genetic Algorithm (GA) SMILES-GA ( 49 ) Graph GA ( 25 ) - Hill Climbing SMILES-LSTM-HC ( 5 ) MIMOSA ( 16 ) - Reinforcement Learning (RL) REINVENT ( 34 ) MolDQN ( 52 ) - Gradient Ascent (GRAD) Pasithea ( 40 ) DST ( 15 ) - Generative Models SMILES/SELFIES-VAE-BO ( 18 ) JT-VAE ( 27 ) 3DSBDD ( 33 ) , Pocket2mol ( 35 ) , PocketFlow ( 26 ) , ResGen ( 50 ) , TargetDiff ( 20 ) Table 2: Top 1 docking score for each target. Targets in CrossDocking are marked in red , and targets not in CrossDocking are in blue . Model 6GL8 1UWH 7OTE 1KKQ 5WFD 7W7C 8JJL 7D42 7S1S 6AZV Pocket2Mol -11.56 -14.56 -15.72 -14.18 -11.30 -13.76 -13.27 -12.76 -12.90 -12.36 PocketFlow -9.42 -11.04 -10.27 -12.47 -10.30 -13.52 -11.88 -12.79 -10.16 -11.83 ResGen – -9.71 -7.14 -9.81 – -7.88 – -8.94 -11.77 -9.71 3DSBDD -8.61 -12.67 -10.52 -13.36 -11.28 -11.29 -11.67 -11.12 -10.19 -10.13 DST -8.69 -11.09 -11.41 -10.92 -10.13 -12.14 -12.20 -11.87 -11.54 -10.31 graph-GA -8.47 -11.19 -11.15 -10.61 -9.66 -11.85 -10.72 -11.03 -10.47 -9.85 JT-VAE -10.26 -12.38 -12.29 -12.25 -11.65 -12.45 -11.91 -12.79 -11.53 -10.60 MIMOSA -8.64 -11.13 -11.49 -11.00 -9.91 -11.72 -11.85 -11.72 -11.96 -10.27 MolDQN -6.63 -7.38 -7.49 -7.35 -7.79 -7.75 -8.94 -7.30 -8.42 -8.04 Pasithea -9.25 -11.47 -11.56 -10.45 -10.54 -12.00 -11.87 -11.76 -11.35 -10.24 REINVENT -9.06 -11.13 -12.03 -11.19 -10.18 -11.88 -11.63 -12.23 -11.32 -10.66 SMILES-GA -8.83 -10.74 -11.18 -10.47 -9.72 -11.74 -11.29 -11.93 -11.05 -10.46 SMILES-LSTM-HC -9.77 -11.50 -12.35 -12.40 -11.21 -13.93 -11.41 -12.84 -12.02 -10.61 SMILES-VAE -9.35 -11.95 -13.06 -10.91 -10.01 -12.11 -11.95 -12.01 -12.14 -10.42 TargetDiff – -7.30 – -11.53 -10.07 -9.27 -8.91 -6.10 – – Figure 1 : The bar chart of average generated molecules that are calculated by our selected oracles for each model across all target proteins under given time. 1D methods are colored orange, blue is used to indicate 3D methods, and green represents 2D methods. 2 Related Works Significant progress has been made in benchmarking drug design models ( 5 ; 46 ; 23 ; 17 ; 37 ; 21 ; 51 ) . Benchmarks like Guacamol, Molecular Sets (MOSES), Practical Molecule Optimization (PMO), and POSECHECK have been crucial for evaluating algorithms on molecular properties and protein-ligand interactions. More recently, CBGBench ( 29 ) introduced a comprehensive framework for evaluating various 3D SBDD models across multiple generative tasks (de novo, linker design, scaffold hopping). Our work builds upon these efforts but occupies a distinct niche by providing the first large-scale, cross-paradigm benchmark specifically comparing 1D, 2D, and 3D methods side-by-side for the de novo structure-based generation task under unified evaluation conditions. Crucially, we extend beyond standard metrics by