A Workflow to Create a High-Quality Protein-Ligand Binding Dataset for Training, Validation, and Prediction Tasks
Yingze Wang 1,Δ , Kunyang Sun 1,Δ , Jie Li 1 , Xingyi Guan 1 , Oufan Zhang 1 , Dorian Bagni 1 , Yang Zhang 4-6 , Heather A. Carlson 7 , Teresa Head-Gordon* 1-3 · 2024
Read A Workflow to Create a High-Quality Protein-Ligand Binding Dataset for Training, Validation, and Prediction Tasks by Yingze Wang 1,Δ , Kunyang Sun 1,Δ , Jie Li 1 , Xingyi Guan 1 , Oufan Zhang 1 , Dorian Bagni 1 , Yang Zhang 4-6 , Heather A. Carlson 7 , Teresa Head-Gordon* 1-3 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01223.txt.
Description
A 2024 arXiv research paper by Yingze Wang 1,Δ , Kunyang Sun 1,Δ , Jie Li 1 , Xingyi Guan 1 , Oufan Zhang 1 , Dorian Bagni 1 , Yang Zhang 4-6 , Heather A. Carlson 7 , Teresa Head-Gordon* 1-3. Development of scoring functions (SFs) used to predict protein-ligand binding energies requires high-quality 3D structures and binding assay data for training and testing their parameters.
Catalog record
| CREATOR | Yingze Wang 1,Δ , Kunyang Sun 1,Δ , Jie Li 1 , Xingyi Guan 1 , Oufan Zhang 1 , Dorian Bagni 1 , Yang Zhang 4-6 , Heather A. Carlson 7 , Teresa Head-Gordon* 1-3 |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-01223
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Workflow to Create a High-Quality Protein-Ligand Binding Dataset for Training, Validation, and Prediction Tasks Yingze Wang 1,Δ , Kunyang Sun 1,Δ , Jie Li 1 , Xingyi Guan 1 , Oufan Zhang 1 , Dorian Bagni 1 , Yang Zhang 4-6 , Heather A. Carlson 7 , Teresa Head-Gordon* 1-3 Abstract Development of scoring functions (SFs) used to predict protein-ligand binding energies requires high-quality 3D structures and binding assay data for training and testing their parameters. In this work, we show that one of the widely-used datasets, PDBbind, suffers from several common structural artifacts of both proteins and ligands, which may compromise the accuracy, reliability, and generalizability of the resulting SFs. Therefore, we have developed a series of algorithms organized in a semi-automated workflow, HiQBind-WF, that curates non-covalent protein-ligand datasets to fix these problems. We also used this workflow to create an independent data set, HiQBind, by matching binding free energies from various sources including BioLiP, Binding MOAD and BindingDB with co-crystalized ligand-protein complexes from the PDB. The resulting HiQBind workflow and dataset are designed to ensure reproducibility and to minimize human intervention, while also being open-source to foster transparency in the improvements made to this important resource for the biology and drug discovery communities. 1 Kenneth S. Pitzer Theory Center and Department of Chemistry, 2 Department of Bioengineering, 3 Department of Chemical and Biomolecular Engineering, University of California, Berkeley, CA, 94720 USA 4 Department of Computer Science, School of Computing, National University of Singapore, 117417, 5 Cancer Science Institute of Singapore, National University of Singapore, 117599, 6 Department of Biochemistry, Yong Loo Lin School of Medicine, National University of Singapore, 117596, Singapore 7 Odyssey Therapeutics Inc. 1350 Highland Dr., Ann Arbor, MI, 48108, USA Δ authors contributed equally corresponding author: [email protected] 1 INTRODUCTION Scoring functions (SFs) are crucial in computer aided drug discovery, utilized for selecting the most probable ligand geometry and its binding pose with a protein that best correlates or predicts their free energy of binding. 1 There are a plethora of SFs being developed and widely used by computational and medicinal chemists, and they can be broadly categorized into either classical scoring functions 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 or machine learning scoring functions. 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 The majority of protein-ligand SF predictors, whether physical or machine-learned, have been trained on the PDBbind dataset 21 , 22 , 23 , 24 , 25 , 26 , 27 (http://www.pdbbind-cn.org/), specifically v2020, a curated set of \sim 19,500 biomolecular complex structures and their experimentally measured binding affinities. PDBbind is further organized into a "general" data subset that is often adopted by SFs for training, and separate "refined" and "core" datasets which contain protein-ligand complexes with the best structural quality and most reliable binding affinity data that is used for testing. Various benchmarks based on PDBbind, such as CASF (Comparative Assessment of Scoring Functions) series 28 , 29 , 30 , 31 , CSAR (Community Structure Activity Resource) 2010 32 and PDBbind-blind-2013 33 have been proposed to assess the scoring power, ranking power, docking power and screening power of various SFs. PDBbind has been an invaluable resource to the biomolecular community during its two-decade development, but a significant portion of the PDBbind dataset contains structural errors, statistical anomalies, and a sub-optimal organization of protein-ligand classes that can limit SF training and validation 34 , 35 . These inconsistencies undermines the purpose of the refined set, which is intended to serve as a high-quality benchmark for evaluation of scoring functions and docking methods. Another concern in regards PDBbind is that the data processing procedure is neither open-sourced nor automated, potentially relying on individual groups needing to introduce their own manual intervention that may lead to inconsistencies. Furthermore, the PDBbind data curation process became more problematic in 2021 when PDBbind ceased to be freely available for data curated after 2020, which limits access and hinders the development and validation of new scoring functions (and other additional uses). Fortunately, other curation efforts have created alternative protein-ligand structural and/or binding datasets that have increased the size and comprehensiveness of available data for drug discovery efforts. BindingDB is a database containing 2.9 million binding measurements spanning 1.3 million compounds for thousands of protein targets, which are curated from the literature and patents. 36 , 37 , 38 Binding MOAD is a curated database of 41,409 protein–ligand structural complexes, with binding affinity data available for 15,223 (37%) of them; Binding MOAD’s curation involved extracting high-quality structures from the PDB and finding associated binding data from publications with the aid of an NLP-based annotation tool. 39 , 40 , 41 , 42 BioLiP is a large database of over 900,000 biologically-relevant protein-ligand interactions curated from the PDB, and enriched with various functional annotations, including Enzyme Commission numbers, Gene Ontology terms, catalytic sites, and binding affinities from Binding MOAD, BindingDB, as well as manual surveys. 43 , 44 Other related datasets that focuses more on the geometries of proteins and ligands, including PLINDER 45 and DockGen 46 , contain an expanded set of protein-ligand structural complexes but do not have annotations of binding affinity data. However, in general, these curation efforts have largely focused on increasing the size and comprehensiveness of protein-ligand data, rather than increasing the quality and reliability of the data themselves. Therefore, there is a pressing need for an open-source and systematic workflow to prepare protein-ligand binding datasets with well-defined binding affinity annotations and higher-quality structures in order to foster greater reproducibility, transparency, and accessibility. In this work, we introduce HiQBind-WF, a workflow of algorithms for data cleaning and structural preparation that creates a curated dataset of high-quality, non-covalent protein-ligand complex structures with binding affinity annotations. This workflow contains several modules: (1) a curating procedure that rejects ligands covalently bonded to proteins, ligands with rarely-occurring elements, and structures containing severe steric clashes; (2) a ligand-fixing module to ensure the correctness of the ligand structure including correct bond order and reasonable protonation states; (3) a protein-fixing module to extract and, when necessary, add missing atoms to all chains involved in the protein-ligand binding; (4) a structure refinement module to simultaneously add hydrogens to both proteins and ligands in their complex state, as opposed to the current practice in PDBbind that completes the hydrogen chemistry for protein and ligand independently. The motivation for adding this hydrogen growth module is that although many SFs only take heavy atoms into consideration, future physics-based SFs could potentially benefit from explicit hydrogens to better model intermolecular interactions such as hydrogen bonding. We utilized this workflow to optimize PDBbind v2020 and compared the processed structures. Analysis of the structural differences between the same PDB entry demonstrated that HiQBind-WF is able to correct for various observed structural imperfections. Further, to illustrate the applicability of the HiQBind-WF, we created HiQBind, a new dataset with high-quality protein-ligand binding structures and affinities by processing PDB entries included in BioLiP2 and Binding MOAD associated with binding affinities drawn from BindingDB. The HiQBind dataset includes >18,000 unique PDB entries and >30,000 protein-ligand complex structures. We also confirmed that HiQBind