New tools for the analysis and validation of cryo-EM maps and atomic models.

Afonine PV, Klaholz BP, Moriarty NW, Poon BK, Sobolev OV, Terwilliger TC, Adams PD, Urzhumtsev A. · 2018

Read New tools for the analysis and validation of cryo-EM maps and atomic models. by Afonine PV, Klaholz BP, Moriarty NW, Poon BK, Sobolev OV, Terwilliger TC, Adams PD, Urzhumtsev A. (2018) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc6130467.txt.

Introduction

Afonine and co-authors present a methods article in Acta Crystallographica Section D on new tools for checking cryo-EM maps and models. Cryo-electron microscopy now yields many near-atomic structures. Each map must be fit with an atomic model. Both the map and the fit need careful quality checks.

The tools sit inside the PHENIX software suite. They judge map quality, model quality, and how well the two match. The team applied them across many high-resolution maps. They discuss what the scores show and where errors hide. The work aims to keep a fast-growing field honest about its structures.

Catalog record

CREATORAfonine PV, Klaholz BP, Moriarty NW, Poon BK, Sobolev OV, Terwilliger TC, Adams PD, Urzhumtsev A.
YEAR2018
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC6130467

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

New tools for the analysis and validation of cryo-EM maps and atomic models By Pavel V Afonine, Bruno P Klaholz, Nigel W Moriarty, Billy K Poon, Oleg V Sobolev, Thomas C Terwilliger, Paul D Adams, Alexandre Urzhumtsev Published in: Acta Crystallographica. Section D, Structural Biology DOI: 10.1107/S2059798318009324 ABSTRACT New methods and PHENIX tools for quality assessment of cryo-EM maps, atomic models and model-to-map fitting are presented. Results of systematic application of these tools to high-resolution cryo-EM maps and corresponding atomic models are analyzed and discussed. Keywords: cryo-EM, atomic models, model quality, data quality, validation, resolution INTRODUCTION While crystallography is still the predominant method for obtaining the three-dimensional atomic structures of macromolecules, the number of near-atomic resolution structures from electron cryomicroscopy (cryo-EM) is growing exponentially (Fig. 1 ▸; Orlov et al., 2017 ▸). Since the introduction of direct electron detectors (see, for example, Faruqi et al., 2003 ▸; Milazzo et al., 2005 ▸; Deptuch et al., 2007 ▸), cryo-EM is increasingly becoming the method of choice for many macromolecules, particularly since these detectors have been standardized for routine usage. Crystallographic structure determination is a multi-step process that includes sample preparation, obtaining a crystal of the sample, measuring experimental data from that crystal, solving the phase problem and building an atomic model, followed by model refinement and validation (Rupp, 2010 ▸). As an imaging technique, the collection and processing of experimental data is significantly different in structure determination using cryo-EM because there is no phase problem to solve (Frank, 2006 ▸). However, it is very similar to crystallography in the subsequent stages of the process, such as model building, refinement and validation. [Figure: Cryo-EM models in the PDB. (a) Cumulative number of models and (b) mean resolution extracted from the database by year. (c) Distribution of the resolution for all models.] It has been widely accepted that model validation (Chen et al., 2010 ▸) is critical in assessing the correctness of a model from chemical, physical and crystallographic viewpoints, which in turn helps to ensure that the result, the atomic model of a structure, is suitable for further uses (see, for example, Read et al., 2011 ▸). Model validation also plays a key role in identifying scientific fraud (Janssen et al., 2007 ▸) and the misinterpretation of experimental data (Chang et al., 2006 ▸; see also Brändén & Jones, 1990 ▸; Kleywegt & Jones, 1995 ▸; Kleywegt, 2000 ▸ and references therein). In crystallography, it took decades for validation methods and tools to become established, mature and gain wide acceptance. Cryo-EM is just entering the era of routine use at near-atomic resolution (Kühlbrandt, 2014 ▸) with atomic models built de novo based on experimental maps. While many validation metrics, such as those that assess the geometry of atomic models, can be directly imported from crystallography, others are not readily applicable (such as crystallographic R factors). This is mostly because of the nature of the experimental data; for example, there are no experimental structure factor amplitudes in cryo-EM that could be used to calculate R factors. To date, there are more than a thousand atomic models in the PDB that were obtained using cryo-EM and that were likely to have been evaluated using tools borrowed from various crystallographic packages or other sources. Thus, an overall quality assessment of these models may be useful (Henderson et al., 2012 ▸; Pintilie et al., 2016 ▸; Joseph et al., 2017 ▸; Neumann et al., 2018 ▸). Here, we survey cryo-EM maps and derived models as well as discuss tools and methods implemented in the PHENIX suite of programs (Adams et al., 2010 ▸) specifically designed to evaluate cryo-EM-derived atomic models and maps. We have used these tools to provide an assessment of the quality of a high-resolution subset (4.5 Å or better) of cryo-EM-derived atomic models that are currently available in the Protein Data Bank (PDB; Bernstein et al., 1977 ▸; Berman et al., 2000 ▸) and the corresponding maps available in the Electron Microscopy Data Bank (EMDB; Lawson et al., 2011 ▸). The analysis shows an improvement in model quality in recent years, while also suggesting that there are opportunities for further improvement that will require the development of new validation tools and procedures. METHODS All of the tools and methods described in this section are either standard PHENIX tools or have been implemented in PHENIX as part of this work. Validation 2.1. The aim of modeling experimental data is to find a mathematical description that allows an accurate and unambiguous explanation of the data. This description can then be used to explain known features of the system studied and to predict new features. Subject to validation are the atomic model, the experimental data (three-dimensional reconstruction, in the case of cryo-EM) and the model to data fit. Validating the results of a structural analysis typically requires answering questions such as the following. - (i) How high is my data quality? - (ii) Does my model agree with priors (for example, chemical and physical knowledge)? - (iii) How well does my model fit the experimental data? - (iv) Does my model overinterpret my experimental data? Is my model unique? - (v) What are the method-specific features of the data, model and process of obtaining the model that may affect the quality of the final model? For example, in crystallography, once obtained from data-processing tools, diffraction intensities or amplitudes are never changed or otherwise modified even though the obtained density may depend on phasing with the atomic model under refinement. In contrast, cryo-EM maps may be subjected to various changes [such as masking, focused refinement (von Loeffelholz et al., 2017 ▸), sharpening, blurring etc.] throughout the entire process of structure solution; however, once a final map has been obtained it will be constant throughout the atomic model building and refinement process as it is comparable to an independently phased map and thus is model-independent. Validation normally consists of three components: analysis of the experimental data, analysis of the model and analysis of the fit of the model to the data. These analyses are performed using some well established methods and metrics. Generally, these metrics are of two types: global and local (see, for example, Tickle, 2012 ▸). Global metrics provide concise summaries that are often easy to evaluate (see, for example, Urzhumtseva et al., 2009 ▸); however, they may be misleading as they may not reveal local or low-occurrence violations. For instance, the root-mean-square (r.m.s.) deviation between covalent bond lengths calculated from atomic coordinates of the model and those found in restraints libraries is a global validation metric that is almost universally used in validation reports. While this metric is useful in providing an overall indication of model geometric quality, it is unlikely to reveal one or a few covalent bonds with poor geometry (Morffew & Moss, 1983 ▸; Urzhumtsev, 1992 ▸). In contrast, local metrics, for example the quality of a residue side-chain fit into the density map measured with a map correlation, or validation of (φ, ψ) torsion angles in proteins (Ramachandran et al., 1963 ▸), are good at identifying local issues, but may be voluminous and require careful presentation. In this work, we only use global validation metrics. While some of these metrics are

Read the complete text