New developments on the Encyclopedia of DNA Elements (ENCODE) data portal.

Luo Y, Hitz BC, Gabdank I, Hilton JA, Kagda MS, Lam B, Myers Z, Sud P, Jou J, Lin K, Baymuradov UK, Graham K, Litton C, Miyasato SR, Strattan JS, Jolanki O, Lee JW, Tanaka FY, Adenekan P, O'Neill E, Cherry JM. · 2020

Read New developments on the Encyclopedia of DNA Elements (ENCODE) data portal. by Luo Y, Hitz BC, Gabdank I, Hilton JA, Kagda MS, Lam B, Myers Z, Sud P, Jou J, Lin K, Baymuradov UK, Graham K, Litton C, Miyasato SR, Strattan JS, Jolanki O, Lee JW, Tanaka FY, Adenekan P, O'Neill E, Cherry JM. (2020) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc7061942.txt.

Introduction

Luo and co-authors report upgrades to the ENCODE data portal in Nucleic Acids Research. The Encyclopedia of DNA Elements project aims to identify every functional element in the human and mouse genomes. Its consortium data are free to all through a portal run by the Data Coordinating Center, first released in 2013. Keeping such a resource findable and usable takes constant work.

Recent updates add new data and assay types, uniform processing pipelines so experiments are analysed the same way, and fresh visualisation tools. A dataset cart lets users gather files across pages. The full collection is now openly available on the Amazon Web Services open data registry, removing access friction for cloud computing. Tutorials and documentation were expanded as well. The authors frame the changes around making ENCODE data findable, accessible, interoperable, and reusable for any researcher.

Catalog record

CREATORLuo Y, Hitz BC, Gabdank I, Hilton JA, Kagda MS, Lam B, Myers Z, Sud P, Jou J, Lin K, Baymuradov UK, Graham K, Litton C, Miyasato SR, Strattan JS, Jolanki O, Lee JW, Tanaka FY, Adenekan P, O'Neill E, Cherry JM.
YEAR2020
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC7061942

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

New developments on the Encyclopedia of DNA Elements (ENCODE) data portal By Yunhai Luo, Benjamin C Hitz, Idan Gabdank, Jason A Hilton, Meenakshi S Kagda, Bonita Lam, Zachary Myers, Paul Sud, Jennifer Jou, Khine Lin, Ulugbek K Baymuradov, Keenan Graham Published in: Nucleic Acids Research DOI: 10.1093/nar/gkz1062 ABSTRACT Abstract The Encyclopedia of DNA Elements (ENCODE) is an ongoing collaborative research project aimed at identifying all the functional elements in the human and mouse genomes. Data generated by the ENCODE consortium are freely accessible at the ENCODE portal (https://www.encodeproject.org/), which is developed and maintained by the ENCODE Data Coordinating Center (DCC). Since the initial portal release in 2013, the ENCODE DCC has updated the portal to make ENCODE data more findable, accessible, interoperable and reusable. Here, we report on recent updates, including new ENCODE data and assays, ENCODE uniform data processing pipelines, new visualization tools, a dataset cart feature, unrestricted public access to ENCODE data on the cloud (Amazon Web Services open data registry, https://registry.opendata.aws/encode-project/) and more comprehensive tutorials and documentation. INTRODUCTION Over 99% of the human genome was sequenced as a part of the Human Genome Project that was completed in April 2003 (1). Learning the function of genomic sequences remains a challenge and even today the biological purpose of a large fraction of the human genome is largely unknown. The Encyclopedia of DNA Elements (ENCODE) project is a public research consortium funded by the National Human Genome Research Institute initiated after the completion of the Human Genome Project in 2003 (2). The goal of the ENCODE project is to identify all the functional elements in the human and mouse genomes. All experimental metadata, raw data and analysis results generated by the ENCODE project are freely accessible to the scientific community on the ENCODE portal (https://www.encodeproject.org/), developed and maintained by the ENCODE Data Coordinating Center (DCC) (3–6). In addition to the data generated by the ENCODE consortium, the ENCODE portal also hosts data from modENCODE (7), modERN (8), The NIH Roadmap Epigenomics Consortium (9) and Genomics of Gene Regulation (https://www.genome.gov/27561317/genomics-of-gene-regulation/) projects as well as some datasets provided by other members of the scientific community. The ENCODE portal provides unrestricted access to more than 15 000 experimental results from more than 40 different categories of high-throughput sequencing (HTS) technologies in over 75 different cell and tissue types. The ENCODE portal hosts more than 640 terabytes of data files and this is expected to grow to over 1 petabyte by 2021. The ENCODE DCC is a critical component of the ENCODE project, working to maximize the accessibility and utility of the data generated by the consortium. Using the data model developed by the DCC, ENCODE production labs format and submit to the ENCODE portal structured metadata describing their experiments and the data generated by the experiments. In addition to serving as the centralized data deposition repository of the ENCODE consortium, the DCC is also responsible for primary data analysis of key ENCODE assays. The DCC processes the raw data using the ENCODE uniform processing pipelines and submits processed analysis files to the portal (3,4,6). The DCC is also responsible for the documentation of a variety of metadata and data standards developed by the ENCODE consortium, as well as for the implementation of automated checks to validate data against these standards (6). Collectively, these efforts ensure that ENCODE data are findable, accessible, interoperable and reusable (10) and follow the original metadata organization principles (6). DATA ON THE ENCODE PORTAL As an ongoing collaborative research project, both the size and the spectrum of the data available on the ENCODE portal continue to grow from year to year (3). More than 2000 experiments of various assay types were added to the portal in the past year, including experiments studying more than 30 new sample types (Supplementary Table S1). Data generated by new HTS assays and cutting-edge technologies have been made publicly available, including, but not limited to, single-nucleus ATAC-seq (11), icSHAPE (12) and long-read RNA-seq (13 Wyman, D. et al. bioRxiv, https://doi.org/10.1101/672931). To get a high-level overview of the available data on the portal, users can go to the experiment matrix page (https://www.encodeproject.org/matrix/?type=Experiment&status=released), which presents the experiments as a matrix with sample types listed as its y-axis and assay types as its x-axis. The matrix along with the faceted browsing interface on the left-hand side of the screen is designed to help users find experiments of interest (Figure 1). [Figure: Experiment matrix. The ENCODE portal hosts data generated by more than 40 different biochemical assays, listed on the x-axis of the matrix. The y-axis lists various sample types represented on the portal. Each cell in the matrix indicates the number of experiments that are currently available on the portal with a particular sample type and the corresponding assay type. To the left of the matrix are faceted browsing interface bars that can be used to positively select (blue) and negate selection (red) of certain values of specific experimental metadata properties.] FACETED BROWSING INTERFACE The faceted browsing interface was updated to include new facet bars: ‘Cell’, ‘Target of assay’ and ‘Date range selection’. The ‘Cell’ facet bar helps to find experiments performed on specific cell type(s) and the ‘Target of assay’ facet bar helps to find experiments with a common target (e.g. transcription factor of interest). The ‘Date range selection’ facet bar allows the users to narrow down the time period in which experiments of interest became publicly available. Facet bars containing long lists of values (e.g. ‘Cell’ and ‘Target of assay’ facet bars) were added the ‘typeahead’ feature to facilitate the lookup for terms of interest (Figure 2). [Figure: Faceted browsing interface. Four new facet bars were added to the faceted browsing interface: (A) ‘Target category’ facet bar, (B) ‘Target of assay’ facet bar, (C) ‘Cell’ facet bar and (D) ‘Date range selector’ facet bar. The ‘Cell’ and ‘Target of assay’ facet bars that have long lists of values include the typeahead search feature to help users locate terms of interest more quickly.] Using data from NCBI Entrez Gene (https://www.ncbi.nlm.nih.gov/gene), HGNC (https://www.genenames.org/), MGNC (http://www.informatics.jax.org/mgihome/nomen/), FlyBase (https://flybase.org/), WormBase (https://www.wormbase.org) and the Gene Ontology Consortium (14–21), the DCC added Gene objects to the portal. Linkage of the target objects to the relevant gene objects allowed categorization of the targets based on the Gene Ontology annotations (for more details on the categorization method, visit https://www.encodeproject.org/target-categorization/). Target categories are listed under the ‘Target category’ facet bar (Figure 2A). DATA PROCESSING Processing the vast amount of data that are hosted on the ENCODE portal is challenging. The variation between experimental results coming from different labs and performed using similar, but not identical protocols requires robust, production-grade uniform processing pipelines that ensure successful analyses and generate comparable outputs. The DCC is tasked with the development, implementation and execution of the uniform processing pipelines that are first defined by collaborative consortium working groups. Centralized processing using uniform processing pipelines by the DCC generates comparable analysis results free of technical artifacts arising from methodological variability across labs and time. All of the pipelines that are developed by the DCC are open source and are maintained in the DCC GitHub repository (Supplementary Table S2, https://github.com/ENCODE-DCC). The pipelines that have been developed in the previous

Read the complete text