IMNGS: A comprehensive open resource of processed 16S rRNA microbial profiles for ecology and diversity studies.
Lagkouvardos I, Joseph D, Kapfhammer M, Giritli S, Horn M, Haller D, Clavel T. · 2016
Read IMNGS: A comprehensive open resource of processed 16S rRNA microbial profiles for ecology and diversity studies. by Lagkouvardos I, Joseph D, Kapfhammer M, Giritli S, Horn M, Haller D, Clavel T. (2016) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc5034312.txt.
Introduction
Ilias Lagkouvardos and six co-authors build a platform for microbial profiles in Scientific Reports in 2016. The world's main sequence archive already holds over 100,000 surveys based on the 16S rRNA gene, the standard barcode for bacteria. Those raw datasets sit in mismatched forms, so few researchers can use them together. IMNGS reprocesses all of them in one uniform way.
The platform screens the archive, builds a cleaned profile for each sample, and lets users search the whole pool through a web page. Researchers can ask how common a chosen microbe is across hosts or ecosystems, or zoom in on one taxonomic group. They can also push their own new data through the same pipeline and compare it fairly with the archive. The authors present IMNGS as shared groundwork for ecology and diversity studies that no single lab could assemble alone.
Catalog record
| CREATOR | Lagkouvardos I, Joseph D, Kapfhammer M, Giritli S, Horn M, Haller D, Clavel T. |
|---|---|
| YEAR | 2016 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IMNGS: A comprehensive open resource of processed 16S rRNA microbial profiles for ecology and diversity studies By Ilias Lagkouvardos, Divya Joseph, Martin Kapfhammer, Sabahattin Giritli, Matthias Horn, Dirk Haller, Thomas Clavel Published in: Scientific Reports DOI: 10.1038/srep33721 ABSTRACT The SRA (Sequence Read Archive) serves as primary depository for massive amounts of Next Generation Sequencing data, and currently host over 100,000 16S rRNA gene amplicon-based microbial profiles from various host habitats and environments. This number is increasing rapidly and there is a dire need for approaches to utilize this pool of knowledge. Here we created IMNGS (Integrated Microbial Next Generation Sequencing), an innovative platform that uniformly and systematically screens for and processes all prokaryotic 16S rRNA gene amplicon datasets available in SRA and uses them to build sample-specific sequence databases and OTU-based profiles. Via a web interface, this integrative sequence resource can easily be queried by users. We show examples of how the approach allows testing the ecological importance of specific microorganisms in different hosts or ecosystems, and performing targeted diversity studies for selected taxonomic groups. The platform also offers a complete workflow for de novo analysis of users’ own raw 16S rRNA gene amplicon datasets for the sake of comparison with existing data. IMNGS can be accessed at www.imngs.org. Microbial communities are key members of many ecosystems on earth. They play important roles in essential biological functions ranging from carbon and nitrogen cycles in the environment to regulation of immune and metabolic responses in colonized animal and human hosts12. Hence, research in microbial ecology is essential for proper understanding of these communities and their functional impact. One critical aspect in microbial ecology is to describe the members of microbial communities that, in contrast to macro ecology, cannot be easily identified and enumerated. Studies in the field had been limited in the past to culture-based approaches that allow isolation of microorganisms as pure cultures and downstream characterization in vitro and in vivo. The limitation of these approaches is that a substantial proportion of microorganisms escape cultivation3. Thus, early advances in sequencing technologies enabled culture-independent profiling of microbial communities using phylogenetic markers such as the highly conserved 16S ribosomal RNA (rRNA) gene4. Next Generation Sequencing (NGS) methods, including pyrosequencing and Illumina technology, have further revolutionized the field of microbial ecology by allowing in-depth and high-throughput parallel analysis of PCR products from multiple samples. These amplicon sequencing approaches have been used extensively for characterization of diverse ecosystems ranging from aquatic and terrestrial to host-derived ecosystems567. The maturation of NGS technologies has allowed expansion of the number of parallel samples under investigation and enabled investigation of temporal dynamics in composition of microbiomes. Due to continuously increasing capacity and decreasing costs, recent sequencing-based studies were in the range of a few hundreds or thousands of samples per study891011. These advances resulted in a flood of primary amplicon sequence data that are usually archived in one of the long-term repositories of the International Nucleotide Sequence Database Collaboration, including the Sequence Read Archive (SRA), for reference and reuse. These repositories have accumulated unprecedented amounts of 16S rRNA gene amplicon datasets that cover the vast majority of biomes on earth biospheres12. However, there is to date a lack of user-friendly and flexible approaches dedicated to standardized and reproducible meta-analysis of microbial distribution and diversity exploiting this large pool of sequence data. A web tool that can be used to analyze amplicon sequences in public archives has recently been published13, but the system relies on a relatively limited number of data and is not really extensible. We previously demonstrated the potential of using accumulated amplicon data for estimation of the diversity of the bacterial phylum Chlamydiae14. In the present work, we describe the Integrated Microbial Next Generation Sequencing (IMNGS) web platform, a transparent and fully flexible system for integration of archived amplicon 16S rRNA gene sequence reads into readily accessible sample-specific databases. Scripts in the backend of IMNGS routinely check and retrieve raw data from SRA and uniformly process and classify them. Registered users can obtain sequences across all samples or lists of samples selected by the user, and investigate prevalence patterns based on similarity to selected sequences or taxonomic groups of interest. In addition, a user friendly implementation of the UPARSE amplicon analysis pipeline15 is offered for researchers that want to explore their own raw data and compare them to the similarly preprocessed samples in the IMNGS system. The present manuscript contains a detailed description of IMNGS and provides example analyses to demonstrate the potential of this novel platform. RESULTS Features of the IMNGS platform IMNGS is based on an innovative bioinformatic workflow embedded in a web interface, which allows users to perform large-scale analysis of all 16S rRNA gene amplicon datasets available in SRA, for instance to generate novel insight into the diversity and ecological distribution of specific bacterial groups of interest. IMNGS has two core functions (query types) that help generating such data: sequence similarity search against template sequences provided by the users, and query based on taxonomic classification of sequences available in the IMNGS database. A template analysis for each approach is presented in the next sections. The first complete IMNGS crawling of the SRA detected 105,374 runs (samples) that matched the amplicon study description. After quality filtering and processing, 55,073 runs remained that became available for query (build 1510, i.e. October 2015, used in the present paper for description and demonstration purposes; the current size of the IMNGS database as per July 2016 is 85121 runs). To ensure a seamless integration of the continuous flow of new samples in SRA, the sequences from each sample are clustered de novo at 97% sequence identity. All samples represent currently a total of 1.4 billion sequences that clustered into 53,696,442 sample-specific OTUs (operational taxonomic units). This means that an OTU name (or number) has no reference value outside of the given sample where it was created. Although independent de novo clustering impairs more straightforward comparison between samples as could be done with a common OTU table, it has the advantage to allow continuous update of the database and to retain all unknown sequences that would be otherwise lost during closed reference-based clustering required for creation of such a common OTU table. The origin of samples in IMNGS is diverse (96 categories), but not uniformly distributed. The database is skewed towards host-associated sources (67%), and particularly human samples (50%). Samples of environmental origin account for approximately 33% of the database. The performance of queries varies greatly depending on the number of samples selected. In general, a taxonomy query is finished within one hour, while a similarity query over all samples can take approximately 6 h per sequence. The analysis of newly generated 16S rRNA gene amplicon reads from users is fast, i.e., returns OTU tables and corresponding sequence information from raw data in less than an hour. Readers are invited to look in detail at the methods for information on the scalability of the system. As described in detail in the Methods section and in README files provided online after analysis, IMNGS delivers detailed information about the abundance and distribution of sample-specific OTUs that match queried sequences or taxonomic groups in the form of tables and sequence files.