A comprehensive overview and evaluation of circular RNA detection tools.

Zeng X, Lin W, Guo M, Zou Q. · 2017

Read A comprehensive overview and evaluation of circular RNA detection tools. by Zeng X, Lin W, Guo M, Zou Q. (2017) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc5466358.txt.

Introduction

Zeng and co-authors compare the software tools that hunt for circular RNAs in gene data. Their overview and evaluation appeared in PLoS Computational Biology. Circular RNAs form loops instead of straight chains. They can soak up small regulatory RNAs or serve as disease markers. New sequencing data have revealed thousands of them. Many detection tools have appeared in response. Users lacked a fair guide to which tool works best.

The team built an improved simulator for testing. It creates fake reads that mimic real circular RNA signals. They then ran 11 detection tools on both fake and real data sets. Scores covered precision, sensitivity, and overall balance. No single tool won on every measure. Three tools stood out for balance. CIRI, CIRCexplorer, and KNIFE each paired accuracy with good coverage. The authors offer the results as practical guidance for choosing a tool.

Catalog record

CREATORZeng X, Lin W, Guo M, Zou Q.
YEAR2017
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC5466358

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A comprehensive overview and evaluation of circular RNA detection tools By Xiangxiang Zeng, Wei Lin, Maozu Guo, Quan Zou, Paul P. Gardner Published in: PLoS Computational Biology DOI: 10.1371/journal.pcbi.1005420 ABSTRACT Circular RNA (circRNA) is mainly generated by the splice donor of a downstream exon joining to an upstream splice acceptor, a phenomenon known as backsplicing. It has been reported that circRNA can function as microRNA (miRNA) sponges, transcriptional regulators, or potential biomarkers. The availability of massive non-polyadenylated transcriptomes data has facilitated the genome-wide identification of thousands of circRNAs. Several circRNA detection tools or pipelines have recently been developed, and it is essential to provide useful guidelines on these pipelines for users, including a comprehensive and unbiased comparison. Here, we provide an improved and easy-to-use circRNA read simulator that can produce mimicking backsplicing reads supporting circRNAs deposited in CircBase. Moreover, we compared the performance of 11 circRNA detection tools on both simulated and real datasets. We assessed their performance regarding metrics such as precision, sensitivity, F1 score, and Area under Curve. It is concluded that no single method dominated on all of these metrics. Among all of the state-of-the-art tools, CIRI, CIRCexplorer, and KNIFE, which achieved better balanced performance between their precision and sensitivity, compared favorably to the other methods. INTRODUCTION Circular RNA (circRNA) is a class of noncoding RNA that was discovered decades ago [1]; however, its abundance and ubiquity in eukaryotes were only recognized recently [2–5] because of the advance of next-generation RNA sequencing (RNA-Seq). Although it appears that many circRNAs remain to be discovered, ongoing studies continue to demonstrate important functions of circRNA in cell physiology [6–11]. For instance, the well-known circular RNA sponge for miR-7 (ciRS-7), which originates from the vertebrate cerebellar degeneration-related 1 (CDR1) antisense transcript, has the capacity to serve as a microRNA (miRNA) sponge. It is highly expressed in human and mouse brain cells [2, 12]. Given its possession of more than 60 miR-7 binding sites [2, 13], it is suggested to inhibit the binding of miR-7 to its target mRNAs. Another circRNA that can potentially also act as an miRNA sponge is derived from the murine sex-determining region Y (Sry) gene; it is a testis-specific circRNA, possessing 16 target sites for miR-138 in mouse [13]. Another function proposed for circRNAs is that they affect gene regulation by competing with linear splicing on the usage of splice sites during the cotranscription process, leading to a change in the level of gene expression [14, 15]. Although most circRNAs are from exons, there are also intron-containing circRNAs. It’s reported that they are largely concentrated in the nucleus [16, 17]. Intriguingly, evidence suggests that these intron-containing circRNAs enable the regulation of gene transcription in cis. Specifically, they can enhance the RNA polymerase II (Pol II) transcription activity of their parental genes, although the underlying mechanism is still not fully understood [16, 17]. CircRNAs are characterized by their noncollinearity, in which a splice donor attacks an upstream acceptor, forming a covalently closed circular structure [1, 2, 4, 12, 18–20]. This characteristic endows them with the ability to escape exonuclease digestion, enabling them to persist longer in the cell than their linear counterparts [3, 21, 22]. This feature in combination with their ubiquity in cancer tissues [23, 24], saliva [25, 26], blood [27–29], and exosomes [30, 31] suggests that circRNAs are promising as biomarkers for diseases. On the other hand, their circular structure also serves as a key element for the detection of circRNAs. Specifically, the backsplicing junction reads within the structure presented in RNA-Seq data facilitate the genome-wide identification of this RNA species, although other mechanisms such as genomic tandem duplication, template switching during PCR amplification, or trans-splicing between precursor mRNAs (pre-mRNAs) can also potentially generate such reads [7, 19] and complicate the detection process. To resolve this issue, Jeck et al. [3] developed a biochemical strategy termed CircleSeq that involves treating samples with an exonuclease that digests linear RNAs but preserves circRNAs (RNase R). However, it has been asserted that RNase R resistance alone cannot be used to determine whether an isoform is circular or not, because some circRNAs were found to be susceptible to this exonuclease [3, 19, 32, 33]. CircRNA expression is reported to be specific to different tissues/cell lines and developmental stages [32–35]. Despite the fact that some circRNAs have been experimentally verified to be abundantly expressed, even more highly than their linear counterparts, the vast majority of them are usually expressed at low levels [3, 32, 36]. This not only constitutes another challenge for their identification, but also raises doubts about their functions, indicating that the majority of them may be inert byproducts of noncanonical pre-mRNA splicing [3, 32]. The advent of high-throughput next-generation sequencing technology has enabled the sequencing of hundreds of millions of short reads, and its single-base-pair resolution provides a precise and efficient way to identify circRNAs. The detection of circRNAs from RNA-Seq data can be achieved using various software packages. There are approximately a total of 11 different tools that have been developed for this purpose. However, despite the development of this range of computational tools, no systematic evaluations of their performance have been performed. Although some attempts have been made to compare several of these packages [7, 37] and some comparisons were included in papers by those who developed these tools [33, 38–42], different conclusions were drawn with regard to their performance, owing to different subsets of tools being compared, different filtering strategies being applied, or diverse datasets being utilized, among others. The fact that some circRNAs are susceptible to exonucleases and most of them are expressed at low levels means that there is an inherent bias in filtering for reliable circRNA candidates based on resistance to RNase R and/or the selection of backsplicing junction reads above a specific abundance threshold [33, 43]. For example, recently, Hansen et al. found that, when focusing on the top 100 most highly expressed candidates detected by one tool alone, a large number (77%–88%) of the candidates predicted by 3 of the 5 tools evaluated would be qualified as artefacts, based on the criteria of RNase R resistance [37]. In this study, we perform a comprehensive evaluation of 11 different circRNA detection tools, with the aim of providing useful guidelines for researchers engaged in this field. These tools have been run and compared on 4 different datasets: (1) positive dataset: a dataset of simulated reads, encompassing a total of 14,689 circRNAs detected in HeLa cells from CircBase [44]; (2) background dataset: a large negative dataset comprised of reads generated from mRNA sequences deposited in the NCBI Reference Sequence (RefSeq) database; (3) mixed dataset, generated by combining the positive and background datasets together; and (4) real datasets. These real datasets were established by downloading 6 runs of rRNA-depleted RNA-Seq data from NCBI Sequence Read Archive (SRA), including 4 runs of RNA-Seq data from the HeLa cell line and 2 runs from an immortalized human fibroblast cell line (Hs68), of which, 2 runs of RNA-Seq data from the HeLa cell line and 1 run from Hs68 were further treated with RNase R enzyme during sample preparation. The performance of the software packages was evaluated based on metrics such as sensitivity, precision, F1 measure, Area

Read the complete text