An Imbalanced Dataset with Multiple Feature Representations for Studying Quality Control of Next-Generation Sequencing
Philipp Röchner, Clarissa Krämer, Johannes U Mayer, Franz Rothlauf, Steffen Albrecht, Maximilian Sprang · 2026
Read An Imbalanced Dataset with Multiple Feature Representations for Studying Quality Control of Next-Generation Sequencing by Philipp Röchner, Clarissa Krämer, Johannes U Mayer, Franz Rothlauf, Steffen Albrecht, Maximilian Sprang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04981.txt.
Introduction
Röchner and five colleagues build an imbalanced dataset for studying quality control in next-generation sequencing, a key technique for reading DNA and RNA. Spotting quality problems across varied experimental settings stays hard, and existing repositories offer few quality-related features. Their dataset draws on 37,491 sequencing samples with two types of quality-related feature representations. The first type holds 34 features from quality control tools. The second type holds a variable count from eight to 1,183 features, derived from read counts in problem regions.
Catalog record
| CREATOR | Philipp Röchner, Clarissa Krämer, Johannes U Mayer, Franz Rothlauf, Steffen Albrecht, Maximilian Sprang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41869 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.04981
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Imbalanced Dataset with Multiple Feature Representations for Studying Quality Control of Next-Generation Sequencing Philipp Röchner, Clarissa Krämer, Johannes U Mayer, Franz Rothlauf, Steffen Albrecht, Maximilian Sprang Abstract Next-generation sequencing (NGS) is a key technique for studying the DNA and RNA of organisms. However, identifying quality problems in NGS data across different experimental settings remains challenging. To develop automated quality-control tools, researchers require datasets with features that capture the characteristics of quality problems. Existing NGS repositories, however, offer only a limited number of quality-related features. To address this gap, we propose a dataset derived from 37,491 NGS samples with two types of quality-related feature representations. The first type consists of 34 34 features derived from q uality c ontrol tools ( QC-34 features). The second type has a variable number of features ranging from eight to 1,183 . These features were derived from read counts in problematic genomic regions identified by the ENCODE b lock l ist ( BL features). 1 1 1 Instead of the original term used by 3 , we use the terms blocklist and blocklisted regions. All features describe the same human and mouse samples from five genomic assays, allowing direct comparison of feature representations. The proposed dataset includes a binary quality label, derived from automated quality control and domain experts. Among all samples, 3.2 % 3.2\% are of low quality. Supervised machine learning algorithms accurately predicted quality labels from the features, confirming the relevance of the provided feature representations. The proposed feature representations enable researchers to study how different feature types ( QC-34 vs. BL features) and granularities (varying number of BL features) affect the detection of quality problems. † † footnotetext: Correspondence to: [email protected] . Keywords: Genomics; next-generation sequencing; quality control; bioinformatics; data quality; machine learning; benchmarking; imbalanced data; feature representations; ENCODE 1 Background & Summary Genome sequencing has deepened our understanding of biology. In particular, next-generation sequencing (NGS) methods read DNA and RNA snippets from biological samples in parallel, substantially reducing the time and cost of generating large amounts of biological data [ 33 ] . This allows, for example, clinical researchers to use NGS data to identify biomarkers for diagnosis and monitoring [ 28 ] . NGS experiments of low quality, however, can yield unreliable and difficult-to-reproduce results. Common quality issues include too few reads, insufficient genome coverage, and too many reads that cannot be aligned with the reference genome [ 39 ] . Non-aligned reads can result from sample contamination, such as the presence of DNA or RNA from other sources. To improve the quality of NGS data, several community consortia have developed quality standards for NGS experiments [ 37 , 11 , 8 , 43 , 16 ] . The large volume of data generated by NGS experiments, however, makes manual verification difficult. To automatically assess the quality of NGS data, machine learning approaches can be used [ 2 , 24 ] . Classifiers are, for example, able to automatically detect quality problems in NGS data [ 2 ] . Automated detection of quality problems in NGS data with classifiers typically requires deriving the relationship between quality-related features and quality labels. While research consortia, such as the Encyclopedia of DNA Elements (ENCODE) [ 11 , 26 , 9 ] or Cistrome [ 46 ] , provide quality labels and some quality-related features, they do not provide tabular datasets with pre-computed features suitable for developing machine learning models to detect quality problems. To support research on automated quality control of NGS data, we introduce a dataset derived from NGS experiments with two types of quality-related feature representations: The first type of feature representation consists of 34 features (denoted as QC-34 ), which we derived from quality control and bioinformatics tools, as described by 2 . The second type of feature representation (denoted as BL ) captures the number of reads mapped to quality-related genomic regions included in the ENCODE blocklist [ 3 ] . The ENCODE blocklist defines species-specific sets of quality-related genomic regions. While the QC-34 features include aggregated measures of such reads, the BL features provide detailed information per genomic region. The BL feature representations differ by the number of considered blocklisted regions in a genome, allowing us to control the number of BL features between eight and 1,183 . As the number of considered regions increases, the features provide more information on data quality. Both feature representations are tabular and describe the quality of the same 37,491 human and mouse samples, but capture different aspects of sample quality. Based on automated quality control and manual review by domain experts, 3.2\% of the samples were classified as low quality and labeled as revoked ; the remaining samples were high quality and labeled as released . The dataset could support research in several directions. First, by using different types of feature representations ( QC-34 versus BL ) for the same dataset, researchers can study how the detection of quality problems differs between them. Second, by varying the number BL features, researchers can examine how quality control depends on the number of features. For example, although additional BL features provide more information about quality, they also increase the dimensionality of the feature space. This can make it harder to identify relevant patterns and may cause approaches to suffer from the curse of dimensionality: data become increasingly sparse, and distances between points become increasingly similar in high-dimensional spaces [ 14 ] . 2 Methods Figure 1 : Feature generation (a) Researchers upload their experimental data as FASTQ files to the ENCODE database. (b) The experimental data is automatically reviewed based on quality metrics. If these metrics indicate insufficient quality, ENCODE quality experts manually review the samples and label the reported data as released or revoked . (c) We downloaded 37,491 FASTQ files and their associated metadata from ENCODE, then mapped the reads to the reference genomes using Bowtie 2. (d) The 34 QC-34 features are generated using quality control and bioinformatics tools. (e) For the BL features, we first integrate the quality-related and species-specific blocklisted regions to create a combined human-mouse blocklist. The integration can be done with varying degrees of restriction, based on the alignment ratio r , yielding n blocklisted regions. The feature values for the BL- n features are the number of reads in each of the n blocklisted regions. 2.1 NGS and Quality Control Terminology 2.1.1 Assay Types NGS methods, called functional genomics assays, provide insights into gene function and regulation. Commonly used methods are RNA sequencing (RNA-Seq) [ 42 ] , Chromatin Immunoprecipitation sequencing (ChIP-Seq) [ 29 ] , DNase sequencing (DNase-Seq) [ 35 ] , and enhanced CrossLinking and ImmunoPrecipitation followed by high-throughput sequencing (eCLIP) [ 41 ] . RNA-Seq captures gene expression, ChIP-Seq identifies where specific proteins interact with DNA, and DNase-seq detects open chromatin regions, which are parts of the chromatin accessible to cellular processes, in contrast to tightly packed (compact and structured) DNA. The eCLIP assay measures protein binding to RNA in the cell [ 41 ] . 2.1.2 File Formats FASTQ FASTQ files are the standard format for storing high-throughput sequencing data. Each read is represented by four lines: a sequence identifier, the sequence fragments from a sample’s DNA or RNA, a