AnnotateMissense: a genome-wide annotation and benchmarking framework for missense pathogenicity prediction

Muhammad Muneeb, David B. Ascher · 2026

Read AnnotateMissense: a genome-wide annotation and benchmarking framework for missense pathogenicity prediction by Muhammad Muneeb, David B. Ascher (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24520.txt.

Introduction

Muhammad Muneeb and David B. Ascher present AnnotateMissense, a 2026 framework that annotates and benchmarks predictions of whether single-letter protein changes cause disease. It merges population, conservation, transcript, and protein-language-model evidence into one genome-wide resource. Benchmarked on 132,714 ClinVar-labeled variants, its full 303-feature XGBoost model reached a mean MCC of 0.9411 with near-perfect ROC-AUC. The final model then scored more than ninety million variants across the human genome.

Catalog record

CREATORMuhammad Muneeb, David B. Ascher
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21376
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24520

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AnnotateMissense: a genome-wide annotation and benchmarking framework for missense pathogenicity prediction Muhammad Muneeb, David B. Ascher Abstract Motivation: Missense variant interpretation remains challenging because pathogenicity depends on heterogeneous evidence, including population frequency, evolutionary conservation, transcript context, amino acid substitution severity, prior pathogenicity predictors and protein-language-model-derived features. Although these resources are individually useful, there remains a need for reproducible workflows that integrate them at genome-wide scale, benchmark their contribution and provide accessible outputs for downstream research. Results: We present AnnotateMissense , a scalable annotation, benchmarking and genome-wide prediction framework for missense variant interpretation. AnnotateMissense integrates chromosome-wise hg38 missense variants derived from dbNSFP v5.1 with ANNOVAR-based gene-, region- and filter-based annotations, dbNSFP transcript and protein descriptors, AlphaMissense scores, ESM-derived features, conservation metrics, population-frequency variables, established pathogenicity predictors and engineered amino acid/codon-context features. Using 132,714 ClinVar-labelled missense variants, we benchmarked machine-learning and deep-learning models under controlled feature configurations. The full 303-feature benchmark set achieved the strongest performance with XGBoost, reaching mean Matthews correlation coefficient (MCC) = 0.9411 and ROC-AUC = 0.9950 across stratified five-fold cross-validation. Restricted naive and location-oriented feature sets achieved substantially lower best MCC values of 0.4989 and 0.5113, respectively. Circularity-controlled ablations showed that removing prior-predictor, population-frequency and clinically overlapping evidence reduced performance, whereas excluding AlphaMissense and ESM-derived features alone had minimal effect. Temporal ClinVar validation on newly observed pathogenic/benign variants achieved MCC = 0.7613, accuracy = 0.8798 and F1-score = 0.8750. The final genome-wide model was applied to 90,643,830 hg38 missense variants to generate AnnotateMissense pathogenicity scores and binary prediction labels. Availability and implementation: Source code, workflow scripts and command files are available at https://github.com/MuhammadMuneeb007/CAGI7_Annotate_All_Missense . Genome-wide prediction outputs and the compressed DuckDB database are available at https://doi.org/10.5281/zenodo.19981867 . Supplementary information: Supplementary data are available online. Muneeb et al. \ast ]Corresponding author: David B. Ascher, Email: [email protected] keywords missense variants, pathogenicity prediction, ClinVar, dbNSFP, AlphaMissense, ESM, XGBoost, variant annotation, genome-wide inference † † journal: Bioinformatics † † appnotes: Application Note † † firstpage: 1 † † address: School of Chemistry and Molecular Biology, The University of Queensland, Queen Street, 4067, \state Queensland, Australia † † address: Computational Biology and Clinical Informatics, Baker Heart and Diabetes Institute, Commercial Road, 3004, \state Victoria, Australia † † corresponding: [ 1 Introduction Missense variants are among the most clinically important classes of protein-altering genetic variation, but their interpretation remains difficult because functional impact depends on multiple and incompletely overlapping evidence layers. A variant may be rare in population databases, affect an evolutionarily conserved residue, alter amino acid physicochemical properties, occur in an important transcript or protein context, or be supported by prior clinical observations. No single evidence source is sufficient across all genes, proteins and disease settings, creating a persistent challenge for rare disease diagnosis, genome interpretation and large-scale variant prioritisation [ 16 , 1 , 17 , 11 , 9 ] . Many computational resources have been developed to prioritise missense variants, including conservation-based predictors, ensemble pathogenicity scores, genome-wide annotation frameworks and recent protein-language-model-derived resources [ 10 , 8 , 7 , 12 , 5 , 15 ] . These methods provide complementary information, but they differ in score directionality, coverage, missingness, output type, training data and genome-build compatibility. This makes large-scale integration and systematic benchmarking difficult, particularly when some predictors may have been trained on ClinVar, HGMD or related clinical variant databases. Here, we present AnnotateMissense , a reproducible framework for genome-wide missense annotation, feature integration, benchmarking, validation and prediction. Starting from 90,643,830 hg38 missense single-nucleotide variants derived from dbNSFP v5.1 through the CAGI7 Annotate-All-Missense challenge, AnnotateMissense integrates ANNOVAR- and dbNSFP-derived annotations, AlphaMissense scores, ESM-derived features, population-frequency variables, conservation scores, established pathogenicity predictors and engineered biological features [ 18 , 13 , 5 , 15 ] . We benchmarked multiple machine-learning and deep-learning models using ClinVar-labelled missense variants, quantified feature-set contributions through controlled ablation analyses, evaluated prospective concordance using temporal ClinVar validation and generated genome-wide pathogenicity scores as a public research resource. AnnotateMissense is intended as a scalable annotation, benchmarking and research-prioritisation framework, not as a standalone clinical classification system. 2 Materials and methods 2.1 Genome-wide annotation and feature integration AnnotateMissense was developed using chromosome-wise hg38 missense variant files derived from dbNSFP v5.1. These files comprised 90,643,830 missense single-nucleotide variants and included genomic, transcript and protein-level descriptors. Chromosome-level variant files were converted into ANNOVAR-compatible input format and annotated using gene-based, region-based and filter-based resources [ 18 , 13 ] . The resulting outputs were merged with dbNSFP-derived transcript and protein context, AlphaMissense scores, ESM-derived missense effect predictions, population-frequency variables, conservation scores, established pathogenicity predictors and engineered amino acid/codon-context features [ 5 , 15 ] . The integrated feature space included raw annotation variables, transformed numeric variables, categorical encodings, consensus-voting features, amino acid physicochemical change features, codon-composition variables, nucleotide substitution descriptors and selected interaction features. Direct ClinVar-derived fields not intended for prediction were excluded to reduce target leakage. Full annotation commands, database categories, feature construction details and retained/excluded feature summaries are provided in Supplementary Material 1, Supplementary Sections 1–3, and Supplementary Material 2, Sheets S1–S2. 2.2 ClinVar benchmark and model evaluation ClinVar-labelled missense variants were extracted from the chromosome-level annotation tables [ 11 ] . Pathogenic and likely pathogenic variants were assigned to the positive class, whereas benign and likely benign variants were assigned to the negative class. Variants annotated as uncertain significance, conflicting, ambiguous or unsupported were excluded from the primary supervised benchmark. The resulting benchmark contained 132,714 missense variants, comprising 76,804 pathogenic/likely pathogenic and 55,910 benign/likely benign variants. Models were evaluated using stratified five-fold cross-validation. Feature preprocessing was fitted within each training fold and applied to the corresponding held-out test fold. XGBoost, Random Forest, FLAML AutoML, TabNet, a PyTorch deep neural network and a TensorFlow deep neural network were benchmarked across controlled feature configurations [ 4 , 3 , 2 ] . Matthews correlation coefficient (MCC) was used as the primary performance metric, with ROC-AUC, accuracy and related classification metrics used as secondary measures [ 14 , 6 ] . Dataset numbering was fixed throughout the manuscript and supplementary material. Dataset 2 refers to the full 303-feature benchmark matrix, Dataset 3 to the 41-feature naive feature set, Dataset 4 to the 56-feature location-oriented feature set, and Datasets 5–8 to circularity-controlled ablation configurations. Dataset 5 excluded prior pathogenicity predictors and population-frequency metrics. Dataset 6 excluded features derived from tools trained on ClinVar, HGMD or overlapping clinical databases. Dataset 7 excluded AlphaMissense and ESM-derived features. Dataset 8 retained only engineered biological sequence-derived features. Full model settings, feature-configuration definitions and benchmark tables are provided in Supplementary Material 1, Supplementary Sections 3–6. 2.3 Temporal validation and biological use cases To assess generalisation beyond the original ClinVar-derived benchmark, temporal validation was performed using variants present in a newer ClinVar release but absent from the older annotation-derived ClinVar set used during model development. Variants were matched by chromosome, position, reference allele and alternate allele. Only strict pathogenic/benign categories were retained for evaluation, and uncertain or ambiguous categories were excluded. AnnotateMissense predictions were evaluated using the final categorical prediction label. Full temporal validation results are provided in Supplementary Material 1, Supplementary Section 10, and Supplementary Material 2, Sheet S4. Biological utility was assessed using two use-case analyses. First, AnnotateMissense scores were evaluated for ClinVar variants of uncertain significance

Read the complete text