De novo peptide sequencing rescoring and FDR estimation with Winnow

Amandla Mabona InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected], Jemma Daniel InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected] Henrik Servais Janssen Knudsen Department of Biotechnology and BiomedicineTechnical University of DenmarkKgs. Lyngby, 2100, Den · 2025

Read De novo peptide sequencing rescoring and FDR estimation with Winnow by Amandla Mabona InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected], Jemma Daniel InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected] Henrik Servais Janssen Knudsen Department of Biotechnology and BiomedicineTechnical University of DenmarkKgs. Lyngby, 2100, Den (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24952.txt.

Introduction

Amandla Mabona and colleagues introduced a scoring fix for protein fragment identification in 2025. Mass spectrometry tools can read peptide sequences directly, without a reference database, which opens up less-charted parts of the proteome. The catch is trust: each tool reports its own confidence score, the scores are often poorly calibrated, and there is no principled way to estimate the false discovery rate.

Their framework, Winnow, works with any sequencing model. A small neural network converts raw scores into calibrated confidences using features of each match, then estimates error rates for single matches and for the whole experiment without decoy data. Both instant and dataset-tuned calibration are supported.

Catalog record

CREATORAmandla Mabona InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected], Jemma Daniel InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected] Henrik Servais Janssen Knudsen Department of Biotechnology and BiomedicineTechnical University of DenmarkKgs. Lyngby, 2100, Den
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-24952

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

De novo peptide sequencing rescoring and FDR estimation with Winnow Amandla Mabona InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected], Jemma Daniel InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected] Henrik Servais Janssen Knudsen Department of Biotechnology and BiomedicineTechnical University of DenmarkKgs. Lyngby, 2100, Denmark [email protected] Rachel Catzel InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected] Kevin Michael Eloff InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected] Erwin M. Schoof Department of Biotechnology and BiomedicineTechnical University of DenmarkKgs. Lyngby, 2100, Denmark [email protected] Nicolas Lopez Carranza InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected] Timothy P. Jenkins Department of Biotechnology and BiomedicineTechnical University of DenmarkKgs. Lyngby, 2100, Denmark [email protected], Jeroen Van Goey InstaDeep Ltd5 Merchant SquareLondon, W2 1AY, UK [email protected], Konstantinos Kalogeropoulos Department of Biotechnology and BiomedicineTechnical University of DenmarkKgs. Lyngby, 2100, Denmark [email protected] Abstract Machine learning has markedly advanced de novo peptide sequencing (DNS) for mass spectrometry-based proteomics. DNS tools offer a reliable way to identify peptides without relying on reference databases, extending proteomic analysis and unlocking applications into less-charted regions of the proteome. However, they still face a key limitation. DNS tools lack principled methods for estimating false discovery rates (FDR) and instead rely on model-specific confidence scores that are often miscalibrated. This limits trust in results, hinders cross-model comparisons and reduces validation success. Here we present Winnow, a model-agnostic framework for estimating FDR from calibrated DNS outputs. Winnow maps raw model scores to calibrated confidences using a neural network trained on peptide-spectrum match (PSM)-derived features. From these calibrated scores, Winnow computes PSM–specific error metrics and an experiment-wide FDR estimate using a novel decoy-free FDR estimator. It supports both zero-shot and dataset-specific calibration, enabling flexible application via direct inference, fine-tuning, or training a custom model. We demonstrate that, when applied to InstaNovo predictions, Winnow’s calibrator improves recall at fixed FDR thresholds, and its FDR estimator tracks true error rates when benchmarked against reference proteomes and database search. Winnow ensures accurate FDR control across datasets, helping unlock the full potential of DNS. * These authors contributed equally to this study. + To whom correspondence should be addressed. Keywords de novo peptide sequencing \cdot false discovery estimation \cdot peptide filtering 1 Introduction Bottom-up proteomics has transformed biological research, enabling large-scale proteome analysis through peptide mass spectrum (PSM) identification aebersold_mass-spectrometric_2016 . There are two main approaches to PSM identification: database search and de novo sequencing (DNS). Once candidate peptides are assigned, false discovery rate estimation (FDR) is used to retain reliable identifications. Database search involves matching experimental spectra to theoretical spectra derived from candidate peptides, then using decoy sequences to estimate FDR sadygov_large-scale_2004 ; elias_target-decoy_2010 ; chick_mass-tolerant_2015 . While effective, this framework faces growing challenges as experimental scale and proteome complexity increase. As databases expand to include multiple proteomes and diverse post-translational modifications (PTMs), FDR inflation becomes a significant concern, as the enlarged search space increases random matches and artificially elevates false discovery estimates. savitski_scalable_2015 ; freestone_re-investigating_2023 . At the same time, FDR is frequently underestimated, resulting in overly optimistic thresholds wen_assessment_2025 . Consequently, decoy-free approaches (DFAs) have been proposed to address these issues by modelling correct and incorrect matches as separate distributions and using mixture models to estimate error rates keller_empirical_2002 ; gonnelli_decoy-free_2015 ; peng_algorithm_2024 ; peng_new_2020 ; madej_modeling_2023 ; huang_development_2020 . Despite their promise, widespread DFA adoption has been hindered by implementation complexity, lack of integration into standard proteomics software platforms, and resource demands. Furthermore, the distributional assumptions underpinning many of these approaches can degrade the fit of the mixture models across diverse datasets. DFAs can be used in DNS, which cannot benefit from target-decoy approaches, yet DFAs also tend to be overly conservative. These methods often assume that low-scoring PSMs are predominantly false positives. However, in DNS workflows score distributions can be less well separated, containing substantial numbers of mid- and low-scoring true positives. When these true positives are misclassified as false matches, the resulting FDR is overestimated. DNS provides an alternative to database search by inferring peptide sequences directly from tandem mass spectra, without relying on reference proteomes ma_peaks_2003 ; frank_pepnovo_2005 . This approach is especially valuable for characterising peptides from poorly annotated species, novel protein variants or previously unobserved PTMs. In such settings, database searches may be infeasible or results thereof incomplete. Hybrid approaches that combine DNS with partial database search offer a promising compromise by capturing both known and novel peptides muth_evaluating_2018 ; muth_potential_2018 . However, since many DNS predictions still lack reference sequences, these methods inherit DNS’s central weakness: the absence of well-established scoring and FDR estimation strategies. More broadly, proteomics researchers rely on statistical measures like q-values and posterior error probabilities (PEPs), quantities that allow clearer interpretation and control of error rates kall_posterior_2008 . Such measures remain largely absent in DNS methods, limiting their adoption. Recent progress in DNS has been driven by machine learning, particularly transformer-based models qiao_computationally_2021 ; mao_mitigating_2023 ; yilmaz_sequence–sequence_2024 ; zhao_transformer-based_2025 ; zhang_-primenovo_2025 ; lee_bidirectional_2024 ; yang_introducing_2024 ; eloff_instanovo_2025 . These models can predict peptide sequences and PTMs from spectra with high recall and generate real-valued confidence scores based on token probabilities. While such scores are useful for ranking predictions, they are often poorly calibrated tran_novoboard_2024 ; qiu2025universalbiologicalsequencereranking . This disconnect between model confidence and the true probability that a prediction is correct undermines their use in FDR estimation; we cannot trust these scores as accurate confidence levels. Furthermore, lack of calibration makes it challenging to compare or integrate predictions across different models. In previous work eloff_instanovo_2025 , we used FDR estimates grounded in database search results to identify a confidence score threshold for DNS outputs. However, this approach depends on the availability of a database and cannot be applied to novel spectra lacking reference matches. Moreover, when applied to the unlabelled spectra, the shift from the labelled to unlabelled domain often leads to overly optimistic FDR estimates. In this study, we propose Winnow, a general-purpose rescoring, calibration and FDR estimation framework for peptide identification. Winnow transforms confidence scores into well-calibrated error probabilities using a supervised calibration model. Our approach incorporates experimental spectrum features and DNS model inference output to improve prediction reliability and provide familiar metrics in proteomics data. Crucially, Winnow enables lightweight and statistically rigorous FDR estimation without relying on distributional assumptions or reference databases–a valuable addition to deep learning-based DNS workflows. Furthermore, our reformulation of FDR using a discriminative decomposition represents, to our knowledge, an entirely novel contribution to the proteomics field. Winnow corrects miscalibrated confidence scores, improves recall and maintains accurate FDR control. In doing so, Winnow addresses a key limitation in existing DNS workflows, offering an accurate, trustworthy and model-agnostic method for FDR control that improves generalisation across diverse proteomic landscapes. 2 Results 2.1 Modelling FDR with Winnow We set out to create a generally applicable, database- and decoy-free method for estimating FDR in deep learning-based DNS. Existing DNS models output amino acid probabilities at each sequence position, which can be aggregated into an overall sequence score, using the dot product or mean probability across positions eloff_instanovo_2025 ; yilmaz_sequence–sequence_2024 . Though model-specific, these scores can be interpreted as confidence estimates for a given PSM. Prior decoy-free FDR estimation methods have relied on fitting separate score distributions for correct and incorrect identifications, which requires both a

Read the complete text