WATSON-Net: Vetting, Validation, and Analysis of Transits from Space Observations with Neural Networks

Martín Dévora-Pajares, F. J. Pozuelos, J.C. Suárez, M. González-Penedo, C. Dafonte · 2025

Read WATSON-Net: Vetting, Validation, and Analysis of Transits from Space Observations with Neural Networks by Martín Dévora-Pajares, F. J. Pozuelos, J.C. Suárez, M. González-Penedo, C. Dafonte (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08768.txt.

Introduction

M. Dévora-Pajares and four co-authors built WATSON-Net, a neural network that vets candidate exoplanet transits from space telescopes. As detections pile up, humans cannot inspect every signal, and automated tools must judge the same diagnostic plots that experts traditionally read by eye.

Trained on the full Kepler dataset with ten-fold cross-validation, the system produces ten calibrated models that share one standardized input pipeline. On Kepler targets it ranks second among compared tools, just behind ExoMiner, on a strict recall-at-precision measure. On TESS signals it is the best classifier that was not fine-tuned for that mission, with precision near ninety-three percent. The open-source package plugs into the SHERLOCK vetting pipeline and is designed to extend to future missions.

Catalog record

CREATORMartín Dévora-Pajares, F. J. Pozuelos, J.C. Suárez, M. González-Penedo, C. Dafonte
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE107 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08768

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

WATSON-Net: Vetting, Validation, and Analysis of Transits from Space Observations with Neural Networks Martín Dévora-Pajares, F. J. Pozuelos, J.C. Suárez, M. González-Penedo, C. Dafonte Abstract Context. As the number of detected transiting exoplanet candidates continues to grow, the need for robust and scalable automated tools to prioritize or validate them has become increasingly critical. Among the most promising solutions, deep learning models offer the ability to interpret complex diagnostic metrics traditionally used in the vetting process. Aims. In this work, we present WATSON-Net, a new open-source neural network classifier and data preparation package designed to compete with current state-of-the-art tools for vetting and validation of transiting exoplanet signals from space-based missions. Methods. Trained on Kepler Q1–Q17 DR25 data using 10-fold cross-validation, WATSON-Net produces ten independent models, each evaluated on dedicated validation and test sets. The ten models are calibrated and prepared to be extensible for TESS data by standardizing the input pipeline, allowing for performance assessment across different space missions. Results. For Kepler targets, WATSON-Net achieves a recall-at-precision of 0.99 ([email protected]) of 0.903, ranking second, with only the ExoMiner network performing better ([email protected] = 0.936). For TESS signals, WATSON-Net emerges as the best-performing non-fine-tuned machine learning classifier, achieving a precision of 0.93 and a recall of 0.76 on a test set comprising confirmed planets and false positives. Both the model and its data preparation tools are publicly available in the dearwatson Python package, fully open-source and integrated into the vetting engine of the SHERLOCK pipeline. 1 Introduction The vetting and analysis of transiting exoplanet candidate signals are essential components of any space-based mission dedicated to exoplanet discovery. As the volume of detected signals continues to grow, robust and automated vetting strategies have become increasingly critical for prioritizing follow-up efforts and ensuring the reliability of derived planet catalogs. The first missions, such as COROT ( 6 ) , released only a few dozen candidates and were primarily conceived as proof-of-concept efforts demonstrating what could be achieved with dedicated projects. Thus, vetting could be handled in manual, step-by-step pipelines. The subsequent mission, Kepler ( 9 ) , was designed to enable the first large-scale statistical studies of exoplanet populations and included numerous automated processes across its multiple data pipelines. These steps would later be centralized by the Science Processing Operations Center ( 24 , SPOC,) prepared for the TESS ( 45 ) mission. After finding a signal using their Transiting Planet Search (TPS) pipeline ( 23 ) , every signal had to comply with several models, thresholds, and metrics computed with different techniques and algorithms, which were filtered one by one. Over time, the Kepler vetting pipeline underwent significant changes, and subsequent Data Releases (DRs) included only those signals that successfully passed the latest set of filters and metrics, excluding those that no longer met the updated criteria. To help categorize signals in a more comprehensible and simplified manner, several tools have been developed over the last decade, including Autovetter ( 38 ) , which utilizes a Random Forest classifier, and Robovetter ( 11 ) , a tool that transforms human decisions into machine resolution through simple decision trees. Other independent projects have emerged within the community, either aiming to prioritize potential exoplanet candidates ( 39 , see, e.g.,) , or focusing on their vetting and validation, as demonstrated by the confirmed planets around Kepler-80 and Kepler-90 in 50 . In recent years, a completely new field has emerged in the data science and processing area with Neural Networks (NN) and their Deep Learning (DL) approaches, where several perceptron layers are connected between the data inputs and outputs, creating the so-called hidden layers with hidden units introduced in 47 . Such approaches have taken over the state of the art of most scientific fields, such as Natural Language Processing ( 14 ; 56 ) , Time Series Analysis ( 30 ; 33 ) , Image Processing/Computer Vision ( 16 ) , and also a wide range of Astrophysics ( 37 ) . One of the first DL screening proposals was AstroNet ( 12 ) , which was followed by several iterations of the same work using convolutional neural networks (CNNs), a DL architecture introduced in 28 . This led to a final version with minor adjustments in 62 . Soon, new approaches emerged, including additional information as the centroids shift data and the stellar parameters, as 1 did with their Exonet NN. The latest and arguably most successful model in this line of development is ExoMiner ( 60 ) , which proposed a multibranch NN architecture and demonstrated superior performance over all previous methods. ExoMiner not only proved to be the most performant model under the same test sets compared to the previously published tools but was also used to release more than 300 new, validated transiting exoplanets from the Kepler Data Release 25 catalog ( 54 , DR25,) . While modern methods based on DL techniques have shown strong potential in validating planetary candidates from space missions, approaching these results cautiously is essential, especially when there is no independent confirmation from follow-up efforts. Additionally, ExoMiner was also enhanced with new training on TESS data, reaching state-of-the-art results for this mission ( 59 , ExoMiner++;) . In this context, here we present WATSON-Net, a DL–based tool designed to perform automated vetting of transiting exoplanet candidates. WATSON-Net adopts a multi-branch NN architecture to classify signals as either True Positives or False Positives, returning a probabilistic score that reflects the likelihood of a planetary origin. To facilitate its practical use in ongoing surveys, WATSON-Net has been integrated into the latest version of the SHERLOCK pipeline, a modular, open-source framework for detecting and analyzing planetary candidates in light curves from space-based missions ( 15 ; 43 ) . While earlier versions of SHERLOCK relied on manual inspection of heuristic diagnostics through a preliminary module named watson , the inclusion of WATSON-Net enables a fully automated and interpretable vetting process, significantly reducing the effort required for signal assessment. We further benchmark WATSON-Net against leading models in the field, including ExoMiner, focusing on their performance with Kepler and TESS data. In particular, we analyze their ability to reproduce confirmed exoplanet populations and discuss the implications for the robustness and reliability of modern DL approaches in the context of space-based transit surveys. 2 Methodology Training, validation, and test set selection and preparation are among the most critical stages of any Machine Learning (ML) model. The choice of data to be used in the entire training process is crucial for obtaining reliable predictions when applied in productive environments with inputs that were never seen during the training steps. Therefore, the training data must, whenever possible, be well-curated by experts from the community on which the model is focused. In addition, it is not only necessary to start with a robust and trustworthy labeled dataset, but also to prepare the data in a clean and numerically stable manner to facilitate the model’s ability to distinguish between scenarios. We decided to rely exclusively on data available through public web services and to provide the data processing as part of the final release to be able to compute the same metrics as those provided for the official Threshold-Crossing Events (TCEs) list (

Read the complete text