Learning to detect continuous gravitational waves: an open data-analysis competition
R Tenorio, M J Williams, J Bayley, C Messenger, M Demkin, W Reade, Kaggle Competitors · 2025
Read Learning to detect continuous gravitational waves: an open data-analysis competition by R Tenorio, M J Williams, J Bayley, C Messenger, M Demkin, W Reade, Kaggle Competitors (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06445.txt.
Introduction
A public contest to hear the universe's faintest steady hum is reported in a 2025 paper led by Rodrigo Tenorio with thirty-one co-authors. Continuous gravitational waves from spinning neutron stars remain undetected, and the Kaggle-hosted challenge asked over a thousand participants to find simulated signals hidden in real LIGO data under realistic search conditions.
The top ten approaches are described and judged as preprocessing for standard searches. On the challenge data they cut computing cost by one to three orders of magnitude at equal false-dismissal rates, and several drove new GPU-accelerated pipelines now used elsewhere. The dataset is released as the first open standardized benchmark for continuous-wave detection.
Catalog record
| CREATOR | R Tenorio, M J Williams, J Bayley, C Messenger, M Demkin, W Reade, Kaggle Competitors |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06445
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning to detect continuous gravitational waves: an open data-analysis competition R Tenorio, M J Williams, J Bayley, C Messenger, M Demkin, W Reade, Kaggle Competitors Abstract We report results of a public data-analysis challenge, hosted on the open data-science platform Kaggle, to detect simulated continuous gravitational-wave signals. These are weak signals from rapidly spinning neutron stars that remain undetected despite extensive searches. The competition dataset consisted of a population of CW signals using both simulated and real LIGO detector data matching the conditions of actual CW searches. The competition attracted more than 1,000 participants to develop realistic CW search algorithms. We describe the top 10 approaches and discuss their applicability as a pre-processing step compared to standard CW-search approaches. For the competition’s dataset, we find that top approaches can reduce the computing cost by 1 to 3 orders of magnitude at a 2 % 2\% dismissal probability. Additionally, the competition drove the development of new GPU-accelerated detection pipelines and extended CW-inspired statistics to other domains. We release the associated dataset, which constitutes the first open standardized benchmark for CW detection, to enable reproducible method comparisons and to encourage further developments toward the first detection of these elusive signals. 1 Introduction Continuous gravitational waves (CWs) [ 1 , 2 , 3 , 4 ] are long-duration gravitational-wave (GW) signals expected from rapidly-spinning non-axisymmetric neutron stars (NSs). Although currently undetected, their detection would, shed light on the extreme physics of NSs, allow us to understand their population in our galaxy, or even establish a new probe to direct and indirect detection of dark matter. CW searches can be classified according to their assumptions on the expected source [ 5 ] . Targeted searches, for example, assume the CW emission of a pulsar fully matches its electromagnetic emission; this allows for very sensitive searches at the cost of not being robust to slight mismatches of the signal. On the other end of the spectrum, blind searches attempt to detect a CW signal from unknown sources; due to their parameter-space breadth, these kinds of searches cannot make use of matched-filtering and instead resolve to semicoherent methods to trade sensitivity for computing cost [ 6 ] . Incidentally, these approaches make blind searches more robust to un-modelled physics such as NS glitches [ 7 ] or spin-wandering [ 8 , 9 ] . The current trend in blind CW searches is to explore relatively narrow parameter-space regions to aim for astrophysically plausible CW sources [ 10 , 11 , 12 , 13 ] , or to extend the parameter space towards binary systems [ 14 , 15 , 16 ] , which may emit detectable CW signals more easily due to accretion [ 17 , 18 , 19 ] . The most sensitive of these searches are based on highly-efficient implementations of the semicoherent \mathcal{F} -statistic [ 20 , 21 , 22 ] , such as the Global Correlation Transform ( GCT ) [ 23 ] , Weave [ 24 ] , or BinarySkyHou \mathcal{F} [ 25 ] . These searches require significant computing budgets to be successfully deployed. Alternatively, short-coherence searches [ 26 , 27 , 28 , 29 , 30 ] followed by hierarchical follow-ups [ 31 , 32 , 33 , 34 ] require a much more modest budget, albeit with the corresponding reduction in sensitivity. All in all, the sensitivity of a CW search is primarily limited by the available computing resources [ 6 ] . Machine learning applications [ 35 ] have demonstrated significant accelerations in search [ 36 , 37 , 38 , 39 ] and parameter-estimation [ 40 , 41 , 42 , 43 ] workflows targeting compact binary coalescences compared to standard approaches [ 44 , 45 , 46 ] . Due to the comparatively broader parameter space, applications to blind CW signals have reported limited success [ 47 , 48 , 49 , 50 , 51 ] , with most successful applications focusing on accelerating specific computational steps [ 52 ] or increasing the robustness of a search to unmodelled physics [ 53 , 54 , 55 ] . In this work, we present the results of an open data-analysis competition to spark new approaches and algorithmic developments in CW searches [ 56 ] . This competition delivered a comparison of methods beyond what within-domain mock data challenges are able to prospect [ 57 , 58 , 59 , 60 ] and allowed us to understand the complications and computational advantages achievable by off-the-shelf approaches from beyond the community. We release the dataset of the competition [ 61 ] to provide the first publicly-available benchmark targeted towards the detection of CW searches. We also summarize the results of the first Kaggle competition aimed at detecting GW signals from compact binary coalescences [ 62 ] in A . 2 Leveraging open competitions for gravitational-wave research The development of CW search methods is often constrained by the expertise and computational perspective available within the CW research community. The complexity of detecting a signal in noisy data, however, represents a challenge that may benefit, if properly supervised and tested, from a fresh perspective as provided by the broader data science community. Open data-analysis competitions have demonstrated significant value in advancing scientific research across multiple domains, such as medical imaging [ 63 , 64 , 65 ] , time-series forecasting [ 66 ] , or particle physics [ 67 ] , often producing solutions that outperform existing standards. These successes stem from competitions’ ability to attract diverse problem-solving approaches, encourage rapid iteration, and provide standardized benchmarks for method comparison [ 68 ] . The gravitational-wave community has already embraced crowd-sourcing approaches through platforms, such as Zooniverse [ 69 ] , to understand transient noise in interferometric detectors [ 70 , 71 , 72 ] , or Kaggle [ 73 ] to search for gravitational-wave signals from compact binary coalescences [ 62 ] . This approach can be understood as an evolution of the well-established mock data challenges conducted by the GW community [ 57 , 58 , 59 , 60 ] , where the aim has shifted from comparing existing pipelines to exploring new strategies altogether. The overall experience in GW citizen-science so far suggests non-experts, when given a proper training framework, can deliver solutions beneficial to the GW community [ 74 , 39 , 75 ] . The problem of detecting CW signals presents an ideal case for an open competition: First, the problem can be framed as a well-defined classification task [ 76 , 77 , 78 ] , which provides a simple criterion to rank different strategies against each other. Second, synthetic data can be easily generated, either from first principles or through well-established software packages [ 79 , 80 , 81 ] . Third, since large-scale searches can be understood as the aggregation of many small-scale searches [ 29 ] , competitors can tackle a simulation of the real problem using standard hardware. Finally, despite the existing experience in the field, large portions of the search-pipeline configuration space where novel improvements may be found remain yet to be explored. Building on previous positive results [ 62 ] , we released our competition on Kaggle [ 73