Finding rare classes in large datasets: the case of polluted white dwarfs from Gaia XP spectra
Xander Byrne, 1 Amy Bonsor, 1 Laura K. Rogers, 2,1 Mariona Badenas-Agusti 1 1 Institute of Astronomy, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK 2 NOIRLab, 950 N Cherry Ave, Tucson, AZ, 85719, USA · 2025
Read Finding rare classes in large datasets: the case of polluted white dwarfs from Gaia XP spectra by Xander Byrne, 1 Amy Bonsor, 1 Laura K. Rogers, 2,1 Mariona Badenas-Agusti 1 1 Institute of Astronomy, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK 2 NOIRLab, 950 N Cherry Ave, Tucson, AZ, 85719, USA (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24487.txt.
Introduction
Some white dwarfs are polluted with rocky debris, and their spectra betray the makeup of destroyed exoplanets. Xander Byrne and 3 co-authors hunt these rare stars in low-resolution spectra for about a hundred thousand white dwarf candidates from the Gaia mission. A small subset shows the broad calcium absorption that marks pollution.
The team compares recent supervised and unsupervised hunting methods and applies a neighbor-embedding method to the data for the first time. That method isolated over half again as many high-confidence candidates as its closest rival, including dozens no other method found. Supervised methods still win where labels exist. The study doubles as a case study in finding rare classes in sparsely labeled data.
Catalog record
| CREATOR | Xander Byrne, 1 Amy Bonsor, 1 Laura K. Rogers, 2,1 Mariona Badenas-Agusti 1 1 Institute of Astronomy, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK 2 NOIRLab, 950 N Cherry Ave, Tucson, AZ, 85719, USA |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-24487
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Finding rare classes in large datasets: the case of polluted white dwarfs from Gaia XP spectra Xander Byrne, 1 Amy Bonsor, 1 Laura K. Rogers, 2,1 Mariona Badenas-Agusti 1 1 Institute of Astronomy, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK 2 NOIRLab, 950 N Cherry Ave, Tucson, AZ, 85719, USA Abstract The Gaia mission’s third data release recorded low-resolution spectra for about 100 000 100\,000 white dwarf candidates. A small subset of these spectra show evidence of characteristic broad Ca ii absorption features, implying the accretion of rocky material by so-called polluted white dwarfs – important probes of the composition of exoplanetary material. Several supervised and unsupervised data-intensive methods have recently been applied to identify polluted white dwarfs from the Gaia spectra. We present a comparison of these methods, along with the first application of t t -distributed stochastic neighbour embedding ( t t SNE) to this dataset. We find that t t SNE outperforms the similar technique Uniform Manifold Approximation and Projection (UMAP), isolating over 50% more high-confidence polluted candidates, including 39 new candidates which are not selected by any other method investigated and which have not been observed at higher resolution. Supervised methods benefit greatly from data labels provided by earlier works, selecting many known polluted white dwarfs which are missed by unsupervised methods. Our work provides a useful case study in the selection of members of rare classes from a large, sporadically labelled dataset, with applications across astronomy. \pagerange Finding rare classes in large datasets: the case of polluted white dwarfs from Gaia XP spectra – Finding rare classes in large datasets: the case of polluted white dwarfs from Gaia XP spectra keywords Data Methods – White Dwarfs 1 Introduction White dwarfs (WDs) are remnant stellar cores, the final form of all main-sequence (MS) stars with zero-age masses below 9 – 12\mathrm{M}_{\sun} ( Althaus et al. 2010 ; Althaus et al. 2021 ; Lauffer et al. 2018 ) . WDs constitute a highly uniform population, and are therefore ideal astrophysical laboratories with which to probe a wide range of astrophysical phenomena, including the bulk composition of exoplanetary material. The presence of metal ‘pollution’ in the spectra of WDs reveals the composition of rocky bodies in the system. Following a star’s post-MS evolution, exoplanetary bodies can be scattered onto star-grazing orbits ( Debes & Sigurdsson 2002 ; Bonsor et al. 2011 ; Frewen & Hansen 2014 ; Mustill et al. 2018 ; Maldonado et al. 2020a ; Maldonado et al. 2020b ) , tidally disrupted ( Jura 2003 ; Veras et al. 2014 ) , and then accreted onto the WD ( Brouwers et al. 2022 ) . This has been shown to be the dominant mechanism behind the appearance of metal features in the spectra of so-called polluted WDs ( Farihi et al. 2010 ; Veras 2016 , e.g.,) . By fitting WD atmosphere models to the polluted WD spectra ( Koester et al. 2005 ; Koester et al. 2011 ; Dufour et al. 2007 ; Hollands et al. 2017 ; Hollands et al. 2018 ; Blouin et al. 2018 ; Badenas-Agusti et al. 2024 , e.g.) , one can post-mortem constrain the bulk composition, and thus geology, of the accreted parent body ( Xu & Bonsor 2021 , e.g.) . The Gaia mission ( Gaia Collaboration et al. 2016 ) has revolutionized the study of WDs. The mission’s second data release (DR2) identified over 262\,000 high-confidence WD candidates, an increase by almost an order of magnitude on the then-state-of-the-art ( Gentile Fusillo et al. 2019 ; Gaia Collaboration et al. 2018 ) . This increased further to over 359\,000 thanks to the improved astrometry and photometry of Gaia ’s Early Data Release 3 ( Gentile Fusillo et al. 2021 ; Gaia Collaboration et al. 2023 , EDR3;) . In addition to astrometric and photometric measurements, the full Gaia DR3 also provides low-resolution ( R\sim 70 ) spectra for 219 million sources ( Carrasco et al. 2021 ; Gaia Collaboration et al. 2023 ) , including \approx 100\,000 WD candidates ( Gentile Fusillo et al. 2021 ) . These spectra – called ‘BP/RP spectra’; collectively ‘XP spectra’ – are stored not as fluxes in a sequence of wavelength bins, but as a pair of 55-coefficient Hermite polynomials. They can therefore be represented by a 110-dimensional coefficient vector \mathbf{x}\in\mathbb{R}^{110} . The Hermite polynomials approximating the spectrum can be reconstructed using the GaiaXPy Python package 1 1 1 https://gaia-dpci.github.io/GaiaXPy-website/ . While an XP spectrum is not sufficient to classify a WD as polluted or not (let alone fit elemental abundances) they indicate which WDs from this large dataset to observe with targeted spectroscopic campaigns at higher resolution. The high surface gravities of WDs ( \sim 10^{8}\,\text{g cm}^{-2} ) cause significant collisional broadening, allowing metal pollution to be detected in even low-resolution spectra, usually from the strong Ca H and K lines at 3933 and 3968~\text{\AA} . Several techniques have recently been applied to the large Gaia XP sample to identify polluted WD candidates: • Uniform manifold approximation and projection (UMAP; McInnes et al. 2018 ) . UMAP is an example of a dimensionality reduction technique, wherein a dataset of high-dimensional points is projected into a two-dimensional map, while approximately preserving the original structure of the dataset. In the case of UMAP, this is achieved by finding a 2D submanifold of the high-dimensional data space that is as close as possible to the data points. Kao et al. 2024 apply UMAP to a sample of 96~134 XP spectra, identifying a distinct group of 465 WDs of which 90 were known a priori to be polluted. The remaining 375 are subject to an ongoing high-resolution spectroscopic campaign; they report that 99 per cent of those observed at the time of publication showed multiple metal lines. • Self-organizing maps (SOMs; Kohonen 1982 ) . SOMs employ neural networks to fit a flexible grid of neurons to the data, ‘assigning’ each data point to a particular neuron together with similar data points. This partitions the dataset, such that within each subset the data are similar to each other. Pérez-Couto et al. 2024 use a sequence of two SOMs: one to remove contaminants such as quasars and galaxies, and another to partition the dataset into spectral classes. They find two populations of 249 and 218 polluted WD candidates, the latter of which was not identified by UMAP. • Gradient tree boosting ( Friedman 2001 ) . Gradient tree boosting trains a sequence of decision trees to regress the error on the prediction from the tree before it. Vincent et al. 2024 apply gradient tree boosting to classify 101 783 WD candidates into one of six primary WD spectral types: DA (characterised by hydrogen features in the spectrum), DB (neutral helium features), DC (no features), DO (ionized helium), DQ (carbon), and DZ (metals) 2 2 2 This classification scheme was first outlined in Sion et al. 1983 ; the ‘D’ stands for ‘degenerate’. . They classify 1~272 WDs as DZs. • Random forests ( Breiman 2001 ) . A random forest consists of a large ensemble of decision trees, which are trained to classify data. García-Zamora et al. 2025 apply this method to