Minuet : A Diffusion Autoencoder for Compact Semantic Compression of Multi-Band Galaxy Images
Alexander T. Gagliano, Yunyi Shen, V. A. Villar · 2025
Read Minuet : A Diffusion Autoencoder for Compact Semantic Compression of Multi-Band Galaxy Images by Alexander T. Gagliano, Yunyi Shen, V. A. Villar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-04145.txt.
Introduction
The Rubin Observatory will soon image nearly twenty billion galaxies, far more than astronomers can inspect one by one. Alexander T. Gagliano, Yunyi Shen, and V. A. Villar present Minuet in a 2025 preprint, a diffusion autoencoder compressing a multi-band galaxy image into just five numbers. Those latent values are meant to be interpretable where ordinary embeddings are not.
Minuet trains on six million galaxy cutouts from a legacy survey. It learns to rebuild each image from its five-number summary with a conditional diffusion model. Classifiers on the latent features recover Galaxy Zoo morphology labels. A companion model turns the features into estimates of redshift, stellar mass, and star formation rate, with uncertainties. Nearest-neighbour searches in the tiny latent space also work well. Galaxy images, the authors conclude, have low intrinsic complexity.
Catalog record
| CREATOR | Alexander T. Gagliano, Yunyi Shen, V. A. Villar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-04145
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Minuet : A Diffusion Autoencoder for Compact Semantic Compression of Multi-Band Galaxy Images Alexander T. Gagliano, Yunyi Shen, V. A. Villar Abstract The Vera C. Rubin Observatory is slated to observe nearly 20 billion galaxies during its decade-long Legacy Survey of Space and Time. The rich imaging data it collects will be an invaluable resource for probing galaxy evolution across cosmic time, characterizing the host galaxies of transient phenomena, and identifying novel populations of anomalous systems. While machine learning models have shown promise for extracting galaxy features from multi-band astronomical imaging, the large dimensionality of the learned latent space presents a challenge for mechanistic interpretability studies. In this work, we present Minuet , a low-dimensional diffusion autoencoder for multi-band galaxy imaging. Minuet is trained to reconstruct 72x72-pixel g r z grz image cutouts of 6M galaxies within z < 1 z<1 from the Dark Energy Camera Legacy Survey using only five latent dimensions. By using a diffusion model conditioned on the transformer-based autoencoder’s output for image reconstruction, we achieve semantically-meaningful latent representations of galaxy images while still allowing for high-fidelity, probabilistic reconstructions. We train a series of binary classifiers on Minuet ’s latent features to quantify their connection to morphological labels from Galaxy Zoo, and a conditional flow to produce posterior distributions of SED-derived redshifts, stellar masses, and star-formation rates. We further show the value of Minuet for nearest neighbor searches in the learned latent space. Minuet provides strong evidence for the low intrinsic dimensionality of galaxy imaging, and introduces a class of astrophysical models that produce highly compact representations for diverse science goals. I Introduction The chemical and dynamical histories of galaxies sit at the nexus of diverse astrophysical domains. Optical observations of galaxies have been critical for probing dust formation [ 6 ] , quenching [ 37 ] , and baryonic feedback across cosmic time [ 3 , 22 ] . A galaxy’s star-formation history also strongly impacts the nature of the transient phenomena that it can host [ 18 , 17 , 20 , 45 ] , and host-galaxy correlations have been used to constrain the progenitor systems of core-collapse SNe [ 44 , 21 ] and peculiar SNe Ia [ 34 ] . Galaxy clusters have also been used to place constraints on cosmological parameters [ 1 ] . The broad-band imaging data obtained by wide-field surveys such as the Sloan Digital Sky Survey [ 46 ] and Pan-STARRS [ 10 ] , have been an essential contribution to diverse galaxy studies. Population-level studies of these datasets have consistently uncovered unexpected populations that upended existing evolutionary theory (e.g., “little red dots” uncovered by JWST , 33 ; and ‘‘green peas’’ and ‘‘red spirals’’ identified by citizen scientists through Galaxy Zoo 1 1 1 https://www.zooniverse.org/projects/zookeeper/galaxy-zoo/ ; 7 , 32 ). Galaxy imaging has also provided a rich test bed for developing and adapting machine learning architectures for astrophysics. There exists a well-established history of convolutional neural networks trained to classify galaxies morphologically [ 9 ] . Techniques for photometric redshift estimation, initially trained on extracted photometry [ 8 , 51 , 11 ] , have begun to focus instead on multi-band imaging of a target [ 14 ] . Deep learning models have been more recently used to synthesize realistic multi-band galaxy images [ 16 ] , deblend sources [ 25 ] , and learn an empirical mapping between survey-specific datasets [ 42 ] . In parallel to these domain-specific approaches, there has been sustained interest in the machine learning community in exploring model architectures and training objectives that can extract semantically-meaningful, generalizable features from raw imaging data. This philosophy has been inspired by the successes of foundation models in computer vision and natural language processing [ 4 ] . A suite of large astronomical models trained using self-supervised objectives, with one or more input modalities, have shown promising initial results in this direction [ 35 , 57 , 2 , 15 , 41 , 58 , 60 ] . Though the scale of astronomical models continues to increase, the resulting high-dimensional latent spaces often obscure physical interpretation, making it difficult to connect learned features to astrophysically meaningful quantities such as stellar mass, metallicity, or morphology. Unconstrained latent spaces may also encode spurious data features [ 52 ] that degrade performance when applied to data with distributional shifts, especially when trained on observational data subject to complex selection biases and poorly characterized systematics. In the case of reconstruction-based objectives, models encode pixel-level information, which is highly redundant [ 38 ] and does not contain significant semantic content (in contrast with natural language; 24 ). In this work, we present Minuet , a model trained to extract a highly compact set of generalizable features from multi-band galaxy imaging. Our model is trained to compress grz images into five latent dimensions using a self-supervised objective. The architecture of Minuet is inspired by 39 and employs a transformer encoder and a conditional probabilistic diffusion decoder. The resulting model is able to simultaneously extract semantically-meaningful features without supervised training and still achieve accurate galaxy reconstructions. Our paper is structured as follows. In § II , we describe the datasets used to train the model. In § III , we expand on Minuet ’s architecture and our training setup. We investigate correlations between the learned latent space and both user-labeled morphological and SED-inferred physical properties of galaxies in our validation set, and train a series of lightweight models to infer these properties from the encoded features. We conclude by discussing the potential uses of the model and directions for future work in § V . All code used to train and validate Minuet , as well as an interactive visualization of the learned latent space, can be found at the Github repository for this work 2 2 2 https://github.com/alexandergagliano/Minuet . II Data We select galaxies from the Dark Energy Camera Legacy Survey [ 13 , DECaLS;] . DECaLS reaches a 5 \sigma depth of g\approx 24 , making it a sufficient analog for upcoming Rubin data ( g\approx 24.5 ) 3 3 3 https://www.lsst.org/scientists/keynumbers . To obtain homogeneous imaging data for each galaxy, we retrieve grz -band images from the catalog constructed by 50 4 4 4 https://github.com/georgestein/ssl-legacysurvey . We also impose an upper limit on the redshift and the apparent magnitude of each source, to ensure that each galaxy is sufficiently resolved. We consider only galaxies with an apparent z -band magnitude of z<20 , and within z<1.0 . This redshift range is well-matched to the redshift range of expected SNe in LSST. The resulting sample has a maximum r -band magnitude of r\approx 23.0 . Next, we cross-match the remaining sample to the catalog of physical properties constructed by 59 . This catalog reports the 50th percentile and the inter-quartile range of the posteriors for redshift, stellar mass, and star-formation rate of each galaxy obtained with the spectral-energy-distribution (SED)-fitting codes CIGALE [ 5 ] . Our complete cross-matched sample contains 6,050,000 galaxies. We split the dataset into fractions of 60/20/20 for train/test/validation sets, respectively. We visualize the distribution of redshifts and stellar mass between the train and test sets after cross-matching in Figure 1 . Figure 1: Distribution