Category-based Galaxy Image Generation via Diffusion Models

Xingzhong Fan, Hongming Tang, Yue Zeng, M.B.N. Kouwenhoven, Guangquan Zeng · 2025

Read Category-based Galaxy Image Generation via Diffusion Models by Xingzhong Fan, Hongming Tang, Yue Zeng, M.B.N. Kouwenhoven, Guangquan Zeng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-16255.txt.

Introduction

Xingzhong Fan, Hongming Tang, Yue Zeng, M B N Kouwenhoven, and Guangquan Zeng present a diffusion model that generates realistic galaxy images by category, in a 2025 paper. Traditional galaxy making leans on physical simulations full of assumptions and hand-tuned settings. Learning models instead draw their rules from real observations, and diffusion models lead the pack in quality.

Their system, GalCatDiff, feeds both image features and physical traits of galaxies into the network design. A custom block mixes attention with standard filters to keep global shape and fine detail in step. Category codes let one model produce many galaxy types, avoiding a separate model per class. The fake galaxies matched real color and size patterns better than rival methods and looked physically sound. The team sees it as a data booster for future galaxy sorting tools.

Catalog record

CREATORXingzhong Fan, Hongming Tang, Yue Zeng, M.B.N. Kouwenhoven, Guangquan Zeng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-16255

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Category-based Galaxy Image Generation via Diffusion Models Xingzhong Fan, Hongming Tang, Yue Zeng, M.B.N. Kouwenhoven, Guangquan Zeng Abstract Conventional galaxy generation methods rely on semi-analytical models and hydrodynamic simulations, which are highly dependent on physical assumptions and parameter tuning. In contrast, data-driven generative models do not have explicit physical parameters pre-determined, and instead learn them efficiently from observational data, making them alternative solutions to galaxy generation. Among these, diffusion models outperform Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) in quality and diversity. Leveraging physical prior knowledge to these models can further enhance their capabilities. In this work, we present GalCatDiff, the first framework in astronomy to leverage both galaxy image features and astrophysical properties in the network design of diffusion models. GalCatDiff incorporates an enhanced U-Net and a novel block entitled Astro-RAB (Residual Attention Block), which dynamically combines attention mechanisms with convolution operations to ensure global consistency and local feature fidelity. Moreover, GalCatDiff uses category embeddings for class-specific galaxy generation, avoiding the high computational costs of training separate models for each category. Our experimental results demonstrate that GalCatDiff significantly outperforms existing methods in terms of the consistency of sample color and size distributions, and the generated galaxies are both visually realistic and physically consistent. This framework will enhance the reliability of galaxy simulations and can potentially serve as a data augmentor to support future galaxy classification algorithm development. I Introduction Galaxies exhibit a wide range of morphologies ( Hubble 1926 ; Sandage 1961 ; van den Bergh 1976 ; Kormendy & Bender 2012 ; Willett et al. 2013 ; Buta et al. 2015 ; Walmsley et al. 2022 ; Walmsley et al. 2023 , e.g.,) . The morphology of galaxies is closely linked to various physical properties, reflecting the cumulative effects of different physical processes throughout their evolutionary history ( Buta 2013 ; Conselice 2014 ; Cappellari 2016 , e.g.,) . For example, spiral galaxies tend to be bluer, exhibit prominent star formation, and are rotation-dominated; in contrast, elliptical galaxies are generally redder and dominated by velocity dispersion. ( Strateva et al. 2001 ; Baldry et al. 2004 ; Kelvin et al. 2014 ; Zhu et al. 2024 , e.g.,) . Moreover, galaxies with different morphology exhibit distinct environmental distribution preferences (e.g., the so-called morphology-density relation): elliptical galaxies are typically found in denser environments, whereas spiral galaxies tend to reside in relatively isolated regions ( Dressler 1980 ; van der Wel et al. 2010 , e.g.,) . Furthermore, differences in the substructures of galaxies can also influence their evolution. For example, some studies suggest that bar structures can significantly influence the gas distribution within galaxies ( Roberts et al. 1979 ; Regan & Teuben 2004 ; Cole et al. 2014 ; Sormani et al. 2015 ; Li et al. 2022 , e.g.,) and the activity of galactic nuclei ( Shlosman et al. 1989 ; Ho et al. 1997 ; Lee et al. 2012 , e.g.,) . It has also been shown that disk galaxies with different bulge components, such as classical bulges or pseudobulges, exhibit significant differences in their disk properties, implying a co-evolution between the bulge and the whole galaxy ( Hu et al. 2024a ; Hu et al. 2024b , e.g.,) . Numerous studies have shown that the morphology of a galaxy can serve as a powerful tool to understand its formation and evolution ( El-Badry et al. 2018 ; Martin et al. 2018 ; Jackson et al. 2020 ; Zeng et al. 2021 ; Zeng et al. 2024 , e.g.,) . Various galaxy generation methods are required to evaluate the consistency between theoretical predictions and observational data. Moreover, a detailed and well-performed galaxy morphology simulation on a large galaxy sample can further benefit the cosmic shear calibration for weak lensing analysis in the era of Euclid ( Euclid Collaboration et al. 2022 ; Euclid Collaboration et al. 2023 ; Euclid Collaboration et al. 2024 , e.g.,) . For example, semi-analytical models can qualitatively reproduce some statistical properties of galaxy morphologies ( Guo et al. 2011 ; Zoldan et al. 2018 , e.g.,) , but they usually rely on oversimplified physical assumptions, such as exclusively linking the formation of bulges and elliptical galaxies to mergers ( Kauffmann et al. 1993 ; Cole et al. 2000 ; Somerville et al. 2001 ; Somerville et al. 2008 ; Croton et al. 2006 ; Gonzalez-Perez et al. 2014 , e.g.,) . Similarly, many recent hydrodynamic simulations have also succeeded in qualitatively reproducing some statistical trends related to galaxy morphology ( Correa et al. 2017 ; Tacchella et al. 2019 ; Bignone et al. 2020 ; Pfeffer et al. 2023 , e.g.,) . Moreover, by employing post-processing techniques such as radiative transfer modeling, it is possible to generate realistic mock galaxy images that closely resemble the actual observations ( Trayford et al. 2017 ; Rodriguez-Gomez et al. 2019 ; Baes et al. 2024 , e.g.,) . However, these hydrodynamic simulations heavily depend on many plausible sub-grid physics models, require meticulous parameter tuning, and are often sensitive to parameter space coverage ( Vogelsberger et al. 2020 ; Crain & van de Voort 2023 , e.g.,) . It is therefore unsurprising that these methods cannot easily fill in such a simulation-to-realism gap and often introduce systematic biases ( Ravanbakhsh et al. 2017 ; Lanusse et al. 2021 ; Smith et al. 2022 , e.g.,) . Deep generative models, however, can directly learn the underlying statistical features from large observational datasets without relying on explicit physical parameter settings ( Kingma 2013 ; Goodfellow et al. 2014 ; Ho et al. 2020 , e.g.,) . Such data-driven approaches accurately capture data features and leverage the capabilities of neural networks and parallel computing to achieve rapid generation ( Ramos & Baso 2019 ; Holdship et al. 2021 ; Lanusse et al. 2021 ; Smith et al. 2022 , e.g.,) , effectively addressing the limitations of conventional methods. In recent years, deep generative models based on Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have already been applied to galaxy generation tasks ( Ravanbakhsh et al. 2017 ; Fussell & Moews 2019 ; Smith & Geach 2019 ; Lanusse et al. 2021 ; Holzschuh et al. 2022 ) . As a representative in VAE-based algorithm, Ravanbakhsh et al. 2017 explores the application of both VAE and GAN-based methods, including the use of Conditional VAE ( Kingma et al. 2014 ; Sohn et al. 2015 , C-VAE;) . They used half-light radius, magnitude, and redshift as conditional inputs for model training, while finding the model has generated images with blurriness issue. Compared with VAEs, GAN-based models are found to be able to generate more realistic galaxy mock images ( Holzschuh et al. 2022 ) . The limitation of GAN-based models, on the other hand, is that images generated via GAN-based models are biased toward the training set, making large-size outputs unrepresentative of true cosmological structures. Additionally, training GANs remains challenging, with stable results achieved only when limited to three photometric bands ( Smith & Geach 2019 , e.g.,) . In summary, VAEs struggle to produce high-quality images ( Van Den Oord et al. 2017 ; Vahdat & Kautz 2020 , e.g.,) , while GANs often suffer from training

Read the complete text