Self-supervised Synthetic Pretraining for Inference of Stellar Mass Embedded in Dense Gas

Keiya Hirashima, Shingo Nozaki, Naoto Harada · 2025

Read Self-supervised Synthetic Pretraining for Inference of Stellar Mass Embedded in Dense Gas by Keiya Hirashima, Shingo Nozaki, Naoto Harada (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24159.txt.

Introduction

Keiya Hirashima and two co-authors tackle a hard measurement in astronomy: the mass of young stars still buried in dense gas. Mass sets how a star lives and evolves, but clouds hide young stars and make simple motion based estimates unreliable. Supervised learning could help, yet it needs large labeled sets from costly high resolution simulations.

The team pretrains a vision transformer on one million synthetic fractal images with a self supervised method, then freezes it and applies it to a small set of detailed simulations. This transfer lets the model read complex gas structure and infer the stellar mass inside. The approach cuts the need for expensive labeled simulation data.

Catalog record

CREATORKeiya Hirashima, Shingo Nozaki, Naoto Harada
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24159

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Self-supervised Synthetic Pretraining for Inference of Stellar Mass Embedded in Dense Gas Keiya Hirashima, Shingo Nozaki, Naoto Harada Abstract Stellar mass is a fundamental quantity that determines the properties and evolution of stars. However, estimating stellar masses in star-forming regions is challenging because young stars are obscured by dense gas and the regions are highly inhomogeneous, making spherical dynamical estimates unreliable. Supervised machine learning could link such complex structures to stellar mass, but it requires large, high-quality labeled datasets from high-resolution magneto-hydrodynamical (MHD) simulations, which are computationally expensive. We address this by pretraining a vision transformer on one million synthetic fractal images using the self-supervised framework DINOv2, and then applying the frozen model to limited high-resolution MHD simulations. Our results demonstrate that synthetic pretraining improves frozen-feature regression stellar mass predictions, with the pretrained model performing slightly better than a supervised model trained on the same limited simulations. Principal component analysis of the extracted features further reveals semantically meaningful structures, suggesting that the model enables unsupervised segmentation of star-forming regions without the need for labeled data or fine-tuning. \workshoptitle Machine Learning and the Physical Sciences 1 Introduction Stellar mass is a fundamental stellar property that governs luminosity, lifetime, stellar evolutionary tracks, and stellar nucleosynthesis, which produce the chemical elements essential for the origin of our solar system and life. In astronomy, the Initial Mass Function (IMF) describes the stellar mass distribution [ 1 ] . Observations suggest that the IMF exhibits a remarkably similar shape across diverse environments, while the physical mechanisms governing this distribution remain unclear [ 2 ] . To uncover the origin of the IMF, it is essential to determine the masses of young, still-forming stars (protostars and pre-main-sequence stars) through observations. However, determining the masses of young stars from direct observations remains highly challenging. They are deeply embedded within their natal molecular clouds, making them invisible with optical light. Furthermore, their luminosity originates primarily from gas accretion rather than stellar radiation, making mass estimates difficult using methods commonly applied to main-sequence stars. Predicting stellar masses from their environments is a challenging task. The gas is highly inhomogeneous, making analytic models unreliable, while capturing the physics requires three-dimensional (3D) simulations, which are too expensive to produce in large numbers [ 3 ] . A promising approach is to combine high-resolution simulations with deep learning. In our work, three-dimensional (3D) magneto-hydrodynamical (MHD) simulations are employed to capture the physics of star formation and track stellar mass growth [ 4 ] . We then leverage two-dimensional (2D) maps of gas projected from these 3D high-resolution MHD simulations to develop deep learning models for predicting stellar masses. Since large amounts of high-resolution simulations or observational data with labels are rarely available, we propose a framework that combines self-supervised pretraining and downstream tasks. Models are trained on numerous synthetic images to learn robust visual representations, while limited high-resolution MHD simulations are reserved for zero-shot and frozen-feature evaluation on downstream tasks. 2 Related work Self-supervised Learning for Astrophysics Self-supervised learning has become a powerful approach for extracting image representations without labels and could help mitigate challenges from limited labeled data. Early methods like MoCoV3 [ 5 ] and MAE [ 6 ] improved vision transformer (ViT) pretraining but often required supervised fine-tuning. In contrast, DINOv2 [ 7 , 8 , 9 ] captures semantic structures by enforcing consistency across multiple views, transfers to downstream tasks without fine-tuning backbones, and requires only lightweight classifiers or k -nearest neighbor evaluation. In astrophysics, self-supervised learning has enabled galaxy classification with sparse labels [ 10 , 11 ] , inference of galaxy properties by combining simulations and observations [ 12 ] , and mitigation of observational biases through metadata [ 13 ] , with DINOv2 recently applied to galaxy images [ 14 ] . Pretraining with Synthetic Data Supervised deep learning has achieved remarkable success by training models on large labeled datasets. An alternative line of research investigates the use of synthetic data generated with mathematical equations to achieve competitive performance across various downstream tasks. Such data can be produced inexpensively and in large quantities, without demanding experiments, observations, or extensive computational resources, and without raising ethical or privacy concerns. A pioneering study [ 15 ] showed that supervised pretraining on fractal images alone can reach competitive accuracy on natural images, in some cases even surpassing models pretrained on ImageNet-22k [ 16 ] . This approach has since been extended to supervised learning with ViTs [ 17 , 16 , 18 , 19 ] and to self-supervised learning with convolutional neural networks [ 20 , 21 ] . 3 Methodology Figure 1 : Overview of our model. Left : self-supervised pretraining with synthetic fractal images using DINOv2 to extract feature vectors. Right : zero-shot evaluation on simulation with the frozen encoder, applied to stellar mass prediction ( k -NN) and semantic segmentation (PCA-based colors). 3.1 Data Generation Synthetic Images for Pretraining We extend the Flame algorithm [ 22 ] to generate our datasets of fractal images. With randomly sampled parameters \theta_{i}=(a_{i},b_{i},c_{i},d_{i},e_{i},f_{i}) for rotation and shifting fed to a translation w , coordinates are sampled through an iterated function system (IFS) [ 23 ] , w(\bm{x};\theta_{i})=\begin{pmatrix}a_{i}&b_{i}\\ c_{i}&d_{i}\end{pmatrix}\bm{x}+\begin{pmatrix}e_{i}\\ f_{i}\end{pmatrix}, (1) where \bm{x} is a coordinate. At each sampling step, one of the non-linear variations (e.g., spherical and bubble) of the original Flame algorithm [ 22 ] is probabilistically applied, yielding the next sampled point \bm{x}_{i+1}=w(\bm{x}_{i};\theta_{i}) . Those sampled points are interpolated to 336\times 336 images. We draw candidate frames with one million points, accept only those that cover \geq 80\% of the image plane, and thus build a dataset of 1M images. Examples are shown in Fig. 1 (1). The dataset generation was executed with a throughput of 2.67 TFLOPS per image and 2.67 EFLOPS in total. Simulations of star-forming regions We performed 3D MHD simulations with SFUMATO , an adaptive mesh refinement code [ 24 , 25 , 26 , 4 ] , in a cubic box of 4 parsec 1 1 1 1 parsec \sim 3.08\times 10^{13} km \sim 3.26 light years per side containing 3000 M ⊙ 2 2 2 1 M ⊙ (solar mass) is equal to the mass of the Sun. of gas with an initial uniform proton density of 1365~\mathrm{cm^{-3}} and a magnetic field of 10\,\mu\mathrm{G} along the z -axis. To follow the long-term evolution, we use the sink particle method [ 25 ] , in which unstable dense clumps are replaced by sink particles that accrete gas within a fixed radius ( 5.0\times 10^{-4} pc). The accreted mass is taken as the protostellar mass, allowing us to trace protostellar growth. The finest spatial resolution is \Delta x\sim 3\times 10^{-3} parsec, sufficient to resolve the Jeans length with more than five cells, given an initial velocity field with a Mach number of 10. Our dataset consists of 32k snapshots of 0.5 pc regions centered on protostars, from which we construct 64\times 64 maps of column density, mean line-of-sight velocity, and its velocity dispersion along the x , y , and z axes, each paired with the elapsed time since protostar formation and the stellar mass shown in Fig. 1 (2). The simulation was executed with a throughput of 2540 TFLOPS per snapshot and

Read the complete text