A Deep Multimodal Multi–Head Neural Network for Joint Estimation of Stellar Age, Lifetime, and Evolutionary Stage

Jing Rou Puah, Sasa Arsovski · 2025

Read A Deep Multimodal Multi–Head Neural Network for Joint Estimation of Stellar Age, Lifetime, and Evolutionary Stage by Jing Rou Puah, Sasa Arsovski (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-18477.txt.

Introduction

Jing Rou Puah and Sasa Arsovski build a deep network that estimates three things about a star at once: its age, its lifetime, and its stage of evolution. Getting these values right is a long-standing problem in astrophysics. Their model feeds on two kinds of data from a large sky survey, spectra and brightness measures. The model splits its work across specialised parts: a simple network for numbers, and an image-style network joined with a vision transformer for spectra.

Three output heads predict the three targets, with stage sorted into five classes from hot stars to red giants. Labels come from standard stellar evolution tracks. The authors tune the design in three phases, balancing the joint loss. They report a final model that pairs low age error with physically realistic outputs, checked further by a dropout-based uncertainty method.

Catalog record

CREATORJing Rou Puah, Sasa Arsovski
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-18477

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Deep Multimodal Multi–Head Neural Network for Joint Estimation of Stellar Age, Lifetime, and Evolutionary Stage Jing Rou Puah, Sasa Arsovski Abstract The accurate estimation of stellar parameters: stellar age, lifespan, and evolutionary stage remain a fundamental challenge in astrophysics. This paper introduces novel deep learning architecture that combines multimodal spectroscopic and photometric data from the Sloan Digital Sky Survey (SDSS) to estimate stellar parameters. We utilise multimodal data from SDSS Data Release 17, creating a 29-dimensional feature set from quality-filtered, extinction-corrected photometry and applying standardised preprocessing to all spectra. The corresponding training labels are derived from MIST v1.2 isochrones: logarithmic age and lifetime are calculated from atmospheric parameters, while evolutionary stage is binned into five classes (Hot, Medium, Cool, Subgiant, Red Giant) based on the star’s position in the T eff T_{\mathrm{eff}} – log ⁡ ( g ) \log(g) diagram. We conduct multi-phase evaluation of eight different deep learning architectures to assess their performance and generalisation capability. In the Phase I, we explore the relationship between model architectures and data balancing strategies. Phase II focuses on the systematic tuning of architectural complexity (depth and width), while Phase III optimises the composition of the multi-task loss function to achieve the best trade-off between regression and classification performance. Following multi-phase evaluation, the final model architecture was selected, a novel hybrid deep learning architecture for stellar parameter estimation. The architecture comprises two main branches: a Multi-Layer Perceptron (MLP) for numerical stellar data analysis (e.g., temperature) and a Convolutional Neural Network (CNN) combined with a Vision Transformer (ViT) for stellar spectrogram analysis. The output layer includes three output heads: one for stellar age prediction, one for stellar lifetime prediction, and one for stellar evolutionary stage classification. The exploration of architectural complexity and the tuning of multi-task objective weights revealed that the selected final architecture achieved the best balance between mathematical precision (e.g., an Age RMSE of 0.093 in ( log ⁡ ( yrs ) \log(\mathrm{yrs}) ) space) and physical realism. To evaluate robustness, we employed Monte Carlo Dropout and confirmed that the model produces well-calibrated uncertainties that accurately reflect prediction errors. These robust uncertainties enable meaningful astrophysical interpretation and set a new benchmark for multimodal stellar parameter estimation. keywords Deep Learning, Multimodal Learning, Astro-informatics, Stellar Parameters, Multi-Task Learning 1 Introduction The accurate estimation of a star’s fundamental parameters: age, total lifetime, and evolutionary stage is a foundation of modern astrophysics. These parameters form the chronological framework of the universe, enabling research that ranges from reconstructing the formation history of the Milky Way to assessing the habitability of exoplanetary systems ( 17 ) . However, despite their importance, deriving these parameters is extremely difficult. As noted by 19 , stellar age is “the most important single parameter of a star, yet it is one of the most difficult to determine”. The primary challenge lies in parameter degeneracy, where different combinations of intrinsic properties (e.g., age, mass, metallicity) and extrinsic factors (e.g., interstellar dust) produce nearly indistinguishable observational signatures ( 13 ) . This is particularly problematic for the vast population of field stars, which constitute the majority of observable samples but lack the uniform age distribution that characterises star clusters. This degeneracy leads to three critical limitations in current methodologies: 1. Uncertainty from Single-Modality Data: Relying on either photometry or spectroscopy alone is often insufficient to break the degeneracy, leading to significant uncertainties in age and lifetime estimation ( 8 ) . 2. Ambiguity in Stage Classification: Distinguishing between subtle, contiguous evolutionary stages (e.g., late main-sequence vs. early subgiant) requires sophisticated feature extraction that is often treated as a separate problem from age regression. 3. Lack of a Unified Framework: Age, lifetime are inherently linked to its evolutionary stage, yet they are typically addressed as separate tasks, a disjointed approach that fails to leverage their mutual constraints. The advent of large-scale surveys like the Sloan Digital Sky Survey (SDSS) ( 20 ) provides a unique opportunity to address these challenges. By providing co-located, multimodal data — broadband photometry and detailed spectroscopy — for millions of objects, SDSS enables a data-driven approach to simultaneously resolve these parameters. While machine learning methods have proven effective in this domain ( 8 ; 15 ) , this work presents the first systematic comparison of modern, deep multimodal architectures for this specific multi-task problem. We explore the relationship between model architectures, data balancing strategies, and the composition of the multi-task objective function, leading to the selection of a final model based on both mathematical precision and its adherence to physical realism — a critical criterion for scientific applications. The key contributions of this work are as follows: • It presents a systematic, comparative analysis of eight deep learning architectures, providing empirical evidence on the trade-offs between classic (ResNet-based) and modern (Transformer-based) models for this task. • It demonstrates two critical findings: first, that a data-level under sampling strategy can unexpectedly outperform a weighted-loss approach in this domain; and second, that a fundamental trade-off exists between mathematical precision and physical realism in the final multi-task model. • It delivers a rigorously validated, high-fidelity regression model with quantified uncertainty, which achieves a state-of-the-art performance (Age RMSE of 0.093 in \log(\mathrm{yrs}) space) while ensuring all predictions are scientifically valid, providing a reusable framework for future studies. 2 Related Work Our research is positioned at the intersection of three key domains: stellar astrophysics, deep learning for scientific applications, and multimodal, multi-task learning. This section briefly reviews the foundational work in each area to establish the context and identify the specific research gap our study addresses. 2.1 Stellar Parameter Estimation The estimation of stellar age, lifetime, and evolutionary stage has long been a central pursuit in astrophysics. The gold-standard method — isochrone fitting on colour-magnitude diagrams — provides reliable ages for coeval stellar populations in clusters ( 2 ) . However, its application to isolated field stars — which constitute the vast majority of galactic populations — is plagued by significant uncertainties arising from the inherent degeneracy between stellar parameters ( 19 ) . While alternative methods like asteroseismology ( 5 ) and gyrochronology ( 1 ) offer high precision for specific types of stars, they are not universally applicable, leaving a critical need for robust methods that can be applied to the large, heterogeneous datasets produced by modern surveys. 2.2 Deep Learning in Stellar Astrophysics The advent of deep learning has introduced powerful new tools for stellar parameter estimations. Convolutional Neural Networks (CNNs), which excel at extracting localised features ( 14 ) , have been widely applied to one-dimensional stellar spectra ( 22 ) . Architectures based on ResNet, for example, have become a benchmark for spectral analysis ( 11 ) . More recently, the Transformer architecture, with its self-attention mechanism, has shown significant promise in modelling the long-range dependencies within spectra, which is crucial for separating the interdependent influences of multiple physical parameters ( 21 ) . However, most existing studies have applied these architectures either to single-modality data (spectroscopy or photometry alone) or to single-task objectives. A systematic, direct comparison of the trade-offs between classic (ResNet-based) and modern (Transformer-based) approaches within a unified, multimodal framework remains a key research gap. 2.3 Multimodal and Multi-Task Learning Fusing complementary data sources through multimodal

Read the complete text