A Probabilistic Autoencoder for Galaxy SED Reconstruction and Redshift Estimation: Application to Mock SPHEREx Spectrophotometry matplotlib ( 31 ) , numpy ( 29 ) , JAX ( 8 ) , BlackJAX ( 11 ) , FlowJAX ( 62 ) , equinox ( 36 )

Richard M. Feder, Liam Parker, Uroš Seljak · 2026

Read A Probabilistic Autoencoder for Galaxy SED Reconstruction and Redshift Estimation: Application to Mock SPHEREx Spectrophotometry matplotlib ( 31 ) , numpy ( 29 ) , JAX ( 8 ) , BlackJAX ( 11 ) , FlowJAX ( 62 ) , equinox ( 36 ) by Richard M. Feder, Liam Parker, Uroš Seljak (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24668.txt.

Introduction

Feder and co-authors present a probabilistic autoencoder for galaxy spectral energy distributions and redshift estimation. The method is tested on synthetic SPHEREx spectrophotometry. The autoencoder learns a compact latent form for rest-frame galaxy spectra, mapped to a Gaussian density by a normalising flow. An explicit forward model then allows joint Bayesian inference over spectrum parameters and redshift. In controlled tests, it beats template fitting on source recovery, outlier rate, and posterior calibration. A cut on relative uncertainties flags most template-fitting outliers while keeping nearly all good sources.

Catalog record

CREATORRichard M. Feder, Liam Parker, Uroš Seljak
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76297
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24668

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Probabilistic Autoencoder for Galaxy SED Reconstruction and Redshift Estimation: Application to Mock SPHEREx Spectrophotometry matplotlib ( 31 ) , numpy ( 29 ) , JAX ( 8 ) , BlackJAX ( 11 ) , FlowJAX ( 62 ) , equinox ( 36 ) Richard M. Feder, Liam Parker, Uroš Seljak Abstract We present a probabilistic autoencoder (PAE) framework for galaxy spectral energy distribution (SED) modeling and redshift estimation, applied to synthetic SPHEREx 102-band spectrophotometry. Our PAE learns a compact latent representation of rest-frame galaxy SEDs transformed to a simple Gaussian base density using a normalizing flow, combined with an explicit forward model enabling joint Bayesian inference over intrinsic SED parameters and redshift with well-defined priors. In controlled tests on simulated SPHEREx spectra, our PAE improves on template fitting (TF) in source recovery, outlier rate, and posterior calibration, with trade-offs in redshift performance that depend on the assumed priors. A simple cut on the ratio of PAE and TF uncertainties identifies sources that are overwhelmingly TF outliers, which can be used to clean existing TF samples while retaining the vast majority of well-recovered sources. By directly profiling over PAE latent variables, we show these cases correspond to shallow likelihood surfaces where the PAE’s continuous SED manifold produces broader likelihoods that more faithfully reflect the lack of constraining power in the data, whereas the TF discrete model grid yields artificially confident but incorrect redshift estimates. Lastly, we present an alternative, simulation-based inference approach using a Transformer encoder and conditional normalizing flow, which provides similar redshift performance to the PAE but with ∼ 200 × \sim 200\times faster inference throughput. Our implementation, PAESpec , is publicly available and provides a foundation for principled redshift estimation in modern photometric surveys. I Introduction Modern galaxy surveys are delivering unprecedented volumes of multi-wavelength photometry and low-resolution spectroscopy, enabling novel studies of galaxy evolution and large-scale structure (LSS). SPHEREx, NASA’s most recent MIDEX mission, began survey operations in May 2025 and is conducting an all-sky near-infrared spectral survey spanning 0.75-5 \mu m, with several hundred million spectra with spectral resolving power R\equiv\lambda/\Delta\lambda=35-125 ( 6 ) . This spectrophotometric dataset occupies an intermediate regime between broad-band photometry and spectroscopy – while the majority of SPHEREx galaxies will not have secure emission-line based redshifts (in contrast to existing spectroscopic surveys), the dense spectral sampling contains rich color and spectral energy distribution (SED) shape information that broad-band photometric redshifts only partially access. The immense science opportunities in cosmology and astrophysics afforded by SPHEREx and other multi-wavelength datasets, e.g., from Gaia ( 24 ) , Rubin ( 32 ) , Euclid ( 19 ) , etc., place a premium on methods that can effectively model SEDs, produce well-calibrated photometric redshift (“photo-z”) uncertainties and scale well to large samples ( 61 ) . All photo-z methods balance trade-offs between accuracy, flexibility, robustness, and interpretability. Template fitting (denoted TF throughout) approaches, which fit a library of SEDs (or combinations of SEDs) to observed photometry using a well-defined forward model ( 3 ; 60 ; 9 ) , have become a workhorse for modern surveys given their computational efficiency and simplicity. However, TF methods that use purely model-based and/or mis-calibrated template sets may struggle to reproduce the full variability of galaxy SEDs captured by increasingly rich datasets. Furthermore, the profile likelihood approach used by many TF codes for p(z) estimation (e.g., profiling over template index, dust law/strength, amplitude) can produce biased or overconfident redshift estimates when nuisance parameters are correlated with redshift or poorly constrained, which becomes more common in low signal-to-noise ratio (SNR) measurements. Alternatively, data-driven photo-z methods using decision trees/random forests ( 12 ; 33 ) , nearest-neighbor approaches ( 25 ; 17 ) , self-organizing maps ( 57 ) , dictionary learning ( 10 ; 23 ) , flow-based density estimation ( 14 ) , and simulation-based inference ( 13 ; 28 , SBI;) have found application across a variety of datasets. These methods learn flexible mappings from observables to physical parameters in a manner that is often informed by high-quality training data. While powerful, they often lack a robust probabilistic framework, with implicit priors that depend strongly on the variance and representativeness of the training set. Hybrid approaches using Gaussian processes ( 42 ) have made progress in addressing gaps between TF and data-driven methods, though challenges remain. We refer the reader to 52 for a more detailed review of photo-z methods, and to 64 for a recent comparison of photo-z methods using early Rubin imaging data. In this work, we use the probabilistic autoencoder (PAE), first introduced in 7 , as the basis for a framework to model galaxy spectra and perform robust redshift estimation. Unlike variational autoencoders, which assume a Gaussian prior over the encoded latent distribution, our PAE decouples the density prior from the autoencoder training, allowing the model to first prioritize data reconstruction. After this, the latent variable distribution is transformed to a simpler base distribution in a second training stage using normalizing flows. PAEs have been successfully demonstrated as a competitive framework for modeling multi-band supernovae time series in 58 . The application to photo-z estimation builds on the fact that galaxy spectra can be described to good approximation by a small number of latent parameters ( 50 ) . Similar to the Spender model ( 46 ) , we use the PAE to define a rest-frame SED model, after which we rely on physically-informed forward modeling to reconstruct the data ( 41 ) . Our method can be viewed as a generalization of template fitting, in which the discrete set of templates is replaced with a learned continuous SED manifold and explicitly controllable priors. Through controlled comparisons, we seek to understand differences between TF and PAE redshift estimates, along with their complementarity. The paper is structured as follows. We first introduce the PAE model as a forward modeling tool for Bayesian inference in § II . After describing the synthetic dataset of galaxy spectra we use to generate SPHEREx spectrophotometry in § III , we describe our implementation PAESpec and describe its computational performance in § IV . We evaluate the performance of our PAE on SED reconstruction in § V and redshift estimation in § VI , using TF as a baseline for close comparison. In § VII we compare our results with an alternative SBI approach, which offers amortized posteriors conditioned on noisy, observed photometry. We conclude in § VIII and discuss potential extensions of our framework for cross-survey photo-z estimation and hierarchical inference. II Probabilistic Autoencoder We train a probabilistic autoencoder (PAE) on synthetic, rest-frame galaxy spectra to learn a low-dimensional latent representation of spectral energy distributions (SEDs), independent of observational effects. We then combine this rest-frame SED model with explicit redshifting and filter convolution operations to predict observed photometry. While models such as Spender and its extension to quasars, SpenderQ ( 27 ) , have leveraged physically informed latent space models, they are focused on higher-resolution spectroscopy where redshifts are already known to high precision. Our approach is designed to enable joint inference of the galaxy’s redshift and intrinsic SED. We outline the structure of the PAE schematically in Fig. 1 . Figure 1: Schematic describing the training (left)

Read the complete text