Embracing Heteroscedasticity for Probabilistic Time Series Forecasting
Yijun Wang, Qiyuan Zhuang, Xiu-Shen Wei · 2026
Read Embracing Heteroscedasticity for Probabilistic Time Series Forecasting by Yijun Wang, Qiyuan Zhuang, Xiu-Shen Wei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24254.txt.
Introduction
Wang and co-authors model how uncertainty itself changes over time in time series forecasting. Volatility clusters in rough periods, fades in calm ones, and jumps at breaks. Many forecasters treat each step's uncertainty as independent. Their VolDy-VAE carries a volatility state from the look-back window into the forecast. A recurrent scale path keeps predictive variances coherent over time. Noisy points then sway the mean less, while their uncertainty stays explicit. On nine benchmarks, accuracy and calibration beat strong baselines, they report.
Catalog record
| CREATOR | Yijun Wang, Qiyuan Zhuang, Xiu-Shen Wei |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 100612 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24254
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Embracing Heteroscedasticity for Probabilistic Time Series Forecasting Yijun Wang, Qiyuan Zhuang, Xiu-Shen Wei Abstract Probabilistic time series forecasting (PTSF) aims to model the full predictive distribution of future observations, enabling both accurate forecasting and principled uncertainty quantification. A central requirement of PTSF is to embrace heteroscedasticity, as real-world time series exhibit time-varying conditional variances induced by nonstationary dynamics, regime changes, and evolving external conditions. However, most existing non-autoregressive generative approaches to PTSF, such as TimeVAE and K 2 K^{2} VAE, rely on MSE-based training objectives that implicitly impose a homoscedastic assumption, thereby fundamentally limiting their ability to model temporal heteroscedasticity. To address this limitation, we propose the Location-Scale Gaussian VAE (LSG-VAE), a simple but effective framework that explicitly parameterizes both the predictive mean and time-dependent variance through a location-scale likelihood formulation. This design enables LSG-VAE to faithfully capture heteroscedastic aleatoric uncertainty and introduces an adaptive attenuation mechanism that automatically down-weights highly volatile observations during training, leading to improved robustness in trend prediction. Extensive experiments on nine benchmark datasets demonstrate that LSG-VAE consistently outperforms fifteen strong generative baselines while maintaining high computational efficiency suitable for real-time deployment. 1 Introduction In recent years, deep learning has driven a paradigm shift in time series analysis ( 20 ; 16 ) , achieving substantial progress in tasks ranging from imputation ( 3 ; 38 ; 6 ; 40 ; 42 ) to anomaly detection ( 45 ; 39 ; 21 ; 25 ; 44 ) . Among these, Probabilistic Time Series Forecasting (PTSF) stands out as a critical capability for high-stakes decision-making ( 8 ; 7 ) . In energy grids, probabilistic load forecasting is essential for risk-aware dispatch ( 10 ; 41 ; 37 ) ; in quantitative finance and supply chains, accurate uncertainty modeling supports robust risk control under volatility ( 35 ; 18 ; 11 ) . Unlike deterministic forecasters that yield only point estimates, PTSF aims to model the full predictive distribution, allowing for the precise evaluation of confidence intervals and tail risks ( 49 ) . Figure 1 : Homoscedastic vs. Heteroscedastic Forecasting. (a) Standard MSE-based models assume constant variance, leading the mean predictor to fit transient fluctuations. (b) LSG-VAE models time-varying uncertainty, allowing the mean prediction to focus on the underlying trend. Despite the growing interest, capturing the intrinsic heteroscedasticity of real-world time series, characterized by conditional variances that fluctuate dynamically over time, remains a formidable challenge ( 8 ) . For instance, wind power generation exhibits stable patterns during calm weather but undergoes violent fluctuations during storms; similarly, financial markets alternate between periods of tranquility and bursts of extreme volatility during crises. A critical theoretical oversight persists in prevalent non-autoregressive generative forecasting paradigms, such as standard VAEs ( 14 ; 4 ) and K^{2} VAE ( 43 ) : they predominantly rely on the Mean Squared Error (MSE) objective. Mathematically, minimizing MSE imposes a rigid homoscedastic assumption ( \sigma^{2}=\text{const} ) ( 12 ) . This assumption fundamentally mismatches the intrinsic nature of real-world data, which is characterized by dynamic, input-dependent volatility. As illustrated in Figure 1 (a), when confronted with volatile observations, such models lack an explicit mechanism to decouple the underlying trend from aleatoric uncertainty. Consequently, the MSE objective disproportionately penalizes high-variance fluctuations, rendering the mean predictor susceptible to overfitting these stochastic deviations and resulting in degraded generalization. To address these limitations, we advocate a simple but effective philosophy: the difficulty often lies not in modeling increasingly complex latent dynamics, but in the lack of explicit mechanisms to decouple underlying trends from transient volatility. Rather than introducing computationally heavy iterative generative procedures or relying on rigid MSE-based objectives, we ask: Can a lightweight generative model be explicitly empowered to know when to be uncertain? Motivated by this intuition, we propose the Location-Scale Gaussian Variational Autoencoder (LSG-VAE). LSG-VAE bridges the gap between efficiency and probabilistic rigor. It adopts a non-autoregressive formulation to avoid error accumulation, while replacing the MSE surrogate with a principled location-scale likelihood. This formulation naturally induces an adaptive attenuation effect (visualized in Figure 1 (b)). By dynamically estimating a time-dependent variance \sigma_{t} , the model yields confidence intervals with time-varying widths. From an optimization perspective, this corresponds to down-weighting the contribution of high-variance observations ( \propto 1/\sigma_{t}^{2} ) in the loss function. As a result, the scale component captures irreducible stochastic uncertainty, allowing the location component to remain stable and recover the underlying trend without being dominated by outliers. In summary, LSG-VAE provides a streamlined framework for efficient and robust probabilistic forecasting. By employing a global latent dynamics module, the model captures long-term dependencies in a single forward pass, avoiding the recursive pitfalls of autoregressive architectures. Compared to diffusion-based approaches that rely on expensive iterative denoising ( 31 ; 36 ; 47 ) , LSG-VAE achieves substantially faster inference while maintaining competitive predictive uncertainty modeling. The main contributions of this work are as follows: • Unified Non-autoregressive Framework: We propose LSG-VAE, a streamlined framework that integrates a location-scale likelihood into a non-autoregressive architecture. This design not only circumvents the error accumulation of autoregressive models but also introduces an intrinsic adaptive attenuation mechanism, enabling the model to dynamically down-weight high-variance observations and robustly decouple underlying trends from irreducible uncertainty. • Universality of the LSG Paradigm: We validate that our proposed heteroscedastic modeling principle is model-agnostic and transferable. By extending the LSG mechanism to other generative backbones, such as GAN-based (TimeGAN) and Koopman-based ( K^{2} VAE) models, we demonstrate that this simple but effective philosophy consistently enhances probabilistic forecasting performance across diverse architectures. • Strong Performance and Efficiency: Extensive experiments on 9 real-world benchmarks demonstrate that LSG-VAE consistently outperforms a wide range of strong baselines in both predictive accuracy and uncertainty calibration, while achieving significantly lower inference latency. We release our code at https://anonymous.4open.science/r/LSG-VAE . 2 Methodology Figure 2 : Overview of the LSG-VAE Framework. The model segments the input series into patches, encodes them into a probabilistic latent space, evolves the state via efficient global dynamics, and decodes the future using a dual-head mechanism to jointly predict location ( \mu ) and scale ( \sigma ). 2.1 Problem Formulation and Motivation 2.1.1 Probabilistic Forecasting Formulation We consider a multivariate time series forecasting scenario. Let \boldsymbol{\mathcal{X}}=\{\mathbf{x}_{t}\}_{t=1}^{L} denote the historical look-back window of length L , where \mathbf{x}_{t}\in\mathbb{R}^{C} represents the observed values of C variables at time step t . The objective is to model the conditional probability density of the future horizon \boldsymbol{\mathcal{Y}}=\{\mathbf{x}_{t}\}_{t=L+1}^{L+H} of length H : p_{\theta}(\boldsymbol{\mathcal{Y}}|\boldsymbol{\mathcal{X}}). (1) Unlike deterministic approaches that yield a single point estimate \hat{\boldsymbol{\mathcal{Y}}}\approx\mathbb{E}[\boldsymbol{\mathcal{Y}}|\boldsymbol{\mathcal{X}}] (often minimizing L_{2} distance), our goal is to capture the full predictive distribution. This formulation is essential for quantifying the aleatoric uncertainty intrinsic to the data generation process, specifically the time-varying volatility (heteroscedasticity). 2.1.2 The Homoscedastic Trap in Vanilla VAEs The Variational Autoencoder (VAE) ( 14 ) provides a powerful framework for this generative task by introducing a latent variable \mathbf{Z} . However, a critical limitation in prevalent time series VAEs is the implicit assumption of a fixed-variance Gaussian likelihood for the decoder: p_{\theta}(\boldsymbol{\mathcal{X}}|\mathbf{Z})=\mathcal{N}(\boldsymbol{\mathcal{X}};\boldsymbol{\mu}_{\theta}(\mathbf{Z}),\sigma_{const}^{2}\mathbf{I}). (2) Under this assumption, maximizing the Evidence Lower Bound (ELBO) involves maximizing the log-likelihood term, which mathematically degenerates into the MSE objective: \displaystyle\log p_{\theta}(\boldsymbol{\mathcal{X}}|\mathbf{Z}) \displaystyle\propto-\sum_{t}\|\mathbf{x}_{t}-\boldsymbol{\mu}_{t}(\mathbf{Z})\|_{2}^{2}. (3) While computationally convenient, this derivation exposes a