A Decomposable Forward Process in Diffusion Models for Time-Series Forecasting

Francisco Caldas, Sahil Kumar, Cláudia Soares · 2026

Read A Decomposable Forward Process in Diffusion Models for Time-Series Forecasting by Francisco Caldas, Sahil Kumar, Cláudia Soares (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21812.txt.

Introduction

Francisco Caldas, Sahil Kumar, and Cláudia Soares bring diffusion models to forecasting time series. Diffusion methods generate data by gradually adding noise and learning to remove it. For time series, the authors argue, the noise-adding step itself should respect the structure of the signal.

Their 2026 preprint introduces a forward diffusion process that splits a signal into its spectral components, its mix of fast and slow waves. That split preserves structured patterns such as seasonality better than standard diffusion does. The method is model-agnostic, meaning it can wrap around existing forecasting networks rather than replacing them. Better handling of seasons and cycles could improve forecasts in energy, finance, and weather-driven planning.

Catalog record

CREATORFrancisco Caldas, Sahil Kumar, Cláudia Soares
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21812

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Decomposable Forward Process in Diffusion Models for Time-Series Forecasting Francisco Caldas, Sahil Kumar, Cláudia Soares Abstract We introduce a model-agnostic forward diffusion process for time-series forecasting that decomposes signals into spectral components, preserving structured temporal patterns such as seasonality more effectively than standard diffusion. Unlike prior work that modifies the network architecture or diffuses directly in the frequency domain, our proposed method alters only the diffusion process itself, making it compatible with existing diffusion backbones (e.g., DiffWave, TimeGrad, CSDI). By staging noise injection according to component energy, it maintains high signal-to-noise ratios for dominant frequencies throughout the diffusion trajectory, thereby improving the recoverability of long-term patterns. This strategy enables the model to maintain the signal structure for a longer period in the forward process, leading to improved forecast quality. Across standard forecasting benchmarks, we show that applying spectral decomposition strategies, such as the Fourier or Wavelet transform, consistently improves upon diffusion models using the baseline forward process, with negligible computational overhead. The code for this paper is available at https://anonymous.4open.science/r/D-FDP-4A29 . 1 Introduction Time-series forecasting plays a critical role in a wide range of real-world applications ( Lim & Zohren 2021 ) , from weather prediction ( Choi et al. 2023 ) to financial market analysis ( Makridakis et al. 2024 ) . Classical statistical methods ( Box et al. 2016 ) and autoregressive linear models ( Hyndman & Athanasopoulos 2021 ) remain widely used due to their interpretability and competitive predictive performance. However, these approaches often struggle with capturing long-range dependencies ( Zhou et al. 2021 ) , hierarchical seasonal structures ( Hewamalage et al. 2021 ) , and non-linear dynamics ( Rangapuram et al. 2018 ) . Diffusion models ( Sohl-Dickstein et al. 2015 ) , which learn a Markov chain of progressively denoised latent representations, have demonstrated state-of-the-art performance in image generation ( Ho et al. 2020 ; Dhariwal & Nichol 2021 ) and inpainting ( Lugmayr et al. 2022 ) . More recently, they have been applied to time-series forecasting ( Kong et al. 2021 ; Tashiro et al. 2021 ) , showing competitive results against other generative models. While some works have incorporated multi-resolution processing ( Shen et al. 2024 ; Gu et al. 2023a ; Fan et al. 2024 ) , these models do not fully exploit the inherent structure of time-series data in their diffusion processes. A well-established technique in time-series modeling is decomposition into three main components: trend, seasonal effects, and residual noise ( Hyndman & Athanasopoulos 2021 ; Cleveland et al. 1990 ; Yi et al. 2023 ) . However, existing diffusion models lack mechanisms to preserve these structured components, often leading to inaccurate long-term predictions. For instance, in electricity demand forecasting, standard diffusion-based models tend to smooth out periodic consumption cycles, failing to accurately capture sub-daily patterns. This loss of structured information diminishes the model’s forecasting ability, especially in applications that require precise seasonality preservation. To address this limitation, we introduce a novel approach that integrates structured time-series decomposition into the forward diffusion process. Specifically, we employ spectral decomposition to isolate and process seasonal components and remainders separately. After identifying the different components, our proposed diffusion process performs diffusion sequentially and in ascending order of amplitude, guaranteeing that the more relevant components are kept longer in the forward diffusion process and reconstructed earlier. Our method modifies the sample generation of the training process, and equivalently the sample inference process, which means that it can be used with any known deep learning architecture for time-series model. This approach is particularly suited for long time-series, where stronger seasonal patterns are common and can be more effectively captured through seasonal decomposition during both training and inference, in the conditional window. Furthermore, we evaluate this framework using different types of spectral decomposition and show that it is generalizable to any additive decomposition method. We demonstrate its efficacy using both Fourier and wavelet transforms, and show consistent improvements over diffusion-based forecasting models that employ the conventional forward process. Contributions. Existing diffusion-based time series models (e.g., DiffWave ( Kong et al. 2021 ) , TimeGrad ( Rasul et al. 2021 ) , MG-TSD ( Fan et al. 2024 ) , mrDiff ( Shen et al. 2024 ) , Diffusion-TS ( Yuan & Qiao 2024 ) ) focus primarily on adapting architectural components, such as attention or S4 layers ( Gu et al. 2022 ) , or developing hierarchical models, but retain the standard forward process that injects noise indiscriminately, erasing structured temporal features such as seasonality and trend. In contrast, we redesign the forward process itself to explicitly preserve these features, yielding more faithful reconstructions and adapted to long-horizon forecasting when structure-aware extrapolation is required. Unlike previous works, our approach is model agnostic and can be applied to any diffusion model architecture. Our contributions are threefold: (1) we propose a novel structured forward diffusion process leveraging spectral decomposition for time-series forecasting; (2) we theoretically generalize this framework to accommodate various additive decomposition methods; and (3) we empirically validate our spectral decomposition approach on multiple benchmark datasets, demonstrating its effectiveness in capturing long-range dependencies and seasonal patterns. Figure 1 : Diffusion process with decomposition. During the forward process, noise is added to each component in ascending order of amplitude. This process slows down the destruction of the more relevant frequencies, preserving key structures longer. 2 Related Work i. Diffusion Models Diffusion probabilistic models ( Sohl-Dickstein et al. 2015 ; Song et al. 2021 ) have gained significant popularity since their introduction, demonstrating remarkable success in image generation ( Ho et al. 2020 ; Ho et al. 2022a ) and text-to-speech synthesis ( Shen et al. ) . They have also been extended to video ( Ho et al. 2022b ) , audio ( Chen et al. 2020 ) , and other applications ( Luo & Hu 2021 ) . Song et al. 2021 unified two perspectives on these models—discrete and continuous formulations—under the umbrella of score-based generative models. In this work, we adopt the discrete formulation, equivalent to the variance-preserving stochastic differential equation (VP-SDE) ( Ho et al. 2020 ) , in a non-autoregressive setting. ii. Latent and Multi-scale Diffusion Recent advancements have improved diffusion models in terms of scalability and efficiency. Techniques such as inference cost reduction ( Song et al. 2021 ) , and others ( Song & Ermon 2020 ; Bortoli et al. 2021 ; Watson et al. 2021 ) have enhanced their applicability. Additionally, Nichol & Dhariwal 2021 introduced variance prediction in the reverse diffusion process, enabling competitive performance with fewer sampling steps. For high-resolution image generation, latent diffusion models ( Ramesh et al. 2022 ) compress data into a lower-dimensional space before applying the diffusion process. A different approach applies diffusion in the spectral domain ( Phillips et al. 2022 ; Crabbé et al. 2024 ) . Other hierarchical models refine outputs by generating a low-resolution image first, followed by super-resolution techniques ( Gu et al. 2023a ; Ho et al. 2022a ) . However, these improvements remain largely focused on spatial data, and their direct applicability to time-series forecasting remains limited due to differences in structural dependencies. iii. Temporal Representation Recent research has focused on improving temporal representations in Transformer-based

Read the complete text