TIMED: Adversarial and Autoregressive Refinement of Diffusion-Based Time Series Generation

MohammadReza EskandariNasab 1, Shah Muhammad Hamdi, Soukaina Filali Boubrahimi · 2025

Read TIMED: Adversarial and Autoregressive Refinement of Diffusion-Based Time Series Generation by MohammadReza EskandariNasab 1, Shah Muhammad Hamdi, Soukaina Filali Boubrahimi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19638.txt.

Introduction

Fake time series can stand in for real data when records are scarce, private, or costly. MohammadReza EskandariNasab, Shah Muhammad Hamdi, and Soukaina Filali Boubrahimi build TIMED, a generator that blends three engines. A diffusion model learns the global shape of the data. A supervisor network learns step-by-step dependence by predicting each next value. A critic in the Wasserstein style grades realism and pushes for smooth, faithful series.

An extra loss term aligns the real and fake data in feature space, guarding both variety and quality. Making series is harder than making static rows, since order itself carries meaning. The authors aim the tool at forecasting and anomaly detection. Trustworthy synthetic series could let teams train and test models without exposing sensitive records.

Catalog record

CREATORMohammadReza EskandariNasab 1, Shah Muhammad Hamdi, Soukaina Filali Boubrahimi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-19638

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TIMED: Adversarial and Autoregressive Refinement of Diffusion-Based Time Series Generation MohammadReza EskandariNasab 1, Shah Muhammad Hamdi, Soukaina Filali Boubrahimi Abstract Generating high-quality synthetic time series is a fundamental yet challenging task across domains such as forecasting and anomaly detection, where real data can be scarce, noisy, or costly to collect. Unlike static data generation, synthesizing time series requires modeling both the marginal distribution of observations and the conditional temporal dependencies that govern sequential dynamics. We propose TIMED , a unified generative framework that integrates a denoising diffusion probabilistic model (DDPM) to capture global structure via a forward–reverse diffusion process, a supervisor network trained with teacher forcing to learn autoregressive dependencies through next-step prediction, and a Wasserstein critic that provides adversarial feedback to ensure temporal smoothness and fidelity. To further align the real and synthetic distributions in feature space, TIMED incorporates a Maximum Mean Discrepancy (MMD) loss, promoting both diversity and sample quality. All components are built using masked attention architectures optimized for sequence modeling and are trained jointly to effectively capture both unconditional and conditional aspects of time series data. Experimental results across diverse multivariate time series benchmarks demonstrate that TIMED generates more realistic and temporally coherent sequences than state-of-the-art generative models. I Introduction The generation of realistic synthetic time series is a fundamental yet understudied problem in machine learning, especially in domains where data collection is limited by privacy constraints, acquisition costs, or irregular sampling [ 1 ] . These constraints are acute in heliophysics, where multivariate magnetic-field time series are scarce and imbalanced; even with multifaceted preprocessing, including augmentation and contrastive learning [ 2 ] , performance remains data-limited, motivating synthetic time series augmentation [ 3 ] . Unlike static modalities such as images \mathbf{x}\in\mathbb{R}^{H\times W\times C} , where H , W , and C denote height, width, and number of channels, or text sequences \mathbf{x}=(w_{1},\dots,w_{n}) , where w_{i} is the i th token, time series are represented as multivariate sequences \mathbf{x}_{1:T}=(x_{1},\dots,x_{T})\in\mathbb{R}^{T\times F} , where T is the sequence length and F is the number of features. These sequences exhibit complex temporal dependencies, with each x_{t} potentially depending on its entire history \mathbf{x}_{1:t-1} [ 4 ] . These sequences often have variable lengths and follow non-stationary statistics, demanding models capable of learning both intricate temporal dynamics and feature-level distributions. Similar challenges have been investigated in neuroscience, where EEG-based approaches leverage temporal dynamics for tasks such as auditory attention detection [ 5 ] and schizophrenia diagnosis [ 6 ] , underscoring the importance of models that capture both short- and long-range dependencies in sequential data. Therefore, a principled generative framework must simultaneously capture the marginal data distribution and the conditional sequential structure. These dual objectives introduce significant modeling challenges, often requiring careful trade-offs between sample realism, temporal coherence, and distributional diversity [ 7 ] . Formally, given a multivariate sequence \mathbf{x}_{1:T} , the generative objective is to approximate the true data-generating distribution p(\mathbf{x}_{1:T}) with a learned model \hat{p}(\mathbf{x}_{1:T}) . In practical settings, this distribution exhibits intricate structure, characterized by both temporal dependencies and correlations among feature dimensions. Classical sequence models, such as autoregressive and sequence-to-sequence architectures, typically factorize the joint distribution as \prod_{t=1}^{T}p(x_{t}\mid\mathbf{x}_{1:t-1}) , enabling effective modeling of causal dynamics. While such models excel in forecasting tasks, they face limitations in generative settings, including exposure bias from teacher forcing [ 8 ] , error accumulation during autoregressive sampling, and low sample diversity due to deterministic decoding. These limitations are especially important in applications that require coherent long-horizon dynamics for model-based reasoning, for example equation-editable physics simulations [ 9 ] . Recent progress in deep generative models (DGMs) has enabled more holistic approaches to approximating complex data distributions. Prominent DGM families such as Generative Adversarial Networks (GANs) [ 10 ] , Variational Autoencoders (VAEs) [ 11 ] , and normalizing flows [ 12 ] aim to learn a mapping from latent variables \mathbf{z}\sim p(\mathbf{z}) to observed data \mathbf{x}\sim p(\mathbf{x}) , but were originally designed for static data and require architectural adaptations to model sequential inputs \mathbf{x}_{1:T} . Denoising Diffusion Probabilistic Models (DDPMs) [ 13 ] define a Markovian forward process q(\mathbf{x}^{(\tau)}\mid\mathbf{x}^{(\tau-1)}) that progressively adds noise, and learn a reverse process p_{\theta}(\mathbf{x}^{(\tau-1)}\mid\mathbf{x}^{(\tau)}) to generate realistic samples [ 14 ] . While DDPMs have shown impressive performance on image synthesis tasks, their reliance on convolutional architectures optimized for spatial structure limits their effectiveness on time series data, where temporal coherence and autoregressive structure p(\mathbf{x}_{t}\mid\mathbf{x}_{1:t-1}) are central. Similar benefits from context-aware sequential modeling appear in NLP, where graph-augmented transformers advance minority stress detection [ 15 ] . To advance the generative modeling of sequential data, TIMED proposes a principled framework that addresses key challenges in time series synthesis. Built upon a DDPM backbone, TIMED introduces the following innovations: 1. a masked attention DDPM architecture designed to capture global structure in time series; 2. a supervisor network trained with next-step prediction to enforce autoregressive temporal dependencies; 3. a Wasserstein critic that provides adversarial guidance for improving temporal realism; 4. a Maximum Mean Discrepancy (MMD) loss that encourages global distributional alignment between real and generated sequences; and 5. a unified training strategy that jointly optimizes all three networks, enabling the model to balance fidelity, diversity, and coherence effectively. Together, these components enable TIMED to generate samples that are both statistically sound and temporally plausible across diverse time series domains. II Related Work Generative models differ widely in how they represent data distributions, define training objectives, and minimize divergence between real and generated samples. Autoregressive approaches model the joint distribution via a causal decomposition, p(\mathbf{X}_{1:T})=\prod_{t=1}^{T}p(X_{t}\mid\mathbf{X}_{1:t-1}) , and are typically optimized through teacher forcing, which conditions the model on ground-truth observations at each time step [ 8 ] . This setup enables exact likelihood computation and stable gradient-based training. However, it introduces a discrepancy between training and inference phases, commonly referred to as exposure bias [ 16 ] : at inference time, the model must autoregressively rely on its own predictions, which can be imperfect, leading to cascading errors and degraded sample quality. Methods such as professor forcing [ 17 ] attempt to mitigate this by aligning the model’s hidden-state trajectories across training and generation via adversarial regularization. Despite such remedies, autoregressive models remain deterministic in training and fail to capture latent variability, limiting their capacity as expressive generative models. VAEs [ 11 ] learn latent representations through a probabilistic encoder–decoder framework by optimizing the evidence lower bound (ELBO), \log p(x)\geq\mathbb{E}_{q(z\mid x)}[\log p(x\mid z)]-\mathrm{KL}(q(z\mid x)\|p(z)) [ 11 ] . This formulation promotes a trade-off between reconstruction fidelity and latent regularization. While VAEs offer stable training and interpretable structure, they often generate overly smooth or low-variance outputs due to a loose ELBO and the risk of posterior collapse in powerful decoders. GANs [ 10 ] forgo explicit likelihoods by formulating generation as a two-player game between a generator and a discriminator. Their training implicitly minimizes the Jensen–Shannon (JS) divergence [ 18 ] : \min_{G}\max_{D}\;\mathbb{E}_{\mathbf{x}\sim p_{\mathrm{data}}}[\log D(\mathbf{x})]+\mathbb{E}_{\mathbf{z}\sim p_{z}}[\log(1-D(G(\mathbf{z})))]. GANs can produce highly realistic samples, but suffer from training instability, mode collapse, and lack of reliable density estimation due to adversarial dynamics and sensitivity to hyperparameters. TimeGAN [ 19 ] is a hybrid framework for time series generation that combines GANs with supervised autoregressive learning. It jointly trains a generator,

Read the complete text