L-GTA: Latent Generative Modeling for Time Series Augmentation DOI: XXXXXXX.XXXXXXX Conference: Machine Learning in Time Series (MILETS) Workshop at the ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 3–7, 2025; Toronto, ON, Canada ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing

Luis Roque, Carlos Soares, Vitor Cerqueira, Luís Torgo · 2025

Read L-GTA: Latent Generative Modeling for Time Series Augmentation DOI: XXXXXXX.XXXXXXX Conference: Machine Learning in Time Series (MILETS) Workshop at the ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 3–7, 2025; Toronto, ON, Canada ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing by Luis Roque, Carlos Soares, Vitor Cerqueira, Luís Torgo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23615.txt.

Introduction

Luis Roque and co-authors fake more time series data so forecasters can train on plenty, in a 2025 paper. Their model, L-GTA, squeezes each series into a latent code with a bidirectional memory network and attention, then nudges the code with jitter, warps, or drift to mint new, plausible series. A consistency rule keeps code changes and data changes in step.

Against rival generators and raw transforms, the fakes cut forecast error by up to twenty-six percent over the best rival and twenty-seven percent over no augmentation at all. The knobs for change strength stay readable, which helps analysts in energy, health, and retail trust what the machine invented.

Catalog record

CREATORLuis Roque, Carlos Soares, Vitor Cerqueira, Luís Torgo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23615

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

L-GTA: Latent Generative Modeling for Time Series Augmentation DOI: XXXXXXX.XXXXXXX Conference: Machine Learning in Time Series (MILETS) Workshop at the ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 3–7, 2025; Toronto, ON, Canada ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Machine learning CCS: Mathematics of computing Time series analysis Luis Roque, Carlos Soares, Vitor Cerqueira, Luís Torgo Abstract . Data augmentation is gaining importance across various aspects of time series analysis, from forecasting to classification and anomaly detection tasks. We introduce the Latent Generative Transformer Augmentation (L-GTA) model, a generative approach using a transformer-based variational recurrent autoencoder. This model uses controlled transformations within the latent space of the model to generate new time series that preserve the intrinsic properties of the original dataset. L-GTA enables the application of diverse transformations, ranging from simple jittering to magnitude warping, and combining these basic transformations to generate more complex synthetic time series datasets. Our evaluation of several real-world datasets demonstrates the ability of L-GTA to produce more reliable, consistent, and controllable augmented data. This translates into significant improvements in predictive accuracy and similarity measures compared to direct transformation methods. 1. Introduction In the era of big data, time series analysis has emerged as a critical tool in various domains ranging from financial markets ( Cheng et al. 2022 ) to health monitoring ( Gitto et al. 2021 ) , from climate forecasting ( Fathi et al. 2022 ) to retail sales predictions ( Karmy and Maldonado 2019 ) . Accurate and insightful time series analysis can lead to predictive models that provide crucial information for decision-making processes. Nevertheless, the performance of these models significantly depends on the quality and quantity of the available data. Also, collecting labeled time series data for a specific task or domain can be challenging. Similarly, real-world time series data often exhibit complex dependencies, non-linear dynamics, and high dimensionality. They may also be affected by noise, irregular sampling, and missing values, further complicating their analysis and modeling. As a result, models trained on such data often fail to generalize well, leading to poor predictive performance when applied to unseen data. In such scenarios, data augmentation techniques, which generate synthetic data samples from the original data, offer a promising solution. They increase the quantity of the data and improve model robustness by providing diversified data instances ( Wen et al. 2021 ) . The problem with traditional data augmentation techniques for time series data, such as jittering, scaling, and warping, is that they are relatively simple and may not adequately capture the complexities often found in relevant datasets. Furthermore, these techniques are difficult to apply in a controlled manner, which may introduce artificial distortions that deviate significantly from real-world scenarios. Consequently, this reduces the practical utility of the models trained on such data. Figure 1. Diagram depicting the L-GTA framework for augmenting time series data. This method combines Bi-LSTMs and CVAEs with a Variational Multi-Head Attention (VMHA) mechanism to generate semi-synthetic time series data. The learned latent space is transformed by applying time series augmentation techniques such as jittering and magnitude warping. The augmented latent representations are then decoded, producing data that maintains the statistical fidelity of the original sequences. L-GTA allows for robust and diverse data transformed data. We introduce the Latent Generative Transformer Augmentation (L-GTA) model to address these limitations (see Figure 1 ). L-GTA generates semi-synthetic time series data that merges the capabilities of Transformers, Bidirectional Long Short-Term Memory Networks (Bi-LSTMs), conditional Variational Autoencoders (CVAEs), and traditional time series augmentation techniques. We introduce a Variational Multi-Head Attention (VMHA) mechanism to capture more nuanced and long-term temporal dependencies in the data. The variational component introduces randomness in a controlled manner, making the attention mechanisms more robust and flexible. Alongside VMHA, we use Bi-LSTMs to capture the more immediate temporal dependencies within the data, while CVAEs construct a probabilistic, low-dimensional latent space that accurately represents the dataset. In this learned latent space, we apply traditional time series augmentation techniques, like jittering and magnitude warping. The transformed latent space is then passed through the learned decoder. This process consistently yields augmented data that mirrors the effects of direct transformations while more strictly respecting the statistical properties of the original data. As a result, the produced data is less prone to exhibit artificial patterns and extreme values. For example, we demonstrate that the residuals of the datasets generated after applying jittering directly or using L-GTA are different. Direct transformations produce residuals that are more skewed than those generated by L-GTA. L-GTA also offers additional variety while controlling for the amount of change in augmented data that is generated. In the current set of generative models (e.g., ( Yoon et al. 2019a ) ), we have to rely on randomly sampling the latent space to generate new data. With our proposed approach, the latent space is manipulated in a controlled way, which creates the ability to generate data with certain characteristics. This is relevant to increase robustness and diversity in time series analysis. We evaluate the L-GTA method against traditional direct augmentation techniques using three real-world datasets, focusing on its ability to preserve the statistical properties and predictive characteristics of the original data. Through a series of experiments, we assess the fidelity of the transformed data by comparing the generated patterns and the control and consistency of L-GTA. We measured the Wasserstein distance and reconstruction error alongside the Train-on-Synthetic, Test-on-Real (TSTR) framework. Our findings highlight the superior performance of L-GTA in maintaining the original data integrity, as demonstrated by lower Wasserstein distances, minimal deviation in reconstruction error, and prediction accuracies in line with those achieved using the original datasets. The primary contributions of this paper are as follows: • We propose a novel generative model, L-GTA, which leverages a transformer-based CVAE for controlled time series augmentation; • We introduce a flexible method to apply transformations, such as jittering and magnitude warping, to lower dimensional embeddings of a dataset. These transformations are then propagated coherently to generate new transformed time series that incorporate both the transformation and the intrinsic characteristics of the original dataset. These transformations can be combined in various ways to create a large set of diverse synthetic time series, thereby improving the versatility of the augmentation process; • We empirically tested L-GTA, comparing it with direct transformation methods. We analyzed the patterns of the transformed data and the control and consistency of L-GTA when generating it. We also discussed three perspectives to assess the fidelity of the generated data compared to the original: the distribution of distances, the reconstruction error, and the prediction performance. All experiments are fully reproducible, and the methods and time series data are available as a publicly available code repository. 1 1 1 https://github.com/luisroque /latent-generative-modeling-time-series-augmentation 2. Notation and Background 2.1. Time Series Let us consider a set of S related univariate time series, represented as \mathcal{Z}=\{z^{i}_{t}:t\in\mathbb{N},i=1,\dots,S\} , where the sequence z^{i}_{1:T}=[z^{i}_{1},z^{i}_{2},\ldots,z^{i}_{T}] denotes the observed values of the i -th time series up to the final observation time T . Each observation z^{i}_{t}\in\mathbb{R} indicates the value of series i at time t . To simplify discussions in certain contexts, we denote \mathbf{z}^{i}=z^{i}_{1:T} as the complete observed time series for the i -th series. The process of time

Read the complete text