Time Series Generation Under Data Scarcity: A Unified Generative Modeling Approach
Tal Gonen, Itai Pemper, Ilan Naiman, Nimrod Berman, Omri Azencot · 2025
Read Time Series Generation Under Data Scarcity: A Unified Generative Modeling Approach by Tal Gonen, Itai Pemper, Ilan Naiman, Nimrod Berman, Omri Azencot (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20446.txt.
Introduction
Tal Gonen and four co-authors conducted a large study in twenty twenty-five of how generative models synthesize time series when data are scarce. Few-shot generation matters in medicine, finance, and industry, where long records are rare. Their survey of leading models exposed a wide gap between full-data and scarce-data performance.
To close it they propose a unified diffusion framework pre-trained on a large, mixed collection of time series. Dynamic convolutional layers flex across channel counts, and dataset tokens condition generation on the domain. With only a few examples it beat domain-specific baselines across subset sizes. Remarkably, it also topped baselines on full data sets, crediting pre-training and cross-domain transfer. Code is public.
Catalog record
| CREATOR | Tal Gonen, Itai Pemper, Ilan Naiman, Nimrod Berman, Omri Azencot |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20446
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Time Series Generation Under Data Scarcity: A Unified Generative Modeling Approach Tal Gonen, Itai Pemper, Ilan Naiman, Nimrod Berman, Omri Azencot Abstract Generative modeling of time series is a central challenge in time series analysis, particularly under data-scarce conditions. Despite recent advances in generative modeling, a comprehensive understanding of how state-of-the-art generative models perform under limited supervision remains lacking. In this work, we conduct the first large-scale study evaluating leading generative models in data-scarce settings, revealing a substantial performance gap between full-data and data-scarce regimes. To close this gap, we propose a unified diffusion-based generative framework that can synthesize high-fidelity time series across diverse domains using just a few examples. Our model is pre-trained on a large, heterogeneous collection of time series datasets, enabling it to learn generalizable temporal representations. It further incorporates architectural innovations such as dynamic convolutional layers for flexible channel adaptation and dataset token conditioning for domain-aware generation. Without requiring abundant supervision, our unified model achieves state-of-the-art performance in few-shot settings—outperforming domain-specific baselines across a wide range of subset sizes. Remarkably, it also surpasses all baselines even when tested on full datasets benchmarks, highlighting the strength of pre-training and cross-domain generalization. We hope this work encourages the community to revisit few-shot generative modeling as a key problem in time series research and pursue unified solutions that scale efficiently across domains. Code is available at https://github.com/azencot-group/ImagenFew . 1 Introduction Many engineering and scientific domains face challenges in collecting high-quality time series data due to cost, privacy, and other barriers. In seismology, earthquake recordings are sparse and geographically limited [ 51 ] ; climate research requires expensive, long-term sensor deployments [ 25 ] ; and biomedical data like ECGs often suffer from underrepresentation and privacy constraints [ 12 , 43 ] . These limitations hinder the development of robust machine learning models, which typically rely on large, diverse datasets. A promising alternative to large-scale time series collection is the training of generation models [ 66 , 45 , 44 , 67 ] . These models aim to capture both the distribution of features at each time step and the complex temporal dynamics across time. Once trained to approximate the underlying data distribution, such models enable the generation of novel, reliable data samples related to the original dataset. While generative modeling offers a promising way to alleviate data scarcity, existing models are often designed and evaluated under the assumption of abundant training data . In particular, despite the growing interest in generative approaches, their performance in low-data settings, which reflect many real-world scientific applications, remains largely unexplored. In this context, our first main contribution is a systematic evaluation of state-of-the-art time series generation models under low-data conditions . We introduce a novel benchmark that brings together datasets from diverse real-world domains, including finance, climate, and biomedicine, and simulate data-scarce scenarios by limiting training to a small fraction of each dataset (e.g., 5%) [ 8 ] . This benchmark allows us to assess the resilience of generative models when data is limited, mirroring the constraints commonly faced in practical applications. Our results reveal a consistent drop in generation quality under such conditions, highlighting that current approaches struggle to maintain good performance with limited data. This finding underscores the pressing need for more robust methods that can operate effectively in low-data regimes. Existing time series generation models are typically trained separately for each dataset or problem domain [ 66 , 45 , 44 , 67 , 29 ] , a paradigm that proves restrictive in scenarios characterized by limited data availability. Inspired by the success of unified training approaches for vision [ 33 ] , language [ 5 ] , and non-generative tasks in time series [ 20 , 8 , 63 , 14 ] , we extend this paradigm to generative modeling under data-scarce conditions. Rather than training separate models for each dataset, we aim to build a single generative model exposed to a wide range of domains, including energy, finance, climate, and traffic, to encourage cross-domain generalization and few-shot generation. We hypothesize that such diversity enables the model to learn transferable temporal structures, improving its ability to generate high-quality samples even when only a few training examples are available. To realize this goal, our second main contribution is the development of a unified generative model for time series data, trained across a heterogeneous set of domains. We first pre-train our model on a large, diverse time series corpus, and then fine-tune it on downstream generative tasks with limited data. Our architecture builds on the ImagenTime framework [ 44 ] , which maps time series to invertible image representations, enabling the use of diffusion-based generation in the image domain. To seamlessly handle datasets with varying channel dimensions, we propose a Dynamic Convolution (DyConv) layer that interpolates the weights of the channel dimension, ensuring a unified architecture even when test-time inputs differ in channels structure. Finally, to enable domain-specific sampling in our multi-domain trained model, we introduce a dataset token mechanism that conditions the diffusion process on domain-specific information. Our third main contribution is the empirical demonstration of significant improvements over existing methods. Our approach maintains strong performance when trained on only 15 \% , 10 \% , or even 5 \% of the original dataset. We further evaluate our model under extreme low-resource conditions, where only 10, 25 and 50 training examples are available, and observe that it continues to produce high-quality samples. Specifically, our unified model achieves, on average, over 55.72% and 54.25% performance gains on Discriminative Score and contextFID, respectively, compared to state-of-the-art baselines across multiple datasets and data-limited scenarios. Beyond performance metrics, we conduct in-depth analyses, including scaling law experiments, to better understand the relationship between data volume, model capacity, and generalization. We believe that our model, extensive empirical evaluation, and the proposed benchmark, can serve as a foundation for further research and drive progress in time series generation under data-constrained environments. 2 Related Work Generative modeling of time series. There are three major existing paradigms for generative modeling of time series data. The first is based on Generative Adversarial Networks (GANs) [ 22 ] , which have been applied to capture temporal dynamics through adversarial learning [ 66 , 29 ] . A second line of work employs Variational Autoencoders (VAEs) [ 32 ] , leveraging probabilistic latent representations to model sequential structure [ 45 , 36 , 16 ] . More recently, the success of diffusion models in domains such as image [ 24 , 55 , 54 , 56 , 31 ] and audio generation [ 34 , 38 ] has sparked growing interest in their adaptation to time series [ 13 , 67 , 44 ] . Despite these advances, existing models have largely been developed and evaluated under the assumption of abundant training data. None of these approaches has systematically investigated performance under severe data scarcity, a condition common in many real-world domains such as healthcare, seismology, and climate science. In contrast, our work demonstrates the feasibility of time series generation under extreme low-data conditions, highlighting its practical relevance and robustness in real-world deployment scenarios. Unified training of time series. Recent advances in foundation models, such as large language models [ 5 ,