Evaluating generative models for synthetic financial data

Christophe D. Hounwanou, Pierre Ntakirutimana, Yaé Ulrich Gaba · 2025

Read Evaluating generative models for synthetic financial data by Christophe D. Hounwanou, Pierre Ntakirutimana, Yaé Ulrich Gaba (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-21791.txt.

Introduction

Christophe D. Hounwanou, Yae Ulrich Gaba, and Pierre Ntakirutimana compare three ways of making synthetic financial time series, a need created by scarce data and the secrecy of real market and client data. Fake data are only useful if models trained or tested on them behave as they would on the real thing.

The authors build one evaluation framework and apply it to a statistical ARIMA-GARCH baseline, autoencoders, and TimeGAN, a GAN for sequences, using daily S and P 500 data. They score fidelity, temporal structure such as autocorrelation and volatility clustering, and use in portfolio work and volatility forecasting. The statistical model captures linear trends and shifting volatility but misses nonlinear dynamics. The autoencoder produces smooth series that understate extreme events. TimeGAN achieved the best balance of realism and time coherence, with the lowest discrepancy score.

Catalog record

CREATORChristophe D. Hounwanou, Pierre Ntakirutimana, Yaé Ulrich Gaba
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-21791

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating generative models for synthetic financial data Christophe D. Hounwanou, Pierre Ntakirutimana, Yaé Ulrich Gaba Abstract Data scarcity and confidentiality in finance often impede model development and robust testing. This paper presents a unified multi-criteria evaluation framework for synthetic financial data and applies it to three representative generative paradigms: the statistical ARIMA–GARCH baseline, Variational Autoencoders (VAEs), and Time-series Generative Adversarial Networks (TimeGAN). Using historical S&P 500 daily data, we evaluate fidelity (Maximum Mean Discrepancy, MMD), temporal structure (autocorrelation and volatility clustering), and practical utility in downstream tasks, specifically mean–variance portfolio optimization and volatility forecasting. Empirical results indicate that ARIMA–GARCH captures linear trends and conditional volatility but fails to reproduce nonlinear dynamics; VAEs produce smooth trajectories that underestimate extreme events; and TimeGAN achieves the best trade-off between realism and temporal coherence (e.g., TimeGAN attained the lowest MMD: 1.84 × 10 − 3 1.84\times 10^{-3} , average over 5 seeds). Finally, we articulate practical guidelines for selecting generative models according to application needs and computational constraints. Our unified evaluation protocol and reproducible codebase aim to standardize benchmarking in synthetic financial data research. 1 Introduction Financial modeling and quantitative research depend critically on access to large volumes of high-quality data for forecasting, risk assessment, and portfolio optimization. Yet, financial datasets are often constrained by strict privacy regulations, proprietary restrictions, and significant acquisition costs, which hinder open access and reproducibility [ 1 , 16 , 20 ] . This data scarcity limits the scalability of empirical research and impedes the robust validation of models across diverse market regimes. These constraints are particularly problematic in settings such as bank stress testing, confidential scenario analysis, and the development of proprietary risk models, where sensitive data cannot be shared but synthetic alternatives could support benchmarking and model development. Synthetic data generation has emerged as a promising solution, enabling the creation of artificial datasets that retain key statistical and temporal properties of real financial series while safeguarding confidentiality [ 15 , 17 ] . Traditional econometric models such as ARIMA and GARCH remain widely used due to their interpretability and their ability to reproduce stylized facts like volatility clustering [ 5 , 6 ] . Deep generative architectures including Variational Autoencoders (VAEs) [ 10 ] and Time-series Generative Adversarial Networks (TimeGANs) [ 23 ] provide a complementary perspective by modeling nonlinear and high-dimensional temporal structures. These three model classes are chosen deliberately. ARIMA–GARCH offers a transparent, statistically grounded baseline; VAE represents latent-variable generative modeling with explicit regularization; and TimeGAN captures complex temporal dependencies through adversarial and recurrent mechanisms. Together, they form a representative spectrum of interpretability, flexibility, and computational complexity in financial time-series synthesis. While diffusion-based models have recently achieved state-of-the-art results in synthetic tabular data [ 11 , 12 ] , their application to long-horizon or high-frequency financial series remains computationally demanding. To maintain methodological focus and reproducibility, we restrict our comparison to these three established paradigms widely adopted in prior financial studies [ 4 , 21 ] . Despite the proliferation of techniques, a key challenge persists: the absence of a unified, systematic framework that evaluates both fidelity and practical utility. Existing studies often assess only isolated properties, making it difficult to determine which generative paradigm is most suitable under specific constraints [ 14 , 24 ] . To address this gap, we formalize the central hypothesis guiding this study: Deep temporal generative models (TimeGAN) outperform statistical and static latent-variable models (ARIMA–GARCH, VAE) across distributional fidelity, temporal coherence, downstream predictive utility, and privacy leakage metrics. Evaluation protocol overview. For each model, we generate synthetic datasets aligned with historical market sequences. We assess distributional fidelity (e.g., MMD), temporal structure (autocorrelation), volatility preservation, downstream predictive performance, and privacy leakage (nearest-neighbor and membership inference attacks). This paper contributes a comprehensive comparative analysis of ARIMA–GARCH, VAE, and TimeGAN applied to S&P 500 log returns. Our key contributions are: • A multi-criteria evaluation framework assessing distributional similarity, temporal coherence, volatility patterns, downstream task performance, and visual structure via PCA. • An empirical benchmark quantifying strengths and limitations of each model across stable and volatile market regimes. • Practical guidance on model selection, highlighting trade-offs between interpretability, realism, and computational requirements. The remainder of this paper is organized as follows: Section 2 reviews related work, Section 3 presents the methodology, Section 4 details the evaluation framework, Section 5 reports the experimental results, Section 6 offers a discussion and model trade-offs, and Section 7 concludes. 2 Preliminaries This section charts the conceptual and methodological evolution of synthetic financial data generation, establishing the foundation for our comparative framework. We begin with a unified formal goal before tracing the historical trajectory from interpretable statistical models to flexible deep learning approaches. This narrative highlights how each paradigm addresses limitations of earlier approaches, culminating in the unresolved challenges that motivate our systematic evaluation. 2.1 The generative goal: a unified formal perspective Synthetic data generation seeks to produce artificial financial series whose distribution P_{\text{synthetic}} closely approximates the true data-generating distribution P_{\text{real}} while ensuring confidentiality and reproducibility [ 7 , 17 ] . Formally, a generative model defines a mapping G_{\theta}:\mathcal{Z}\rightarrow\mathcal{X},\qquad x_{\text{syn}}=G_{\theta}(z),\ z\sim P_{z}, which induces the synthetic distribution P_{\text{synthetic}}=G_{\theta}(P_{z}). The learning objective is to minimize a divergence between real and synthetic distributions: \theta^{*}=\argmin_{\theta},\mathcal{D}\!\left(P_{\text{real}},\,P_{\text{synthetic}}(\theta)\right), where \mathcal{D} may be an explicit probability divergence or an implicit adversarial distance. This formulation highlights the central distinction between model families: traditional statistical models (e.g., ARIMA–GARCH) impose interpretable parametric structures on P_{\text{real}} , whereas modern deep generative models(e.g., VAEs, GANs) learn flexible, high-dimensional representations of P_{\text{synthetic}} without explicit distributional assumptions. This contrast motivates the comparative analysis developed in the sections that follow. 2.2 The statistical foundation: Interpretability at a cost Classical statistical models form the cornerstone of financial econometrics, valued for their interpretability, analytical tractability, and well-understood asymptotic properties. An autoregressive integrated moving average process, ARIMA( p,d,q ), models a differenced stationary time series as: \phi(B)(1-B)^{d}x_{t}=\theta(B)\varepsilon_{t}, (2.1) where B denotes the backward shift operator, \varepsilon_{t} is a white noise innovation, and \phi(B) and \theta(B) are polynomials representing the autoregressive and moving-average components, respectively. To capture the phenomenon of volatility clustering, a defining feature of financial return series—the GARCH( p,q ) model [ 1 ] specifies the conditional variance dynamics as: \sigma_{t}^{2}=\omega+\sum_{i=1}^{q}\alpha_{i}\varepsilon_{t-i}^{2}+\sum_{j=1}^{p}\beta_{j}\sigma_{t-j}^{2}, (2.2) where past shocks ( \varepsilon_{t-i}^{2} ) and lagged volatilities ( \sigma_{t-j}^{2} ) jointly determine current market uncertainty. While ARIMA–GARCH models remain powerful for linear dependence and volatility persistence, their parametric structure limits their ability to represent nonlinearities and regime shifts.. These limitations motivated the transition toward more flexible, data-driven generative paradigms. Probabilistic latent representations with VAEs Variational Autoencoders (VAEs) [ 9 ] provide a probabilistic approach to generative modeling by optimizing the Evidence Lower Bound (ELBO): \mathcal{L}_{\text{VAE}}=\mathbb{E}_{q_{\phi}(z|x)}[\log p_{\theta}(x|z)]-D_{\mathrm{KL}}(q_{\phi}(z|x)\,\|\,p(z)). The encoder q_{\phi}(z|x) approximates the posterior distribution, while the decoder p_{\theta}(x|z) reconstructs data from latent variables. The KL term regularizes the latent space, yielding smooth representations. In finance, this smoothness leads VAEs to capture broad market structure but often suppress abrupt shocks or volatility spikes, resulting in synthetic series that appear overly stable. These limitations motivate extensions that explicitly incorporate temporal structure. 2.3 Bridging the gap: temporal and hybrid models Standard VAEs and GANs model distributions effectively but do not impose sequential structure, while statistical models capture temporal dependence but lack flexibility. This gap

Read the complete text