Systematic comparison of deep generative models applied to multivariate financial time series.

Howard Caulfield, James P. Gleeson · 2024

Read Systematic comparison of deep generative models applied to multivariate financial time series. by Howard Caulfield, James P. Gleeson (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-06417.txt.

Introduction

Howard Caulfield and James Gleeson compared in 2024 how well deep generative models fake financial time series against classic formula-based rivals. Banks need realistic fake prices to test risk and tune portfolios, a modeling need over a century old. Deep generators are new to the task and largely unproven.

The team first ran both camps on synthetic data of rising complexity, scoring how closely the fakes matched real distributions, moment by moment. The best deep models then faced market data through a trading task built on implied volatility. The results show where deep models genuinely help and where the classics still hold. The authors frame the study as a fair benchmark for a young field. Code and setup invite others to extend the race.

Catalog record

CREATORHoward Caulfield, James P. Gleeson
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-06417

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Systematic comparison of deep generative models applied to multivariate financial time series. Howard Caulfield, James P. Gleeson Abstract . Financial time series (FTS) generation models are a core pillar to applications in finance. Risk management and portfolio optimization rely on realistic multivariate price generation models. Accordingly, there is a strong modelling literature dating back to Bachelier’s Theory of Speculation in 1901 ( Bachelier, 1901 ) . Generating FTS using deep generative models (DGMs) is still in its infancy. In this work, we systematically compare DGMs against state-of-the-art parametric alternatives for multivariate FTS generation. We initially compare both DGMs and parametric models over increasingly complex synthetic datasets. The models are evaluated through distance measures over moment distributions for both the full and rolling FTS. We then apply the best performing DGM models to empirical data, demonstrating the benefit of DGMs on a implied volatility trading task. 1. Introduction Generative methods in deep learning have launched overwhelming interest in the advent of artificial intelligence. However, the application of DGMs to time series is a burgeoning field. Historically, the field of time series modelling is dominated by econometric and mathematical modelling approaches. Given the success of deep learning in high dimensional fields, it offers an attractive approach to FTS applications. In section two we describe the current landscape of deep generative modelling with respect to FTS. Section three focuses on the models we use and how we create and evaluate the synthetic datasets. We elucidate on our experimental implementation in section four. The results are reported and analysed in section five. Finally, in section six we conclude our analysis, outline caveats of our work and list further areas for research. 2. Related Work The research landscape of synthetic time series generation and probabilistic forecasting using deep learning is quite fluid. The general taxonomy of probabilistic generative models can be divided into implicit and explicit density modelling. Implicit models (General Adversarial Networks ( Goodfellow et al., 2020 ) , Moment Matching Networks ( Lewis and Syrgkanis, 2018 ) and Diffusion models ( Song et al., 2020 ) ) do not require the user to imply a prior distribution in order for the data distribution to be learned. In contrast, explicit models (Variational Autoencoders ( Kingma and Welling, 2014 ) , Normalizing Flows ( Rezende and Mohamed, 2015 ) , Mixture Density Networks ( Bishop, 1994 ) , Boltzmann Machines ( Kondratyev and Schwarz, 2019 ) and Autoregressive Density Estimation ( Uria et al., 2016 ) ) do require an explicit prior, typically a Gaussian distribution. Early work on FTS using DGMs include FIN-GAN ( ( Takahashi et al., 2019 ) ) and Quant GAN ( ( Wiese et al., 2020 ) ). FIN-GAN examined if GANs using multi-layer and convolution architectures could satisfy stylized facts of FTS ( ( Cont, 2001 ) ) such as volatility clustering. Quant GAN also examines this question using dilated convolutions ( ( Lea et al., 2017 ) ) in their architecture to capture long memory. TimeGAN ( Yoon et al., 2019 ) is a time series generation model which was tested over different time series tasks, including univariate stock generation. TimeGAN is comprised of both an autoencoder and GAN network. To induce temporal dynamics, they train a supervisor over the encoded latent space. While financial price series are typically represented as financial returns other methods exist. Signatures ( Lyons, 2014 ) , have been used to represent price paths. SigGWAN ( Ni et al., 2021 ) introduces a new measure Sig-W1 to compare time series models based on the Wassterstein distance of generated return signatures versus true return signatures. SigCWGAN ( Ni et al., 2020 ) generates signatures of financial returns conditioned on a rolling window of signature features. The SigCGWAN model demonstrates superior Sig-W1 scores in comparison to TimeGAN, RCGAN ( Esteban et al., 2017 ) and GMMN ( Li et al., 2015 ) . More recently, the application of DGMs in finance have been extended to specific applications. These include risk management applications such as tail-risk estimation (Tail-GAN ( Cont et al., 2022 ) ). ForGAN ( Koochali et al., 2019 ) combines recurrent neural networks with GANs for probabilistic forecasts. Fin-GAN ( Vuletić et al., 2024 ) extends ForGAN with an economic loss objective to improve portfolio Sharpe ratios. PAGAN ( Mariani et al., 2019 ) uses GANs to condition return generation on historical trends, and in doing so help guide portfolio optimization decisions. Work that focuses on deep generative models for multivariate FTS deep generative models is limited. Hierarchical-SigCWGAN (H-SigCWGAN) is introduced in ( de Meer Pardo et al., 2022 ) and seeks to alleviate the dimensional bottleneck of signature approaches. The approach involves hierarchically clustering time series and determining a base signature for each cluster. However, H-SigCWGAN does not demonstrate improvement in performance over its counterpart SigCWGAN. CoMeTS-GAN ( Masi et al., 2023 ) builds on the work of ( Wiese et al., 2020 ) . In CoMeTS-GAN, a correlation feature is also passed to the discriminator (lower triangular values of the correlation matrix). The model is trained on a Wasserstein loss ( Arjovsky et al., 2017 ) and demonstrates improved correlated time series generation. The authors of ( Tepelyan and Gopal, 2023 ) use both variational autoencoders and normalizing flows to generate multivariate data for a basket of 500 stocks. The first part of the model comprises of a conditional importance weighted autoencoder model trained on predefined factors (PCA applied to a basket of indices). Using generated factor values, they learn a general conditional normalizing flow model to generate multivariate time series. The performance of this two-step model is compared to parametric models (univariate GARCH and an exponential moving average model of the calculated PCA factors) and demonstrates superior negative log-likelihood values. The works most similar to our own include ( Gatta et al., 2022 ) , ( Dogariu et al., 2022 ) and ( Ericson et al., 2024 ) . In ( Gatta et al., 2022 ) , multiple generative models are compared based on statistical properties, prediction scores and novelty. They focus on univariate price returns. The best performing model is an optimal ensemble of SigCWGAN, TimeGAN, RCGAN and GMMN. However, how to create the optimal ensemble is not described. A large variation of DGMs (VAEs and GANs) is examined in ( Dogariu et al., 2022 ) with varying underlying architectures, primarily fully connected multi-layer or convolutional layer based networks. They train on empirical data with no conditioning. GANs are trained using a mixture of maximum mean discrepancy (MMD) and a standard GAN loss. After 100 epochs of training, variational autoencoders are found to work best. No measures of dependency (e.g., correlation) in the synthetic returns are reported . Lastly, ( Ericson et al., 2024 ) is the closest to our work. Synthetic data is used to validate varying conditional generative models while comparing to historical simulation methods and parametric models. The work focuses on modelling value at risk of bond yields. A 250-day period is used for conditioning the models. Based on a mixed ranking of distribution distance, autocorrelation distance and a backtesting score (based on both training and testing data), the authors find that historical simulation outperforms both

Read the complete text