Maximum Likelihood Estimation of the Vector AutoRegressive To Anything (VARTA) model
Jonas Andersson, Dimitris Karlis · 2025
Read Maximum Likelihood Estimation of the Vector AutoRegressive To Anything (VARTA) model by Jonas Andersson, Dimitris Karlis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00631.txt.
Introduction
Multivariate time series modeling is stuck between Gaussian models and one-off models built for single applications. Jonas Andersson and Dimitris Karlis develop maximum likelihood estimation for the VARTA model in 2025. The name promises a vector autoregressive model that can be transformed to anything.
VARTA rests on an underlying, unobserved Gaussian vector autoregression, transformed to match the data's actual distributions. One general approach could serve finance, environment, and industry data alike. Careful likelihood estimation is what turns that elegant construction into a tool practitioners can fit and trust. Transforming to anything means the margins can be counts, positives, or bounded scores. Maximum likelihood gives the estimates a standard theory of uncertainty. For folks who fit such data, the gain is one frame for many kinds of counts. It can bend to fit the shape at hand, yet stay a single tool.
Catalog record
| CREATOR | Jonas Andersson, Dimitris Karlis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-00631
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Maximum Likelihood Estimation of the Vector AutoRegressive To Anything (VARTA) model Jonas Andersson, Dimitris Karlis Abstract The literature on multivariate time series is, largely, limited to either models based on the multivariate Gaussian distribution or models specifically developed for a given application. In this paper we develop a general approach which is based on an underlying, unobserved, Gaussian Vector Autoregressive (VAR) model. Using a transformation, we can capture the time dynamics as well as the distributional properties of a multivariate time series. The model is called the Vector AutoRegressive To Anyting (VARTA) model and was originally presented by 5 who used it for the purpose of simulation. In this paper we derive a maximum likelihood estimator for the model and investigate its performance. We also provide diagnostic analysis and how to compute the predictive distribution. The proposed approach can provide better estimates about the forecasting distributions which can be of every kind not necessarily Gaussian distributions as for the standard VAR models. Keywords : non-Gaussian time series; maximum likelihood estimation; predictive distribution JEL classification : C13; C22; C58 1 Introduction There is an enormous literature on how to model and forecast multivariate time series. Many multivariate statistical models are based on the, analytically tractable, multivariate Gaussian distribution. On the other hand, there is a much smaller literature for multivariate time series for non-Gaussian data, including the problem of forecasting such data. One reason might be the substantial difficulty to define such models and examine their properties. The present paper aims at filling this gap by considering multivariate time series models for non-Gaussian data. The derivation of the model used in this paper is based on an extension of the NORTA (normal to anything) approach, see 10 . Starting from a Gaussian Vector Autoregressive (VAR) model, we apply the probability integral transformation (PIT) to the data to end up with correlated multivariate uniform random variables. This transformation keeps both the time and cross correlations. Then, by the inverse transformation of the cumulative distribution function (CDF) we transform the data to any distribution, still keeping the structure of both the time and cross correlations. Since we can apply a different transformation to each marginal, such an approach can lead to a variety of different marginal models keeping the autoregressive structure and the correlation between the series. Such an approach allows to consider very flexible families of continuous time series models transferred to the case of any type of time series. The model is called the Vector AutoRegressive To Anyting (VARTA) model and was originally presented by 5 who used it for the purpose of simulation. See also 6 for further discussion on this approach. 30 examined conditions that a Gaussian VAR( k ) model has univariate margins that are autoregressive of order k or lower-dimensional margins that are also VAR( k ). Such conditions can help to built the model by selecting appropriate univariate marginal distributions. VARTA can be very helpful to formulate time series models with non-Gaussian marginals. The existing models in the literature are either very specialized, based on a particular multivariate distribution, or unnecessarily flexible, like copula approaches can sometimes become. The VARTA approach falls in between in these extremes in the sense that it models time dynamics as the familiar VAR model while allowing any choice of continuous marginal distributions. For continuous non-Gaussian models, there have been proposed models for bivariate exponential ( 11 ; 7 ) , bivariate uniform ( 26 ) , bivariate beta and gamma ( 2 ) , bivariate Weibull of the Marshal-Olkin type ( 19 ) , bivariate semi Pareto ( 27 ) and multivariate Weibull 29 . Finally 18 proposed state-space models for multivariate longitudinal data of mixed types. It is important to note that in all cases the marginal models are of the same kind. 14 and 23 provide interesting contributions for the case of multivariate count time series while an example of a bivariate time series model in \mathbb{Z} , rather than \mathbb{Z}_{+} , is given in 8 . Forecasting of transformed time series was also treated quite early in the literature for the univariate case by 15 , They considered the problem where a forecasting model is available for the Gaussian process X_{t} which is stationary (or can be made so after differencing) but their interest centers on the instantaneous transformation Y_{t}=T(X_{t}) . They examined the autocovariance structure of and methods for forecasting the transformed series Y_{t}=T(X_{t}) for a transformation T(\cdot) . In this paper we consider a vector autoregressive (VAR) model which is, subsequentally, transformed with a particular transformation based on inverse cumulative distribution functions (CDFs). The idea is that starting from a well known model like the VAR we end up with time series which are correlated and keep the autoregressive structure. Such a transformation is not new in the literature, in the sense that it has been used by many other authors. For example 9 called such an approach for continuous time series autoregressive to anything (ARTA). 13 used the approach for sampling discrete values with given correlation. The key idea is a univariate in such cases transformation from Gaussian distribution to any other. 24 described a general class of models based on this transformation that contains a multitude of models. See also the recent work of 12 and 20 on such latent Gaussian models. The contribution of the present paper is that we present a full parametric inference approach for VARTA models. An advantage is that it uses the huge theory about likelihood inference on VAR processes for random vectors with arbitrary marginal distribution, even mixtures of more than one. Note that the marginal F_{j}(\cdot) does not even need to be a known distribution: it can be directly estimated (parametricaly or not) by the data, as long as the estimated CDF can be inverted. Furthermore, we can model a wide range of time series. One more advantage is that we can simulate very easily by following the inverse process while the forecasting distribution can be easily set via simulation or even closed forms based on the assumed transformation. We demonstrate the idea with data from wind speed assuming Weibull marginal distributions. The properties of such an approach are discussed. The remainder of the paper is as follows: Section 2 defines the VARTA model while Section 3 describes ML estimation, asymptotic properties of the estimator, diagnostics and forecasting. Section 4 presents an illustration with Weibull marginal distributions using wind data. Section 5 provides simulation evidence for the finite sample properties of the estimator and its asymptotic approximation of standard error, including higher dimensional data. Concluding remarks can be found in Section 6 . 2 The model Consider the covariance stationary p -dimensional vector autoregressive (VAR) model or order one, denoted as VAR(1), given by \boldsymbol{Z}_{t}=A\boldsymbol{Z}_{t-1}+\boldsymbol{\eta}_{t}, (1) For identification purposes, we insist that the unconditional variances of all components of \boldsymbol{z}_{t} are unity, then the restrictions on \Omega , namely that \Omega=\Sigma-A\Sigma A^{\prime}, (2) follow. Here, \Sigma=\left(\begin{aligned} 1&&\rho_{12}&&\cdots&&\rho_{1p}\\ \rho_{12}&&1&&\cdots&&\rho_{2p}\\ \vdots&&\vdots&&\ddots&&\vdots\\ \rho_{1p}&&\rho_{2p}&&\cdots&&1\\ \end{aligned}\right). (3) Going back to the p -dimensional VAR(1)-model we transform all or some of the components so that they are allowed to follow a pre-specified marginal distribution. This is done by first applying the univariate