Shrinkage Regularization for (Non)Linear Serial Dependence Test Francesco Giancaterini Abstract 1 Introduction The nonlinear serial dependence test (NLSD hereafter) introduced by 7 is a portmanteau-type test based on the autocovariances of nonlinear functions of strictly stationary time series with non-Gaussian distributions. This approach follows from 1 and has been further developed by 6 for inference on mixed causal-noncausal models from the GCov estimator and the GCov-based specification test. In the frequency domain, a nonlinear serial dependence test was introduced by 3 . The NLSD test can be used to identify nonlinear and noncausal dynamics in both univariate and multivariate time series. The test statistic is computed from nonlinear transforms a(.) of a univariate or multivariate non-Gaussian process \{X_{t},\},t=1,...,T of dimension N . The transformed vector X_{t}^{a} is of dimension higher than N , because it is augmented by K nonlinear functions of X_{t} , such as the squares, absolute values or logarithms, for example, satisfying the regularity conditions given in 6 . For example, let us consider K nonlinear functions a_{1},...,a_{K} of a univariate X_{t} with N=1 . These functions transform X_{t} into a multivariate process of dimension NK=K with components a_{k}(X_{t}) as follows: X_{t}^{a}=\left(\begin{array}[]{c}a_{1}(X_{t})\\ \vdots\\ a_{K}(X_{t})\end{array}\right), (1) where a_{1}(X_{t})=X_{t} is the vector time series itself to capture the linear dependence. Note that if X_{t} has no finite second-order moments, then it can be replaced by a transformed multivariate process X_{t}^{a} with finite moments. Then, from a sample of T observations on X_{t} , we can compute the sample autocovariance matrix of the transformations a_{k}(X_{t}),k=1,...,K : \hat{\Gamma}_{T}^{a}(h)=\frac{1}{T}\sum_{t=h+1}^{T}X_{t}^{a}X_{t-h}^{a^{\prime}}-\frac{1}{T}\sum_{t=1}^{T-h}X_{t}^{a}\frac{1}{T}\sum_{t=h+1}^{T}X_{t-h}^{a^{\prime}}. (2) and the sample variance matrix \hat{\Gamma}_{T}^{a}(0) . Let us consider the following set of null hypotheses: H_{0,a}=(\Gamma^{a}(h)=0,\;h=1,...,H). To test for the absence of linear and nonlinear serial dependence, we compute the test statistic: \hat{\xi}^{a}_{T}(H)=T\sum_{h=1}^{H}Tr\hat{R}_{a}^{2}(h), (3) where \hat{R}_{a}^{2}(h)=\hat{\Gamma}_{T}^{a}(h)\hat{\Gamma}_{T}^{a}(0)^{-1}\hat{\Gamma}_{T}^{a}(h)^{\prime}\hat{\Gamma}_{T}^{a}(0)^{-1}. Under the null hypothesis of independence, the NLSD test statistic \hat{\xi}^{a}_{T}(H) follows asymptotically a \chi^{2}((NK)^{2}H) distribution 6 6 6 7 show that for an increasing set of well-selected nonlinear transformations the null hypothesis of the absence of (non)linear dependence is close to the independence hypothesis, which is the implicit null hypothesis used for the derivation of the asymptotic properties of the test. . When N or K or both are large then the matrix \hat{\Gamma}_{T}^{a}(0) is of high dimension and its inverse may be difficult to compute. Two approaches in the literature address this issue. The first one consists in replacing the sample variance matrix by a matrix containing only its diagonal elements, and was proposed by 5 . The test statistics computed under this approach does not have an asymptotic chi-square distribution under the null of independence. The second is the Ridge regularization (RNLSD) test proposed by 4 , which relies on a Ridge-type regularization of the NLSD test and yields a RNLSD test statistic with an asymptotic chi-square distribution under the null of independence. 4 suggest the cross-validation for selecting the optimal regularization parameter. In this paper, we consider the shrinkage approach of 8 for estimating the sample covariance matrix, when it suffers from the curse of dimensionality. The advantage of this approach is that we can estimate the shrinkage parameter in a single step, directly from the sample. The shrinkage Regularized NLSD (SR-NLSD hereafter) test has an asymptotic chi-square distribution with known degrees of freedom under the null of independence and relies on consistent estimators of the shrinkage parameters. 2 Linear Shrinkage Estimator of Ledoit and Wolf 8 propose a general asymptotic framework, which is reviewed below using their generic notation and allows p=N to tend to infinity at a rate such that p/T stays bounded. They consider X , which is a p\times T matrix of T i.i.d observations on random variables of dimension p with mean zero and variance matrix \Sigma . The Frobenius norm is defined as ||A||=\sqrt{tr(AA^{\prime})/p} , based on the quadratic form of ||.||^{2} and the inner product =tr(A_{1}A_{2}^{\prime})/p . The sample covariance matrix is denoted by S=XX^{\prime}/T . The goal is to find the linear combination of identity matrix I and sample covariance matrix S , which are the components of a regularized variance estimator \Sigma^{*}=\rho_{1}I+\rho_{2}S which minimize E[||\Sigma^{*}-\Sigma||^{2}] , the expected distance between the regularized variance estimator and true variance and \rho_{1},\rho_{2} are the tuning parameters. 8 identify four scalars that play important roles: \mu=<\Sigma,I>,\;\;\alpha^{2}=||\Sigma-\mu I||^{2},\;\;\beta^{2}=E[||S-I||^{2}],\;\;\delta^{2}=E[||S-\mu I||^{2}], where ||.|| denotes the Frobenius norm. For \beta^{2} and \delta^{2} to be finite we need to assume X has a finite fourth moment. Theorem 2.1 of 8 shows that the solution to the optimization problem of \displaystyle\underset{\rho_{1},\varphi_{2}}{Min} \displaystyle E[||\Sigma^{*}-\Sigma||^{2}] (4) \displaystyle\textrm{s.t.} \displaystyle\Sigma^{*}=\rho_{1}I+\rho_{2}S where \rho_{1} and \rho_{2} are non-random regularization parameters is \Sigma^{*}=\frac{\beta^{2}}{\delta^{2}}\mu I+\frac{\alpha^{2}}{\delta^{2}}S, (5) and the objective function is: E[||\Sigma^{*}-\Sigma||^{2}]=\frac{\alpha^{2}\beta^{2}}{\delta^{2}}. (6) 8 propose a consistent estimator of \Sigma^{*} , which is independent of the population variance \Sigma and based on a sample of T observations on i.i.d. variables of dimension p arranged in matrix X_{T} . They consider the spectral decomposition of the variance matrix into eigenvectors and eigenvalues: \Sigma_{T}=G_{T}\Lambda_{T}G_{T}^{\prime} where G_{T} is the rotation matrix whose each column is the eigenvectors of \Sigma_{T} and \Lambda_{T} is a diagonal matrix whose elements are the eigenvalues of \Sigma_{T} . Consider Y_{T}=G^{\prime}_{T}X_{T} and let (y^{T}_{11},...,y^{T}_{p1})^{\prime} be the first column of Y_{T} . To define the consistent estimator of \Sigma^{*} , we need the following assumptions: Assumption 1. There exists a constant \kappa_{2} independent of the number of observations such that \frac{1}{p}\sum_{i=1}^{p}E[(y^{T}_{i1})^{8}]\leq\kappa_{2}. Assumption 2. \lim_{T\to\infty}\frac{(p)^{2}}{T^{2}}\times\frac{\sum_{(i,j,k,l)\in Q_{T}}(Cov[y^{T}_{i1}y^{T}_{j1},y^{T}_{k1}y^{T}_{l1}])^{2}}{Card(Q_{T})}=0, Where Q_{T} is a set of all quadruples of distinct integers of 1 to p and Card(Q_{T}) gives the number of elements in the set Q_{T} . Theorem 3.2, 8 : Suppose there exists a constant \kappa_{1}\in[0,\infty) independent of the number of observations T such that \frac{p}{T}\to\kappa_{1} . Then, under Assumptions 1 and 2, the estimator S_{T}^{*}=\frac{b^{2}_{T}}{d^{2}_{T}}m_{T}I+\frac{a^{2}_{T}}{d^{2}_{T}}S_{T}, (7) is a consistent estimator of \Sigma_{T}^{*} ,where: m_{T}=,d^{2}_{T}=||S_{T}-m_{T}I||^{2},a^{2}_{T}=d^{2}_{T}-b^{2}_{T},b^{2}_{T}=min(d^{2}_{T},\bar{b}^{2}_{T}), and: \bar{b}^{2}_{T}=\frac{1}{T^{2}}\sum_{i=1}^{T}||X_{i}X_{i}^{\prime}-S_{T}||^{2} where X_{i} is the ith column of X_{T} of dimension p\times 1 . Note that the proposed estimator S^{*}_{T} is a consistent estimator of \Sigma^{*}_{T} and not of \Sigma . From the above theorem, it follows that S^{*}_{T} is consistent estimator of \Sigma if \frac{p}{T}\to 0 Then, m^{2}_{T}+\text{Var}^{2}\left(\frac{1}{p}\sum_{i=1}^{p}(y_{i1})^{2}\right)\to 0, and the tunning parameter estimators \hat{\rho}_{1,T}=\frac{b^{2}_{T}}{d^{2}_{T}}m_{T} and \hat{\rho}_{2,T}=\frac{a^{2}_{T}}{d^{2}_{T}} tend to deterministic limits \hat{\rho}_{1,T}\rightarrow\rho_{1}=0 and \hat{\rho}_{1,T}\rightarrow\rho_{1}=1 [ 9 Corollary 4.1]. 3 Shrinkage Regularization of the NLSD Test Under the null hypothesis of independence, the framework of 8 can be applied to regularize the NLSD test statistic. Let us assume that all components of the multivariate process \{X_{t}^{a}\},t=1,...T have mean zero or are demeaned. Then, the consecutive observations can be arranged into a matrix X^{a}_{T} of dimension p\times T where p=NK , which replaces matrix X_{T} from Section 2. Then, under the null hypothesis of independence, X^{a}_{T} contains i.i.d observations of dimension p on random variables with mean zero and population variance matrix \Gamma^{a}(0) . Following the approach of 8 and their their generic notation we define: {\Gamma^{a^{*}}(0)}=\rho_{1}I+\rho_{2}{\Gamma^{a}(0)}. Then, based on a sample of size T, we obtain a consistent estimator of {\Gamma^{a^{*}}(0)} and of the tuning parameters: {\hat{\Gamma}^{a^{*}}_{T}(0)}=\hat{\rho}_{1,T}I+\hat{\rho}_{2,T}\hat{\Gamma}^{a}_{T}(0)=\frac{b^{2}_{T}}{d^{2}_{T}}m_{T}I+\frac{a^{2}_{T}}{d^{2}_{T}}\hat{\Gamma}^{a}_{T}(0), (8) where: m_{T}=<\hat{\Gamma}^{a}_{T}(0),I>,d^{2}_{T}=||\hat{\Gamma}_{T}^{a}(0)-m_{T}I||^{2},a^{2}_{T}=d^{2}_{T}-b^{2}_{T},b^{2}_{T}=min(d^{2}_{T},\bar{b}^{2}_{T}), and: \bar{b}^{2}_{T}=\frac{1}{T^{2}}\sum_{i=1}^{T}||X^{a}_{i}X^{a^{\prime}}_{i}-\hat{\Gamma}_{T}^{a}(0)||^{2} with X_{i} being a p\times 1 vector. Definition 1: The shrinkage-regularized NLSD test statistics (SR-NLSD) is \hat{\xi}^{a}_{SR}(H)=T\sum_{h=1}^{H}Tr\hat{R}_{SR}^{2}(h), (9) where \hat{R}_{SR}^{2}(h)=\hat{\Gamma}_{T}^{a}(h){\hat{\Gamma}_{T}^{a^{*}}(0)}^{-1}\hat{\Gamma}_{T}^{a}(h)^{\prime}{\hat{\Gamma}_{T}^{a^{*}}(0)}^{-1} Recall that Theorem 3.2 of 8 implies that \hat{\Gamma}^{a^{*}}_{T}(0) is consistent estimator of \Gamma(0) if \frac{p}{T}\to 0, which includes the case of p=NK large and constant and T\rightarrow\infty , considered in 4 . In that context, the autocovariance estimator maintains its standard asymptotic properties established by e.g. 2 . Then, the tunning parameter estimators \hat{\rho}_{1,T}=\frac{b^{2}_{T}}{d^{2}_{T}}m_{T} and \hat{\rho}_{2,T}=\frac{a^{2}_{T}}{d^{2}_{T}} defined above tend to deterministic limits \hat{\rho}_{1,T}\rightarrow\rho_{1}=0 and \hat{\rho}_{2,T}\rightarrow\rho_{2}=1 Under the Assumptions 1, 2 of 8 , Assumption A.2 of 4 , we have the following result: Proposition 1: If Assumptions 1-2 and A.2 are satisfied and if \hat{\rho}_{1,T}\rightarrow 0 and \hat{\rho}_{2,T}\rightarrow 1 when p is large and T\rightarrow\infty so that \frac{p}{T}\to 0 , then under the null hypothesis of independence, the SR-NLSD test statistic \hat{\xi}^{a}_{SR}(H) has an asymptotic chi-square distribution with a degree of freedom equal to p^{2}H . Proof: Based on Theorem 3.2 of 8 we know that {\hat{\Gamma}_{T}^{a^{*}}(0)} is a consistent estimator of \Gamma^{a^{*}}(0)=\rho_{1}I+\rho_{2}{\Gamma^{a}(0)} which itself is a consistent estimator of \Gamma^{a}(0) when \frac{p}{T}\to 0 . Therefore, the asymptotic distribution follows from the asymptotic equivalence of the SR-NLSD and NLSD test statistics. The test consists in rejecting the null hypothesis of the absence of linear and nonlinear dependence if \hat{\xi}^{a}_{SR}(H)>\chi^{2}_{0.95}(p^{2}H) . 4 Simulation Studies We investigate the empirical size of the NLSD and SR-NLSD tests. We consider two experiments. First, we generate i.i.d observations X_{t} for t=1,..T , where T=100,200,...,1000 and N=2,4,...,20 from a Student’s t -distribution with degrees of freedom equal to 4, 7 and 10 and with variance equal to I_{N} . We consider H=1 and K=2 (level and power of the time series). Each square of Figure 1 plots is obtained by 1000 replications in the Monte Carlo, and in each experiment, we test the absence of linear or nonlinear dependence in the time series. We report the rate at which we reject the null hypothesis in both cases. In the second experiment, we use the same setup, but instead of increasing the number of variables, we increase the number of transformations as K=2,4,...,20 , which includes the powers of time series up to the K and fixed the number of variables N=2 . Figure 2 illustrates the empirical size of the NLSD and SR-NLSD tests for the second experiment. Figures 1 and 2 show that NLSD performs poorly in terms of empirical size in a high-dimensional setting with many variables or transformations. However, SR-NLSD provides an empirical size close to the nominal size. Comparing the SR-NLSD in many variables and many transformations, it is relatively more conservative in the experiment with many transformations. Figure 1 : Empirical Size of NLSD test and SR-NLSD test for many variables N Figure 2 : Empirical Size of NLSD test and SR-NLSD test, many transformations K