Difference-Based High-Dimensional Long-Run Covariance Matrix Estimation for Mean-shift Time Series

Yanhong Liu, Fengyi Song, Long Feng · 2026

Read Difference-Based High-Dimensional Long-Run Covariance Matrix Estimation for Mean-shift Time Series by Yanhong Liu, Fengyi Song, Long Feng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17226.txt.

Introduction

Liu, Song, and Feng estimate long run covariance matrices for high dimensional time series whose means shift over time. Standard estimators can be badly biased when the mean is not constant. Their fix starts with a difference based estimator that resists a broad class of mean changes. They then apply hard thresholding, soft thresholding, and tapering to get sparse estimators. They derive convergence rates that show how sparsity, mean change, dimension, and sample size all enter. In tests, the methods did well in high dimensions.

Catalog record

CREATORYanhong Liu, Fengyi Song, Long Feng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE110571
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.17226

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Difference-Based High-Dimensional Long-Run Covariance Matrix Estimation for Mean-shift Time Series Yanhong Liu, Fengyi Song, Long Feng Abstract We consider estimation of high-dimensional long-run covariance matrices for time series with nonconstant means, a setting in which conventional estimators can be severely biased. To address this difficulty, we propose a difference-based initial estimator that is robust to a broad class of mean variations, and combine it with hard thresholding, soft thresholding, and tapering to obtain sparse long-run covariance estimators for high-dimensional data. We derive convergence rates for the resulting estimators under general temporal dependence and time-varying mean structures, showing explicitly how the rates depend on covariance sparsity, mean variation, dimension, and sample size. Numerical experiments show that the proposed methods perform favorably in high dimensions, especially when the mean evolves over time. Keywords: difference-based estimator; long-run covariance matrix; high dimension; thresholding; max-norm convergence; nonstationary mean. 1 Introduction Let \{\bm{X}_{t}\}_{t=1}^{n} be a p -dimensional time series. A fundamental second-order object in time series analysis is the long-run covariance matrix \mathbf{V}:=\sum_{k=-\infty}^{\infty}\mathbf{\Gamma}_{k},\ \mathbf{\Gamma}_{k}:=\mathrm{Cov}(\bm{Z}_{0},\bm{Z}_{k}), where \{\bm{Z}_{t}\} denotes the latent stationary noise component. When the spectral density matrix f_{\bm{Z}}(\omega) exists, \mathbf{V}=2\pi f_{\bm{Z}}(0) , so \mathbf{V} is precisely the zero-frequency summary of temporal dependence. This matrix plays a central role in statistical inference for temporally dependent data, including inference for sample means and linear contrasts, change-point analysis, trend inference, simultaneous confidence bands, and many other procedures driven by partial sums or temporally aggregated quantities ( 23 ; 1 ; 10 ; 11 ) . In low-dimensional settings, long-run variance or long-run covariance estimation has been extensively studied through heteroskedasticity and autocorrelation consistent (HAC) estimators and related kernel or bandwidth-based procedures ( 23 ; 1 ) . Classical HAC methodology is typically developed under the implicit premise that the observed series can be globally centered without materially distorting the serial dependence structure. This paradigm is adequate when the mean is stable, but it can break down when the data contain smooth trends, abrupt level shifts, or multiple change points. In such settings, naive centering may contaminate sample autocovariances, thereby leading to seriously biased long-run variance estimates. To overcome this difficulty, 10 and 11 developed mean-structure-robust, difference-based estimators that remain valid under unknown trends and even a possibly divergent number of breaks. However, that literature is essentially low-dimensional and does not address the additional regularization required when the ambient dimension p is comparable to or much larger than the sample size n . Meanwhile, the high-dimensional covariance literature has largely evolved from the i.i.d. setting. It is now well understood that the sample covariance matrix is no longer a reliable estimator when p is large relative to n , which has led to a rich body of work on regularized covariance estimation. Representative examples include hard thresholding ( 4 ) , generalized thresholding and shrinkage ( 29 ) , adaptive thresholding ( 5 ) , and tapering-based estimators ( 6 ) . These methods exploit sparsity or approximate sparsity of the target covariance matrix and have become standard tools in modern high-dimensional inference. However, they are designed primarily for contemporaneous covariance matrices under independence, and therefore do not directly address the cumulative serial dependence encoded in \mathbf{V} . A growing literature extends high-dimensional second-order estimation to temporally dependent observations, but the main target in that line of work is still the contemporaneous covariance matrix \mathbf{\Sigma}=\mathrm{Cov}(\bm{Z}_{t}) or its inverse, rather than the long-run covariance matrix \mathbf{V} . For example, 12 established rates for thresholded covariance and graphical-Lasso-type precision matrix estimation for high-dimensional stationary and locally stationary time series under functional dependence conditions. 30 further developed generalized thresholding and precision matrix estimation for temporally dependent observations, allowing slowly decaying dependence and long memory through autocorrelation-based dependence summaries. Under heavy tails and mild moments, 36 studied robust estimation of means, covariance matrices and precision matrices for high-dimensional time series. Although these papers substantially broaden the scope of high-dimensional covariance analysis under dependence, their inferential target remains \mathbf{\Sigma} or \mathbf{\Sigma}^{-1} rather than the long-run covariance matrix needed for inference on temporal aggregates. Related frequency-domain work considers high-dimensional spectral density matrices and their inverses. 32 proposed thresholded estimators for large spectral density matrices of Gaussian and linear processes. 16 developed non-asymptotic theory for smoothed periodogram estimation and sparse inverse spectral density estimation. For locally stationary processes, 35 derived a systematic asymptotic theory for covariance and spectral density estimation in high dimensions. These papers are highly relevant because the spectral density matrix is the frequency-domain analogue of the covariance structure. Nevertheless, they do not directly solve the problem considered here, namely, estimating a sparse long-run covariance matrix in the time domain when the observed series may contain nonconstant and unknown mean structures. There is also a more recent line of work that comes closer to the present problem by directly targeting zero-frequency or long-memory objects. In particular, 2 developed thresholded and penalized local Whittle estimators for high-dimensional long-run variance and precision matrices under short- and long-range dependence, and 37 studied joint estimation of multiple precision matrices for long-memory time series. These contributions demonstrate that high-dimensional long-run second-order estimation is both statistically meaningful and technically challenging. However, the existing methods in this direction are mainly formulated in the frequency domain under stationary models, whereas many applications in econometrics, finance, environmental studies, and neuroscience involve unknown trends, structural breaks, or other nonstationary mean dynamics. This creates a genuine methodological gap between mean-robust long-run variance estimation in classical time series and sparse regularization in modern high-dimensional statistics. The goal of this paper is to fill this gap. We study difference-based high-dimensional long-run covariance matrix estimation for multivariate time series. Our starting point is a difference-based pilot estimator motivated by 11 , which is intrinsically robust to a broad class of mean structures. We then combine this pilot estimator with three regularization schemes that are standard in high-dimensional covariance estimation, namely, hard thresholding, soft thresholding, and tapering. In this way, we bridge two strands of literature that have largely developed separately: on the one hand, mean-structure-robust long-run variance estimation for dependent data; on the other hand, sparse matrix regularization for high-dimensional covariance estimation. The proposed framework has several attractive features. First, by using difference statistics instead of global centering, it remains stable when the observed series contains smooth mean variation or abrupt mean changes. Second, the subsequent regularization step exploits sparsity of the long-run covariance matrix and therefore adapts naturally to high-dimensional regimes. Third, our methodology is entirely time-domain, making it conceptually simple and computationally convenient, while still targeting the quantity that is directly relevant for inference based on partial sums and sample averages. From a theoretical perspective, we establish convergence properties for the hard-thresholded, soft-thresholded, and tapered estimators under suitable dependence and sparsity conditions. From a numerical perspective, our simulation results show that these procedures perform well in genuinely high-dimensional settings and remain effective when the mean structure is nonconstant, where classical HAC-type estimators can deteriorate substantially. The rest of the paper is organized as follows. Section 2 introduces the difference-based oracle and feasible long-run covariance estimators and the three regularization schemes. We also establishes the main concentration and convergence results. Section 3 reports simulation studies under both constant and nonconstant mean structures. In Section 4 , we apply

Read the complete text