New Confidence Regions for Linear Regression Parameters with Stationary–Ergodic Dependent Errors Journal: Journal of Statistical Planning and Inference

Mous-Abou Hamadou, Martial Longla, Mathias Nthiani Muia, Mahmud Hasan · 2026

Read New Confidence Regions for Linear Regression Parameters with Stationary–Ergodic Dependent Errors Journal: Journal of Statistical Planning and Inference by Mous-Abou Hamadou, Martial Longla, Mathias Nthiani Muia, Mahmud Hasan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20634.txt.

Introduction

Mous-Abou Hamadou and three colleagues build joint confidence regions for linear regression when errors depend over time in a steady, ergodic way. Their method applies random smoothing with an extra sample and shrinking bandwidth to regression and second-moment stats. That yields Wald regions and joint intervals without directly estimating long-run variance or assuming a dependence model. Simulations show near-nominal coverage and region sizes that rival Newey-West methods.

Catalog record

CREATORMous-Abou Hamadou, Martial Longla, Mathias Nthiani Muia, Mahmud Hasan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77626
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20634

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

New Confidence Regions for Linear Regression Parameters with Stationary–Ergodic Dependent Errors Journal: Journal of Statistical Planning and Inference Mous-Abou Hamadou, Martial Longla, Mathias Nthiani Muia, Mahmud Hasan Abstract We develop joint confidence regions for linear regression coefficients when the regressors and errors are jointly stationary and ergodic with unspecified serial dependence. The method applies random smoothing, using an independent auxiliary sample and shrinking bandwidth, to a vector of regression and second-moment statistics. Under stationarity, ergodicity, and finite second moments, the estimator is asymptotically normal and yields Wald confidence regions and simultaneous confidence intervals without direct long-run variance estimation or a parametric dependence model. For implementation, we introduce a scaled estimator with data-driven bandwidth selection and a mild truncation that improves finite-sample stability. Simulations under ARMA, ARFIMA, copula-based Markov errors, and fractional Gaussian noise, with Gaussian and heavy-tailed margins, show near-nominal coverage and competitive region volumes relative to Newey–West HAC and MAC. A winter Beijing PM 2.5 application illustrates the procedure. 1 Introduction Constructing joint confidence regions for regression coefficients under serial dependence remains challenging when the dependence structure is not specified. A large part of the literature addresses this problem through estimation of the long-run covariance matrix, followed by Wald-type inference. This is the basis of heteroskedasticity and autocorrelation consistent methods, including the estimators of 11 , the general kernel-and-bandwidth framework of 1 , and automatic bandwidth selection in 12 . These procedures are standard, broadly applicable, and often effective in practice, but their finite-sample performance in joint inference can be sensitive to the tuning choices involved in long-run covariance estimation, particularly under persistent dependence or at moderate sample sizes. Other approaches reduce or avoid direct long-run variance estimation. Fixed- b asymptotics replace the classical small-bandwidth framework with a different limiting theory (see 6 ). Self-normalized methods use recursive normalizers and lead to asymptotically pivotal statistics under broad weak dependence conditions (see 16 ). Resampling methods for dependent data, including block bootstrap schemes, provide another flexible class of procedures (see Kunsch (1989), 8 ; 13 ). Recent work has continued to refine robust inference in dependent regression environments. 5 study predictive regressions under persistence, heavy tails, and heterogeneously persistent volatility, while 2 show that OLS-HAC regression can fail for several distinct reasons in dynamic time-series settings namely because OLS coefficients may be inconsistent, autocorrelation can make OLS estimation and prediction inefficient, and standard HAC covariance estimators may be poorly suited to the autoregressive dependence patterns that often arise in practice, leading to substantial size distortions and low power. These contributions broaden the available inferential tools and highlight the continuing need for procedures that remain reliable when the serial dependence structure is not specified. The problem is more delicate when dependence is strong. In regression models with long-memory errors, much of the theory has been developed under parametric or semiparametric descriptions of the serial dependence. 17 ; 18 established asymptotic results for least squares estimation with long-memory stationary errors. 14 studied time-series regression when long-range dependence may be present in both the errors and the regressors. 7 proposed confidence intervals for long-memory regressions based on corrected covariance calculations. This literature provides important theoretical guidance and useful procedures, but it also shows that inference under dependence often relies on modeling or estimating key features of the serial structure. This paper develops confidence regions for linear regression coefficients without imposing a parametric model on the error process or directly estimating the long-run covariance matrix. The approach extends the random-smoothing technique introduced by 10 for inference on the mean of a stationary ergodic sequence. Their estimator integrates the observed sample with an independent auxiliary sample, applying kernel weights driven by a shrinking bandwidth. Under stationarity, ergodicity, and finite second moments, the procedure yields asymptotic normality without recourse to a long-run variance estimator. To adapt the method to regression, the coefficient vector is re-expressed through a finite collection of regression moments. This reformulation reduces the problem to joint inference on a multivariate moment vector. The multivariate asymptotic results developed in this paper establish normality and confidence regions for this vector, which are then transferred to the regression coefficients via a smooth transformation. Several refinements are required for practical implementation. Although the direct form of the smoothed estimator is convenient for the asymptotic theory, its leading mean-squared-error expansion does not admit a standard interior optimum, which precludes conventional bandwidth selection. A scaled variant is therefore introduced that restores a tractable bias–variance tradeoff and supports a data-driven bandwidth rule. Since the regression coefficients are obtained via a nonlinear transformation of the estimated moments, near-singularity in the design matrix can produce finite-sample instability; a mild truncation is incorporated to stabilize the procedure, and its asymptotic impact is shown to be negligible. Finally, the bandwidth construction combines a short-memory rule with an adaptive component designed to accommodate stronger serial persistence. Finite-sample performance is examined under several specified serial dependence models for the errors, including ARMA, ARFIMA, copula-based Markov models, and fractional Gaussian noise, with both Gaussian and heavy-tailed margins. The proposed method is compared with Newey–West HAC inference and the MAC procedure used in the simulation study. The comparison focuses on coverage and region size across settings representing both weak and persistent dependence. We also illustrate the method with a regression analysis of winter Beijing PM 2.5 concentrations on weather covariates in the presence of dependent residuals. 1.1 Structure of the paper Section 2 develops the multivariate random-smoothing result on which the analysis is built. Section 3 applies that result to inference for the regression coefficients. Section 4 turns to implementation, including the scaled estimator, bandwidth selection, and truncation. Section 5 reports the simulation study, and Section 6 presents the Beijing PM 2.5 application. Section 7 concludes and proofs of results are provided in Appendix A. 2 Random smoothing for moment vectors This section studies joint inference for a population moment vector, and the resulting theory is then carried over to the regression setting. We use X_{n}\Rightarrow X for convergence in distribution, X_{n}\xrightarrow{P}X for convergence in probability, and X_{n}\xrightarrow{\mathrm{a.s.}}X for almost sure convergence. For a vector y , y^{\top} denotes transpose and \|y\| the Euclidean norm. For a square matrix A , \lambda_{\max}(A) denotes its largest eigenvalue. 2.1 A multivariate random-smoothed estimator Let s\in\mathbb{N} and \mathbf{Y}=(Y_{i})_{i\in\mathbb{Z}} be a sequence of random vectors in \mathbb{R}^{s} , where Y_{i}=(Y_{1i},\dots,Y_{si})^{\top} . Let (X_{i})_{i\in\mathbb{N}} be an i.i.d. sequence independent of \mathbf{Y} , with bounded density f continuous at 0 and f(0)>0 . Let K be a symmetric bounded density function, and (h_{n})_{n\in\mathbb{N}} a sequence of positive bandwidths. Let \overline{\mathbf{Y}}_{n}=\frac{1}{n}\sum_{i=1}^{n}Y_{i} and assume: (C1) \mathbf{Y} is stationary with \mathbb{E}\|Y_{1}\|^{2}<\infty . (C2) h_{n}\to 0 and nh_{n}\to\infty as n\to\infty . (C3) nh_{n}\lambda_{\max}\left(\operatorname{Cov}\left(\bar{\mathbf{Y}}_{n}\right)\right)\to 0 as n\to\infty . Let \mu_{Y}=\mathbb{E}[Y_{1}] denote the mean vector of Y_{1} . We define \widehat{r}_{n}=(\widehat{r}_{n1},\ldots,\widehat{r}_{ns})^{\top},\quad\widehat{r}_{nk}=\frac{1}{n\,\mathbb{E}[K(X_{1}/h_{n})]}\sum_{i=1}^{n}Y_{ki}\,K\!\left(\frac{X_{i}}{h_{n}}\right),\quad k=1,\dots,s. (1) Following 10 , each component \widehat{r}_{nk} is mean-square consistent for \mu_{Y,k} . This implies consistency in the Total Mean Squared Error (TMSE) sense: \mathrm{TMSE}(\widehat{r}_{n}):=\mathbb{E}\|\widehat{r}_{n}-\mu_{Y}\|^{2}=\sum_{k=1}^{s}\mathrm{MSE}(\widehat{r}_{nk})\longrightarrow 0,\quad\text{as }n\to\infty. (2) For q\geq 1 and m\geq 1 , define c_{q}(K)=\int K^{q}(u)\,du>0\quad\text{and}\quad d_{m}(K)=\int u^{m}K(u)\,du. (3) The following lemma gives the first-order covariance expansion of \widehat{r}_{n} . Lemma 2.1 . Assume (C1) – (C3) and c_{2}(K)<\infty . Then there exists a sequence of s\times s matrices (R_{n})_{n\geq 1} such that \operatorname{Var}(\widehat{r}_{n})=\frac{c_{2}(K)}{nh_{n}f(0)}\,\mathbb{E}\big(Y_{1}Y_{1}^{\top}\big)+R_{n}. (4) and,

Read the complete text