Nonparametric Regression and Error Covariance Function Estimation - Beyond Short-Range Dependence

Sisheng Liu, Xiaoli Kong · 2025

Read Nonparametric Regression and Error Covariance Function Estimation - Beyond Short-Range Dependence by Sisheng Liu, Xiaoli Kong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19071.txt.

Introduction

Sisheng Liu and Xiaoli Kong tackle a quiet flaw in curve fitting: the errors are often correlated, and ignoring that fact wrecks the usual ways of picking a smoothing width. When the correlation fades slowly instead of dying fast, the standard toolkit runs out. The authors design a special family of kernel functions for this long-memory setting and build a width-choosing procedure on local linear fitting.

They also give a way to estimate the error covariance curve itself, backed by theory. In simulations, both the fitted curve and the covariance estimate improved markedly under slow-decay correlation, the regime that used to break the methods. Three real datasets, covering heart disease deaths, life expectancy, and bowel cancer deaths in the American Southeast, show the procedure at work.

Catalog record

CREATORSisheng Liu, Xiaoli Kong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-19071

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nonparametric Regression and Error Covariance Function Estimation - Beyond Short-Range Dependence Sisheng Liu, Xiaoli Kong Abstract In nonparametric regression analysis, errors are possibly correlated in practice, and neglecting error correlation can undermine most bandwidth selection methods. When no prior knowledge or parametric form of the correlation structure is available in the random design setting, this issue has primarily been studied in the context of short-range dependent errors. When the data exhibits correlations that decay much more slowly, we introduce a special class of kernel functions and propose a procedure for selecting bandwidth in kernel-based nonparametric regression, using local linear regression as an example. Additionally, we provide a nonparametric estimate of the error covariance function, supported by theoretical results. Our simulations demonstrate significant improvements in estimating the nonparametric regression and error covariance functions, particularly in scenarios beyond short-range dependence. The practical application of our procedure is illustrated through the analysis of three datasets: cardiovascular disease mortality, life expectancy, and colon and rectum cancer mortality in the Southeastern United States. Publication type: Article Type Journal: Journal Volume: 00 keywords Nonparametric regression, Correlated errors, Bandwidth, Covariance estimation, Short-range, Disease mapping † † copyright-year: 2023 † † startpage: 1 † † titlemark: PLEASE INSERT YOUR ARTICLE TITLE HERE † † corresponding: Corresponding author Sisheng Liu, MOE-LCSM, School of Mathematics and Statistics, Hunan Normal University, Changsha, Hunan 410081, P. R. China. Liu and Kong \presentaddress [email protected] † † footnotetext: Abbreviations: ANA, anti-nuclear antibodies; APC, antigen-presenting cells; IRF, interferon regulatory factor. 1 Introduction Assume that we observe random samples (\boldsymbol{X}_{i},Y_{i}) for i=1,\ldots,n , where Y_{i} takes values in \mathbb{R} and \boldsymbol{X}_{i}=(X_{i1},\ldots,X_{iD})^{T} takes values in \mathcal{X}\subset\mathbb{R}^{D} with a common probability density f . The density f is compactly supported, bounded and continuous with f(\boldsymbol{x})>0 for all \boldsymbol{x}\in\mathcal{X} . Consider the model: Y_{i}=\mu(\boldsymbol{X}_{i})+\varepsilon_{i},\ \text{ for }i=1,..,n, (1) where \mu is an unknown smooth (at least twice continuously differentiable) regression function and the \varepsilon_{i} ’s are unobserved random errors such that \mbox{\rm E}(\varepsilon_{i}|\boldsymbol{X}_{i})=0,\ \mbox{\rm Cov}(\varepsilon_{i},\varepsilon_{j}|\boldsymbol{X}_{i},\boldsymbol{X}_{j})=\sigma^{2}\rho_{n}(\|\boldsymbol{X}_{i}-\boldsymbol{X}_{j}\|),\ \text{for }i,j\in\{1,\ldots,n\}, with \sigma^{2}<\infty and \rho_{n} a stationary correlation function satisfying \rho_{n}(0)=1 and \mathinner{\!\left\lvert\rho_{n}(\|\boldsymbol{x}_{i}-\boldsymbol{x}_{j}\|)\right\rvert}\leq 1 for all \boldsymbol{x}_{i},\boldsymbol{x}_{j}\in\mathcal{X} . Kernel-based nonparametric regression methods usually require an appropriate bandwidth to estimate the regression function. However, bandwidth selection methods developed under the assumption of independent and identically distributed (i.i.d.) errors tend to break down in the presence of correlated errors. This problem has been widely studied, see the review paper of Opsomer et al. ? . When prior knowledge or parametric form of the correlation structure is available or assumed, many bandwidth selection methods have been developed, for example, difference-based time series cross-validation ? , plug-in bandwidth selection for AR(1) error process ? , modified generalized cross-validation method for spatial data ? , far casting cross-validation ? and generalied correlated cross-validation ? , etc. There are a few methods that have been developed to bypass the estimation of the error correlation structure. Most of them are based on a bimodal kernel function to mitigate the effect of error correlation e.g. ? ? . These methods are restricted to one-dimensional, equal-distance, fixed designs. Brabanter et al ? first applied the bimodal kernel to remove the error correlation structures in local polynomial regression with random design. Recently, Liu and Yang ? and Kong et al ? adopted the bimodal kernel for both nonparametric regression function and derivativative estimation. Although the bimodal kernel can mitigate the impact of error correlation on bandwidth selection, it is effective only for short-range dependence. The major motivation of our article comes from the Global Health Data Exchange , which records a variety of disease data by different counties in the United States (and also other countries). These data sets can be useful for analyzing the spatial distribution of various type of disease for the interests of the epidemiologist, including the Cardiovascular Mortality Rates data , the Life Expectancy Data , the Cancer Mortality Rates data etc. All these datasets conform to model ( 1 ), where the two-dimensional random vector \boldsymbol{X}_{i} represents the latitude and longitude of each county. Figure 1 (a) illustrates the Cardiovascular Mortality Rates in the Southeastern United States at the year 2014, displaying a clear nonlinear trend in mortality rates, which indicate that a nonparametric fit would be appropriate. In addition, we applied local linear regression with bandwidth chosen via generalized cross-validation and then used the residuals to compute the empirical error covariance. Figure 1 (b) plots the empirical error covariance against the distances, revealing that errors may exhibit strong dependence. In Section 5 , we will demonstrate that the bimodal kernel function fails to mitigate the impact of error correlation on bandwidth selection in the motivated example. Moreover, another two data examples — the Life Expectancy and the Colon & Rectum cancer mortality rate, will be present in the Supplementary file. (a) Raw data (b) Empirical Covariance Figure 1: The left panel is the cardiovascular disease mortality rates of 1064 counties in the southeastern United States in the year 2014. The right panel is the empirical covariance versus the distance ( \times 10^{2} km). In this paper, we introduce a new class of kernel functions and propose a procedure for selecting bandwidth in kernel-based regression. We use local linear regression as an example. Under mild conditions, it is shown that the selected bandwidth is asymptotically optimal in the sense of minimizing the Mean Integrated Square Error. The proposed selection procedure performs better for more complex correlation structures and remains effective for short-range dependent errors. While the proposed bandwidth selection procedure does not require knowing the correlation structure, the estimation of the error covariance function has numerous potential applications, including but not limited to its use in kernel ridge regression with incorporated error covariance ? , tuning parameter selection in derivative estimation ? , and in real data applications where the correlation structure reflects relationships among various observed times/locations, such as our motivated examples. However, most nonparametric estimations of the error covariance function rely on assumptions of fixed equally spaced designs, m -dependence, strong mixing with exponential decay rate, auto-regression ? ? ? ? ? ? . In random design settings, the methods proposed by Hall et al ? and Choi et al ? , do not assume a nonparametric form of the regression function. Our second contribution in this paper is the development of nonparametric estimations for the error covariance function in random design using kernel smoothing. We investigate the theoretical properties of the estimation without assuming any covariance structure. Our proposed methodology has the potential for both methodological and scientific applications. The paper is structured as follows. Section 2 describes basic assumptions on the error correlation. We then introduce the new class of kernel functions and demonstrate the procedure for bandwidth selection using local linear regression. The estimation of the error covariance function is introduced and studied in Section 3 . In Section 4 , we evaluate the performance of our method through simulation studies. Section 5 is dedicated to a real-data application. Potential directions for future research are discussed in Section 6 . Most of the key theoretical results are included in the Appendix and all proofs, additional simulation results and applications are given in the Supplementary file. 2 Bandwidth Selection 2.1 Method and theoretical properties

Read the complete text