M-estimation for Gaussian processes with time-inhomogeneous drifts from high-frequency data

Yasutaka SHIMIZU · 2025

Read M-estimation for Gaussian processes with time-inhomogeneous drifts from high-frequency data by Yasutaka SHIMIZU (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01164.txt.

Introduction

Yasutaka Shimizu proposes a way to fit models to noisy data that arrive very fast, in a 2025 statistics paper. The data come from a Gaussian process, a random curve whose drift changes over time. Standard fitting can require flipping very large matrices, which is slow. Shimizu instead builds a local contrast score from pairs of nearby steps, so no large matrix flip is needed.

He proves the estimates settle on the true values and follow a normal curve as data pile up. One part of the fit converges at an unusual rate, tied to how the drift curve can be summed. When the local score cannot pin down every setting, moment-based fixes restore the missing grip. The method suits high-frequency records with a drift that shifts over time.

Catalog record

CREATORYasutaka SHIMIZU
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE125 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01164

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

M-estimation for Gaussian processes with time-inhomogeneous drifts from high-frequency data Yasutaka SHIMIZU Abstract We propose a contrast-based estimation method for Gaussian processes with time-inhomogeneous drifts, observed under high-frequency sampling. The process is modeled as the sum of a deterministic drift function and a stationary Gaussian component with a parametric kernel. Our method constructs a local contrast function from adjacent increments, which avoids inversion of large covariance matrices and allows for efficient computation. We prove consistency and asymptotic normality of the resulting estimators under general ergodicity conditions. A distinctive feature of our approach is that the drift estimator attains a nonstandard convergence rate, stemming from the direct Riemann integrability of the drift density. This highlights a fundamental difference from standard estimation regimes. Furthermore, when the local contrast fails to identify all parameters in the covariance kernel, moment-based corrections can be incorporated to recover identifiability. The proposed framework is simple, flexible, and particularly well suited for high-frequency inference with time-inhomogeneous structure. Keywords: Gaussian processes, high-frequency data, time-inhomogeneous drift, contrast-based estimation, method of moments MSC2010: 62M10 ; 62F12, 60G15. 1 Introduction Gaussian processes (GPs) are powerful tools for probabilistic modeling and forecasting of time-evolving phenomena. Their nonparametric nature and built-in uncertainty quantification make them well-suited for modeling irregular or noisy data without assuming a specific functional form. For these reasons, GPs are widely used in applications ranging from machine learning to time series analysis. A central task in Gaussian process modeling is the estimation of structural parameters from discrete observations. In particular, time series data often exhibit both deterministic long-term trends and stochastic short-term fluctuations. This motivates models that combine a time-inhomogeneous drift with a stationary Gaussian process. Such models naturally arise in settings such as mortality forecasting and environmental statistics, where gradual trends are superimposed with random variation. We consider the following stochastic process X=(X_{t})_{t\geq 0} on a probability space (\Omega,\mathcal{F},\mathbb{P}) : X_{t}=Z_{t}+\int_{0}^{t}\mu(s)\,\mathrm{d}s,\quad t>0, where \mu:[0,\infty)\to\mathbb{R} is a deterministic function, and Z=(Z_{t})_{t\geq 0} is a Gaussian process defined as follows. Definition 1.1 . A stochastic process Z=(Z_{t})_{t\geq 0} is called a Gaussian process if and only if any finite-dimensional distribution is multivariate Gaussian: for any t_{1},\dots,t_{d}>0 , there exist a mean vector m\in\mathbb{R}^{d} and a positive definite d\times d matrix \Sigma such that (Z_{t_{1}},Z_{t_{2}},\dots,Z_{t_{d}})\sim N_{d}(m,\Sigma), where N_{d}(m,\Sigma) denotes the d -dimensional normal distribution with mean m and covariance matrix \Sigma . Definition 1.2 . A Gaussian process Z is said to be stationary if there exists a function K:[0,\infty)\to\mathbb{R} such that \mathbb{E}[Z_{t}Z_{s}]=K(|t-s|),\quad t,s\geq 0. That is, the covariance between Z_{t} and Z_{s} depends only on their time lag. The function K is called the kernel function. Moreover, Z is said to be centered if the mean function m(t):=\mathbb{E}[Z_{t}] is identically zero. A stationary Gaussian process is fully characterized by its kernel function, which governs properties such as smoothness and temporal dependence. Accurate estimation of the kernel parameters is crucial for model performance, and has been widely studied; see Rasmussen and Williams [ 17 ] for a comprehensive reference. Two of the most widely used approaches for parameter estimation in GP models are Maximum Likelihood Estimation (MLE) and Maximum A Posteriori (MAP) estimation. The MAP method incorporates prior information by maximizing the posterior density, while MLE relies solely on the marginal likelihood. Since n observations from a GP follow an n\times n multivariate normal distribution, both methods require construction and inversion of the n\times n covariance matrix. These steps incur computational costs of O(n^{2}) and O(n^{3}) , respectively, and become infeasible for large n or high-frequency data. Furthermore, as noted by Karvonen et al. [ 10 ] , MLE may suffer from ill-posedness in near-deterministic or noise-free settings. To address the computational and statistical challenges of MLE in such regimes, a variety of approximate methods have been proposed. Minden et al. [ 15 ] developed recursive skeletonization factorizations to accelerate MLE for spatial GPs. Composite likelihood estimation (CLE), developed by Cox and Reid [ 4 ] , Davis and Yau [ 5 ] , and Varin et al. [ 21 ] , constructs contrast functions based on low-dimensional marginals. Bennedsen et al. [ 2 ] apply CLE to high-frequency Gaussian processes by combining q -dimensional marginal densities (typically q=3 ), which avoids full matrix inversion but still requires repeated inversion of q\times q covariance matrices. An alternative class of methods uses frequency-domain approximations. Whittle [ 22 ] proposed likelihood in the frequency domain, now known as the Whittle likelihood , for stationary Gaussian processes, which reduces computational complexity to O(n\log n) . Building on this idea, Fukasawa and Takabatake [ 8 ] developed a high-frequency extension of the Whittle likelihood that achieves asymptotic efficiency for self-similar stationary Gaussian noise. Takabatake [ 19 ] further extended this framework to models driven by fractional Brownian motion with stochastic drift, constructing a quasi-Whittle likelihood estimator and proving consistency and asymptotic normality. A different line of work, exemplified by Kobayashi et al. [ 12 ] , focuses on rigorous continuous-time likelihood inference. They investigated the “exact MLE” of the drift parameter based on continuous-time likelihood, establishing the LAN property of the likelihood, and further analyzed its discretization under high-frequency sampling, proving asymptotic efficiency. In contrast to the above methods, our approach originates from pseudo-likelihood techniques for stochastic differential equations (SDEs); see Kessler [ 11 ] . We construct a contrast-based estimator from local increments of the observed process. The contrast function depends only on scalar conditional variances and does not require matrix inversion. This yields simple estimating equations that are both computationally efficient and theoretically tractable under high-frequency sampling. Interestingly, this setting also leads to a nonstandard convergence rate for the drift estimator, which arises from the direct Riemann integrability (DRI) inherent in the ergodic structure of the process. Moreover, our framework directly handles time-dependent drift functions, unlike most spectral-domain methods which require prior detrending. The key distinction from CLE lies in the information structure. CLE aggregates multiple lagged values within each block, exploiting high-order correlations. Our method, by contrast, uses only second-order local differences. Although this minimal structure may lead to identifiability issues for some parameters in the kernel, such issues can be addressed by incorporating moment-based corrections. We assume a smooth parametric kernel function to facilitate theoretical analysis. However, our method is also applicable to processes with nonsmooth kernels, such as the Ornstein-Uhlenbeck kernel, which is not differentiable at the origin. In such cases, the kernel can be approximated by a family of smooth kernels constructed via mollification. This mollified approximation enables the application of our framework to a broader class of Gaussian processes. See Subsection 4.2 for an illustrative example. Beyond the specific estimators considered, the asymptotic theory developed in this paper—some limit theorems including uniform laws of large numbers under high-frequency sampling—offers fundamental tools for future methodological developments. In particular, these results may serve as a foundation for hybrid procedures combining time- and frequency-domain techniques, or for investigating the asymptotic efficiency of more general contrast-based methods. Our method has the following advantages: • No matrix inversion is required: The contrast depends only on scalar variances, avoiding the computational burden of full MLE or CLE. • Theoretically justified under general ergodic Gaussian processes: Consistency and asymptotic normality are established without assuming Markovianity or spectral

Read the complete text