Gaussian quasi-likelihood analysis for non-Gaussian linear mixed-effects model with system noise
Takumi Imamura, Hiroki Masuda · 2024
Read Gaussian quasi-likelihood analysis for non-Gaussian linear mixed-effects model with system noise by Takumi Imamura, Hiroki Masuda (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00796.txt.
Introduction
Takumi Imamura and Hiroki Masuda work out the math of a statistical method for mixed-effects models driven by rough noise. Such models track many subjects, each with its own traits, plus a shared system noise that does not follow the classic bell shape. Sampling can be uneven across subjects, which adds to the difficulty.
The authors prove key traits of a shortcut score that pretends the noise is bell-shaped, even when it is not. Their estimator settles into a bell-shaped spread as the subject count grows, and its error tails can be bounded. A three-stage version reaches the same first-order result with distinct fine detail. Computer runs back the theory.
Catalog record
| CREATOR | Takumi Imamura, Hiroki Masuda |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-00796
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Gaussian quasi-likelihood analysis for non-Gaussian linear mixed-effects model with system noise Takumi Imamura, Hiroki Masuda Abstract . We consider statistical inference for a class of mixed-effects models with a system noise described by a non-Gaussian integrated Ornstein-Uhlenbeck process. Under the asymptotics where the number of individuals goes to infinity with possibly unbalanced sampling frequency across individuals, we prove some theoretical properties of the Gaussian quasi-likelihood function, followed by the asymptotic normality and the tail-probability estimate of the associated estimator. In addition to the joint inference, we propose and investigate the three-stage inference strategy, revealing that they are first-order equivalent while quantitatively different in the second-order terms. Numerical experiments are given to illustrate the theoretical results. 1. Introduction 1.1. Background and motivation This paper aims to develop a statistical inference theory for a class of models used in longitudinal data analysis. Longitudinal data are repeated measurements or observations taken over time for multiple individuals; for example, in HIV research, the CD4 lymphocyte count and the HIV viral load. In these longitudinal data analyzes, our objective is to infer or evaluate changes over time in the mean structure of the response variable, the effects of covariates on the response variable, and the within-individual correlations of the response variable. Theoretically, by fitting a normal distribution through targeting only the mean and covariance structures of the random dynamics, our primary focus is to propose an explicit and easy-to-use estimation method, and to derive its theoretical properties. When longitudinal data are measured or collected prospectively, the time points at which the data will be measured are usually set in advance. However, due to reasons such as dropout from the longitudinal study, not all individuals are necessarily measured at all planned time points. In such cases, the number of measurements may vary between individuals and the measurement intervals within and between individuals may also vary. Such is called the “unbalanced” data set. As a traditional approach to handling the unbalanced data set, linear mixed-effects (LME) models [ 10 ] are frequently used. As an alternative approach, LME models with a Gaussian integrated Ornstein-Uhlenbeck (OU) process as the system noise are proposed in [ 20 ] ; see also [ 6 ] . A special feature of this model is that we can estimate the degree of derivative tracking from longitudinal data [ 3 ] . We consider that the trajectory of each individual tends to follow a linear path. In that case, the model is said to have strong derivative tracking (i.e., a LME model in which explanatory variables for fixed and random effects include time variables). On the other hand, if the slope of each individual’s trajectory tends to change continuously, the model is said to have weak derivative tracking. See [ 20 ] for more details on the derivative tracking. The previous study [ 7 ] showed the local asymptotic normality and the optimality of a local maximum-likelihood estimator for a class of Gaussian LME models with the integrated OU process as the system noise. Although the classical LME models are usually applied under the Gaussianity of the random effect and the measurement error, there have been some studies about model misspecification of the random effect in the context of (generalized) LME models, e.g. [ 15 ] and [ 16 ] . Furthermore, the previous study [ 2 ] suggested through simulations and case studies that using models that include non-Gaussian system-noise can lead to reliable inferences about fixed-effect parameters. Based on these previous studies, it will be practically useful to develop a theory of inference that does not require the assumption that the random-effect, the measurement error, and the system-noise are Gaussian. In such cases where Gaussianity is not assumed, it is important to consider what type of likelihood function should be used to make statistical inferences. While an ideal likelihood function can be derived from empirical evidence and data characteristics, such a specification is not always feasible. In such cases, it is preferable to employ a simple yet distributionally robust likelihood function that retains theoretical validity even under model misspecification. As a simple likelihood function, we consider an estimation methodology using the Gaussian quasi-likelihood random function (GQLF). If the estimator obtained from the GQLF exhibits desirable asymptotic behavior (e.g. consistency and asymptotic normality), it is expected that analysts can make statistical inferences without using a complex likelihood function; this is exactly the primary objective of this paper. For the driving Lévy process, we will only impose some moment conditions without specifying any distributional class, so that the proposed method can apply to a wide range of models. In this paper, we consider a class of LME models with the possibly non-Gaussian integrated Lévy-driven OU process as the system noise. On the one hand, as in [ 20 ] , thanks to the continuous-time framework, this framework allows us to smoothly handle unbalanced longitudinal data sets in a unified manner; this nice feature cannot hold for the discrete-time first-order autoregressive structure. On the other hand, by adding the integrated OU process term, the Gaussian quasi-likelihood function becomes nonlinear for parameters associated with the OU process, raising concern about the large computational load of simultaneous optimizations for parameter estimates [ 7 ] . To mitigate this problem, we propose a three-stage stepwise inference strategy in which the mean and covariance structures are optimized separately and alternately. By splitting the target parameters, it is expected that the computational load will be reduced compared to simultaneous optimization. In our main result, we will show the very strong mode of convergence of the quasi-likelihood-ratio random field, namely, not only the weak convergence (locally asymptotically quadratic property) and uniform tail-probability estimate. To the best of our knowledge, within the class of LME models, there has been no previous study that compared joint likelihood inference with stepwise likelihood inference in terms of computational load and theoretical properties. 1.2. Setup and objective Suppose that we are given a longitudinal data set from i th individual at given time points 0=t_{i0}<t_{i1}<\dots<t_{in_{i}} , described by \displaystyle Y_{i}(t_{ij}) \displaystyle=X_{i}(t_{ij})^{\top}\beta+Z_{i}(t_{ij})^{\top}b_{i}+W_{i}(t_{ij})+\epsilon_{i}(t_{ij}) (1.1) for 1\leq i\leq N and 1\leq j\leq n_{i} , where \top denotes the transposition of a matrix and \max_{i\leq N}n_{i}=O(1). (1.2) Here and in what follows, the asymptotics are taken for N\to\infty . We will use the generic convention \xi_{ij}=\xi_{i}(t_{ij}) , so that ( 1.1 ) becomes Y_{ij}=X_{ij}^{\top}\beta+Z_{ij}^{\top}b_{i}+W_{ij}+\epsilon_{ij}. (1.3) The ingredients are specified as follows. • X_{ij}\in\mathbb{R}^{p_{\beta}} and Z_{ij}\in\mathbb{R}^{p_{b}} denote non-random explanatory variables for fixed and random effects of the i th individual, respectively, such that \sup_{N}\max_{i\leq N}\left(|X_{i}|+|Z_{i}|\right)<\infty, where, with a slight abuse of notation, X_{i}:=(X_{ij})_{j=1}^{n_{i}}\in\mathbb{R}^{n_{i}}\otimes\mathbb{R}^{p_{\beta}} and Z_{i}:=(Z_{ij})_{j=1}^{n_{i}}\in\mathbb{R}^{n_{i}}\otimes\mathbb{R}^{p_{b}} , and |\cdot| denotes the Euclidean norm. • \beta\in\mathbb{R}^{p_{\beta}} is the unknown fixed-effect parameter, which is common across the individuals. • Let b_{1},b_{2},\dots be unobserved random-effects that are i.i.d. zero-mean random variables in \mathbb{R}^{p_{b}} with common nonnegative-definite covariance matrix \Psi(\gamma) for some function \Psi:\,\mathbb{R}^{\gamma}\to\mathbb{R}^{p_{b}}\otimes\mathbb{R}^{p_{b}} . – We do not fully specify the common distribution \mathcal{L}(b_{1}) . For a specific form of \Psi(\gamma) , one may adopt the unstructured setting where all the entries of \Psi(\gamma) are fully unknown. However, it may suffer from computational issues caused by the high dimensionality of the parameters. • The stochastic process W_{i}(\cdot) represents an unobserved random system-noise process driving