Dynamic Prediction of High-density Generalized Functional Data with Fast Generalized Functional Principal Component Analysis

Ying Jin, Andrew Leroux · 2024

Read Dynamic Prediction of High-density Generalized Functional Data with Fast Generalized Functional Principal Component Analysis by Ying Jin, Andrew Leroux (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-02014.txt.

Introduction

Jin and Leroux build a fast way to guess next states from dense past reads. Next-state guesses from past logs are a chief aim in med work. Big sets with dense reads and tied webs strain stock ways. Cost in time and sums makes those ways fail at scale. More, most ways can't guess for new hosts with no re-fit. Their base is a fast chief-part read for spread-fam data.

That base, fGFPCA, reads bent webs in such data at pace. The new way runs on a plain desk or lap host with ease. It makes bent, true next-path guesses for the read hosts. New-host guesses come with no new fits in the frame. A fake-data test in the work checks the way's force.

Catalog record

CREATORYing Jin, Andrew Leroux
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-02014

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamic Prediction of High-density Generalized Functional Data with Fast Generalized Functional Principal Component Analysis Ying Jin, Andrew Leroux Abstract Dynamic prediction, which typically refers to the prediction of future outcomes using historical records, is often of interest in biomedical research. For datasets with large sample sizes, high measurement density, and complex correlation structures, traditional methods based on Generalized Linear Mixed Models are often infeasible because of the computational burden associated with both data size and model complexity. Moreover, many implementations of mixed-effects models do not directly facilitate out-of-sample predictions for generalized outcomes. To address these issues, we develop a novel approach for dynamic predictions based on a recently developed method estimating complex patterns of variation for exponential family data: fast Generalized Functional Principal Components Analysis (fGFPCA). Our method is able to handle large-scale, high-density repeated measures much more efficiently than existing methods, with its implementation feasible even on personal computational resources (e.g., a standard desktop or laptop computer). The proposed method makes highly flexible and accurate predictions of future trajectories for data that exhibit high degrees of nonlinearity, and allows for out-of-sample predictions to be obtained without reestimating any parameters. A simulation study is designed and implemented to illustrate the advantages of this method. To demonstrate its practical utility, we also conducted a case study to predict diurnal active/inactive patterns using accelerometry data from the National Health and Nutrition Examination Survey (NHANES) 2011-2014. Both the simulation study and the data application demonstrate the better predictive performance and high computational efficiency of the proposed method compared to existing methods. The proposed method also obtains more personalized prediction that improves as more information becomes available, which is an essential goal of dynamic prediction that other methods fail to achieve. Keywords Functional data, Dynamic prediction, Repeated measures, Computational efficiency 1 Introduction Biomedical investigators are often interested in predicting future observations of subjects based on their historical data, where we hope to make predictions that are both 1) individualized; and 2) improves as new information is collected. Such problems are typically termed dynamic prediction. The two desirable properties of these methods are important to support timely clinical decision-making that is customized to each unique individual. Examples of such problems include predicting the change in certain biomarkers over time [ 18 ] , predicting the future status of physical activity using historical data collected by wearable devices, predicting the development of lesion based on imaging data, et cetera. Traditionally, this type of data has been referred to as “repeated measures” and modeled either marginally, such as generalized estimating equations, or conditionally on specific subjects, such as mixed-effect models [ 6 , 17 , 23 , 24 ] . Subject-specific predictions are often made based on the correlation between repeated measures from the same subject. Examples include Rizopoulos [29] , which makes predictions by fitting a generalized linear mixed model (GLMM) and approximates the posterior distribution of parameters of interest with a multivariate normal distribution and their posterior mean. It adopts the Monte Carlo scheme to efficiently approximate the posterior likelihood. Moreover, such repeated measures are often modeled together with a time-to-event outcome to predict the risk of an event, which is updated with the value of repeated measures [ 30 , 33 ] . Popular model frameworks include joint models and landmarking. The former specifies a joint distribution of the repeated measure and the time-to-event outcome. Random effects are typically introduced to model repeated measures and/or introduce correlation between multiple series of repeated measures. The latter estimates models and makes predictions conditioning on a series of “landmark” times, although these models typically use time-dependent fixed effects alone for prediction and do not include random effects. [ 35 , 28 ] However, with the notable exception of Leroux et al. [18] , existing methods are either limited in their flexibility (both fixed and random effect structures, e.g. random slope and intercept), computationally unfeasible for large datasets, or both. Moreover, when the repeated measure is non-Gaussian, out-of-sample prediction often requires reestimating part or all of the model parameters, which adds to the computational burden. These issues are particularly acute for densely measured data, as the computational burden increases substantially with increased data size and measurement density, motivating investigators to look for more efficient methods. A statistical framework well-suited for high-density data with complex association structures is known as Functional Data Analysis (FDA) [ 5 , 26 ] , which conceptualizes high-density repeated measures as the discrete realization of a continuous latent process or a continuous function measured with error. To better explain and illustrate the methodological framework of the FDA, we use data from the National Health and Nutrition Examination Survey (NHANES) as a motivational example throughout this manuscript. The NHANES data from 2011-2014 includes minute-level physical activities collected with wearable activity monitors, which were then dichotomized into binary activity indicators. Figure 1(a) shows the data of six participants. The black dots indicate the activity status of each minute, with 1 indicating active and 0 inactive. The measurement grid is very dense with 1440 repeated measures over one day. The red lines are the estimated probability curves derived from the observed outcomes, which are interpreted as the latent process that specifies the distribution of outcomes at each minute. As the figure reveals, these diurnal trends (and hence, latent functions) are highly nonlinear. Moreover, there is substantial heterogeneity between individuals, which cannot be fully explained using participant characteristics modeled as fixed effects, with unexplained variation continuing to exhibit a high degree of nonlinearity. Methodology for estimating functional regression models with subject-specific random effects has focused primarily on continuous/Gaussian outcomes, often modeling subject-specific random effects with Functional Principal Component Analysis (FPCA) [ 4 , 9 , 31 , 16 ] . Existing methods often use partial observations for prediction with an intercept-only model. Leroux et al. [18] proposed the Functional Concurrent Regression (FCR) framework, which can incorporate the effect of subject-specific predictors, accompanied by an R package fcr [ 19 ] . Delaigle and Hall [7] achieved similar goals using Markov Chains to model the transition between discrete realizations of a continuous function, though the model it proposed did not include random effects. Software and methods for non-Gaussian functional data are currently even more limited. Software is largely limited to the refund [ 12 ] and registr [ 37 ] packages in the statistical software R, both developed based on the Generalized Functional Principal Component Analysis (GFPCA) framework. Functional regression models of non-Gaussian outcomes have also been proposed. Chen et al. [3] proposed approaches to fit marginal functional models that are compatible with multilevel generalized outcomes, although marginal approaches are not suitable for making subject-specific dynamic predictions. Gertheiss et al. [8] identified the distinction between marginal and conditional estimates and pointed out that directly applying a marginal method (e.g. single-level FPCA) to conditional estimation could cause bias. It also proposed to address this problem using a two-stage joint estimation strategy. Goldsmith et al. [11] proposed estimating parameters with Bayesian method in Stan , but the model framework only takes into account the fixed effect of time-invariant covariates. van der Linde [34] used an adapted Bayesian variational algorithm for FPCA of binary and count data. However, most of these methods

Read the complete text