Beyond the mean: Sequence analysis methods for clustering ordinal EMA data

Tianyi Wang, Anna L. Smith, Jillian R. Silva-Jones, Wendy Berry Mendes, Lauren N. Whitehurst · 2026

Read Beyond the mean: Sequence analysis methods for clustering ordinal EMA data by Tianyi Wang, Anna L. Smith, Jillian R. Silva-Jones, Wendy Berry Mendes, Lauren N. Whitehurst (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23834.txt.

Introduction

Wang and colleagues move beyond averages for ordinal momentary assessment data, the repeated real-time ratings used in health studies. They borrow sequence measures that capture each person's pattern over time. Then they cluster with principal components plus K-means to find hidden groups with similar profiles. Tests on fake data beat latent-class rivals. On real stress ratings the groups sharpen links to test scores.

Catalog record

CREATORTianyi Wang, Anna L. Smith, Jillian R. Silva-Jones, Wendy Berry Mendes, Lauren N. Whitehurst
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66027
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23834

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond the mean: Sequence analysis methods for clustering ordinal EMA data Tianyi Wang, Anna L. Smith, Jillian R. Silva-Jones, Wendy Berry Mendes, Lauren N. Whitehurst Abstract Ecological momentary assessment (EMA) ratings are widely used in studies of behavioral and psychological phenomena to capture real-time data in subjects’ real-world environments. Because the data are collected repeatedly over the study period, they provide rich longitudinal rating profiles for each individual. However, the number of observations per subject is often large, while both sample size and sampling intensity can vary substantially across individuals, which complicates the analysis. In some settings, simplified summaries of individual profiles, such as averages computed across the study period, are used for downstream analyses, including regression-style modeling. Although such summaries can be convenient, they may fail to fully capture dynamic temporal patterns present in the complete longitudinal profiles. To address this, we borrow measures from sequence analysis that capture individual-level patterns over time and then applied principal component analysis (PCA) followed by K K -means clustering to identify unobserved latent groups of individuals with similar profiles. We test our approach using simulated data from a categorical functional regression model and compare its performance with two commonly used methods for detecting unobserved group structures: latent class analysis (LCA), and latent transition analysis (LTA). Using EMA stress observations from a large sample of U.S. adults [ 36 , 35 ] , we identify distinct latent stress profile groups and show that they improve characterization of the impact on cognitive performance. 1 Introduction Research studies across various fields, such as psychology, healthcare, and the social sciences, are leveraging ecological momentary assessment (EMA) methods, which data are collected under real-world environments to record study participants’ behaviors, feelings, and experiences in real-time, within the natural context of their daily lives [ 47 , 38 , 5 , e.g.,] . This approach helps minimize recall bias and allows for the study of small-time-scale processes that may influence behavior in real-world environments [ 46 ] . EMA data are often collected via electronic devices, such as mobile phone apps, at regularly scheduled intervals, and can include physiological sensors (e.g., heart rate, blood pressure) as well as self-report survey questions. As in traditional surveys, many measurements of interest are collected as categorical or ordinal (e.g., Likert-style) variables. For example, (nominal) categorical response data can capture demographic information (e.g., race, gender, education), emotional states, or insurance status, while ordinal response scales can measure pain levels (e.g., 1 to 10), customer satisfaction, or perceived daily stress (e.g., 1 to 5), as we will discuss in detail below. As a result of EMA data collection, researchers now have access to fine-scale longitudinal ordinal data, which can provide detailed insights into how these measures evolve and influence study outcomes over time. Beyond characterizing general longitudinal trends, researchers are often interested in clustering individuals who exhibit similar patterns over time. For the motivating study we discuss below, there are competing theories in the literature regarding how individuals experience stress over time. This evidence of natural clustering in individual stress profiles motivates us to consider whether EMA-collected daily stress ratings can be clustered into groups of individuals who exhibit similar patterns over time and whether these clusters are associated with a key study outcome, cognitive performance on a test of declarative memory. In the statistics literature, methods for analyzing fine-scale variation over time, called functional data analysis [ 51 ] , have focused on continuous outcomes, although methods to accommodate categorical responses are being actively developed [ 40 ] . 47 summarized a variety of modeling approaches that have been used to analyze EMA data. Depending on the purpose of the study and the structure of the data, it is not always necessary to include time as a covariate in the model, even when EMA data are collected at specific time points during the study period. For between-subjects analyses collected at predefined time points and analyzed using statistical methods such as Pearson correlation across individuals, the variables are typically assumed to be continuous outcomes, hence these methods are not suitable for ordinal or categorical variables. In addition, some studies focus on comparing event-related effects rather than between-subject differences. Analyses in these contexts often rely on event-based methods, typically within case-control designs. Analytical approaches for such designs include generalized estimating equations (GEE) [ 54 ] , dependent t-tests, and survival analysis, which are not designed for studies that do not include a control group. To investigate relationships involving both main effects and interactions among covariates, point process models can be employed. For example, thinned inhomogeneous Poisson processes are well-suited for sparse event data and allow modeling of event intensity over time. While useful for estimating event rates, they are unsuitable for repeated measures data and cannot capture latent population structures. More flexible approaches, such as population-averaged (PA) and subject-specific (SS) models, offer improvements: PA models estimate marginal effects across the population, while SS models account for within-subject variation using random effects. However, both assume a homogeneous population and cannot uncover latent subgroups. As an alternative, we borrow tools from sequence analysis which are explicitly designed to study longitudinal categorical data and were originally proposed by biologists to study patterns in DNA sequences [ 1 ] . We group individuals with similar stress patterns via principal components analysis (PCA) of our sequence analysis measures, and apply K -means clustering algorithms [ 10 , 24 , 13 ] . As a result, our approach uses tools that are familiar and accessible to many data scientists and applied researchers, while effectively leveraging relevant information from high-frequency EMA data. To validate our approach, we demonstrate that it can recover cluster memberships accurately and is more stable than alternative naïve clustering approaches, including latent class analysis (LCA) and latent transition analysis (LTA), across simulated data from a sophisticated categorical functional data model. For our motivating study, we examine whether our estimated clusters describe distinct stress patterns and compare how well stress cluster membership predicts cognitive performance in a binomial mixed-effects model, relative to reasonable alternative predictor variables: (1) overall mean stress (averaging over time), (2) a selection of (correlated) stress summary statistics (e.g., the mean, standard deviation, mode, measures from the sequence analysis and categorical time series literature), and (3) PCA loadings for the stress summary statistics. We also discuss how to choose the number of principal components, the number of clusters, and examine an alternative clustering algorithm that allows for overlap among the estimated clusters. The paper is structured as follows: Section 2 introduces the motivating study, provides theoretical background on stress and its potential health links, and the MyBPLab 2.0 dataset 36 , 35 . Section 3 discusses the mixed-effects modeling framework within the MyBPLab setting and introduces two common approaches for uncovering unobserved latent groups, namely LCA and LTA. Section 4 describes relevant tools from sequence analysis and presents our PCA-based approach. Section 5 applies the PCA-based method to simulated data under four settings and compares its performance to LCA and LTA. Section 6 presents the results of five mixed-effects models applied to the MyBPLab data and compares their performance. Finally, Section 7 discusses limitations of our approach and outlines directions for future research. 2 Motivating

Read the complete text