Two-Stage Representation Learning for Analyzing Movement Behavior Dynamics in People Living with Dementia

Jin Cui, Alexander Capstick, Payam Barnaghi, Gregory Scott · 2025

Read Two-Stage Representation Learning for Analyzing Movement Behavior Dynamics in People Living with Dementia by Jin Cui, Alexander Capstick, Payam Barnaghi, Gregory Scott (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09173.txt.

Introduction

Jin Cui, Alexander Capstick, Payam Barnaghi, and Gregory Scott published this health data paper in 2025. It analyzes movement and activity data recorded in the homes of people living with dementia. Such high-frequency records are rich but hard to read. The authors propose a two-stage, self-supervised learning method that squeezes the data into a compact form that keeps the meaningful patterns.

In the first stage, activity sequences are turned into text-like strings and encoded by a pre-trained language model. A PageRank-based step then extracts a low-rank summary of how one activity state follows another. That summary supports clustering and transition analysis. The patterns it revealed lined up with clinical scores of cognitive function. The authors say the approach could support predicting cognitive status, tailoring care, and monitoring many patients at scale.

Catalog record

CREATORJin Cui, Alexander Capstick, Payam Barnaghi, Gregory Scott
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09173

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Two-Stage Representation Learning for Analyzing Movement Behavior Dynamics in People Living with Dementia Jin Cui, Alexander Capstick, Payam Barnaghi, Gregory Scott Abstract In remote healthcare monitoring, time series representation learning reveals critical patient behavior patterns from high-frequency data. This study analyzes home activity data from individuals living with dementia by proposing a two-stage, self-supervised learning approach tailored to uncover low-rank structures. The first stage converts time-series activities into text sequences encoded by a pre-trained language model, providing a rich, high-dimensional representation. In the second stage, these vectors are transformed into a low-dimensional latent state space using a PageRank-based method. This PageRank vector captures latent state transitions, effectively compressing complex behavior data into a succinct form that enhances model interpretability. This low-rank representation not only enhances interpretability but also facilitates clustering and transition analysis, revealing key behavioral patterns correlated with clinical metrics such as MMSE and ADAS-Cog scores. Our findings demonstrate the framework’s potential in supporting cognitive status prediction, personalized care interventions, and large-scale health monitoring. 1 Imperial College London 2 UK Dementia Research Institute, Care Research and Technology Centre Introduction In remote healthcare monitoring applications, the use of wearables and Internet of Things (IoT) devices to continuously collect time-series data, as is shown in Figure 1 , often with second-level accuracy or finer, has become increasingly common. However, the sheer scale of such data makes it difficult for human experts to analyze or use directly, necessitating the use of time-series deep learning techniques for effective analysis and diagnosis. Figure 1: Example Home layout with IOT sensors for monitoring behavioral patterns of People Living with Dementia Training on large volumes of unlabeled time-series data poses a significant challenge. Semi-supervised and unsupervised methods are typically employed to encode and extract data features for downstream tasks like classification or regression, demonstrating their ability to capture deep features. Semi-supervised methods, such as nearest neighbor contrastive learning and temporal relation prediction, efficiently utilize both labeled and unlabeled data, improving the quality of representations for downstream tasks like classification ( Kim et al. 2024 ; Fan et al. 2021 ) . Unsupervised methods focus on learning robust representations without relying on labels, often leveraging contrastive learning techniques and innovative data augmentations to capture key temporal patterns ( Franceschi, Dieuleveut, and Jaggi 2019 ; Lee, Kim, and Son 2024 ) . Attention mechanisms and domain-adaptive techniques further enhance the interpretability of encoded features, aligning them more closely with human intuition and domain-specific insights ( Lyu et al. 2018 ) . However, this strategy faces two challenges: first, labeling criteria for time-series data is often vague, which can significantly impact model performance; second, the encoded data remain vast, unintuitive, and difficult to interpret ( Ye and Ma 2023 ; Hill et al. 2022 ) . In this work, we focus on time-series data characterized by irregular discrete values. Extending the methods introduced in ( Capstick et al. 2024 ) , we present preliminary results of a second-order representation learning method designed to aid in clustering, identifying similar clinical cases, and uncover patients’ interpretable behavioral patterns. This is achieved through a large language model encoding combined with a two-dimensional vectors representation and transfer pattern analysis. Our Contribution We propose an integrated approach for discovering latent states of activity. This method comprises several key steps: 1. Temporal Data Preprocessing : The raw temporal data is first preprocessed to remove noise and standardize the data for consistency. 2. Language Model Encoding : A language model is trained on our dataset to encode the preprocessed temporal data into high-dimensional vector representations. To enhance the model’s learning capability, we perform pseudo labeling using one-hot similarity. This allows the model to better capture temporal dependencies and patterns in the data. 3. Dimensionality Reduction and Clustering : To visualize the high-dimensional embeddings, we apply dimensionality reduction techniques such as t-SNE to project the data into a 2D space. Clustering algorithms are then used to identify distinct latent states within the data. 4. Transition Pattern Analysis with PageRank : By defining a transition matrix between these low-rank latent states, we use the PageRank algorithm to analyze transition patterns. This approach compresses complex temporal data into interpretable, low-rank state vectors, allowing us to determine the influence and significance of each state within the transition graph and provide insights into patient behavior dynamics. This analytical framework will aid in the clinical diagnosis of patients and support the development of personalized care programs. The availability of dataset and code for this work is discussed in appendix. Related Work Time-series forecasting is primarily to predict future values based on previously observed data points. Traditional statistical methods, most notably the Autoregressive Integrated Moving Average (ARIMA) model, have long been utilized due to their mathematical simplicity and flexibility in application ( Rizvi 2024 ; Kontopoulou et al. 2023 ) . While ARIMA remains a staple for scenarios where data exhibits linear patterns, recent developments in machine learning have introduced sophisticated models capable of capturing non-linear dependencies, thus offering potential improvements in forecasting accuracy and robustness ( Masini, Medeiros, and Mendes 2023 ; Rhanoui et al. 2019 ) . The advent of the Generative Pre-trained Transformer (GPT) by OpenAI marked a significant milestone in the field of natural language processing ( Brown et al. 2020 ) , catalyzing a wave of innovations in large language models (LLMs). Large Language Models (LLMs) have profoundly transformed natural language processing and are increasingly being considered for diverse applications beyond text, such as time series data analysis. The study by ( Bian et al. 2024 ) presents a framework that adapts LLMs for time-series representation learning by conceiving time-series forecasting as a multi-patch prediction task, introducing a patch-wise decoding layer that enhances temporal sequence learning. Similarly, ( Liu et al. 2024 ) propose a model which leverages the autoregressive capabilities of LLMs for time series forecasting. In Capstick et al. (2024) , the authors apply a GPT-based text encoder to string representations of in-home activity data to enable vector searching and clustering. Using a secondary modelling stage, we extend these ideas to enable further analysis and interpretability. PageRank, originally developed to rank web pages, is an algorithm designed to assess the importance of nodes within a directed graph by analyzing the structure of links within networks ( Page et al. 1999 ) . While it was initially created for search engines, its application has since expanded across various disciplines. For instance, in biological networks, ( Iván and Grolmusz 2011 ) employed personalized PageRank to analyze protein interaction networks, providing scalable and robust techniques for interpreting complex biological data. Similarly, ( Bánky, Iván, and Grolmusz 2013 ) introduced an innovative adaptation of PageRank for metabolic graphs. This cross-disciplinary application of PageRank highlights its potential for analyzing complex systems beyond its original domain. Methods Mathematical Foundations of the Model Given a discrete data sample \mathbf{X}=\{x_{1},x_{2},\dots,x_{n}\} , the following steps describe the transformation process: 1. Sampling and Text Conversion: Each sample x_{i} is converted into a text representation T(x_{i}) . 2. Language Model Encoding: A pre-trained language model f_{\text{LM}} is applied to obtain high-dimensional vector embeddings for the text data: \mathbf{h}_{i}=f_{\text{LM}}(T(x_{i})),\quad\mathbf{h}_{i}\in\mathbb{R}^{d}. 3. Dimensionality Reduction: The high-dimensional embeddings are projected into a 2D space using a dimensionality reduction method \Phi ,

Read the complete text