Bridging Generalization and Personalization in Wearable Human Activity Recognition via On-Device Few-Shot Learning DOI: XXXXXXX.XXXXXXX CCS: Human-centered computing Interaction design CCS: Human-centered computing

Pixi Kang, Julian Moosmann, Mengxi Liu, Bo Zhou, Michele Magno, Paul Lukowicz, Sizhen Bian · 2025

Read Bridging Generalization and Personalization in Wearable Human Activity Recognition via On-Device Few-Shot Learning DOI: XXXXXXX.XXXXXXX CCS: Human-centered computing Interaction design CCS: Human-centered computing by Pixi Kang, Julian Moosmann, Mengxi Liu, Bo Zhou, Michele Magno, Paul Lukowicz, Sizhen Bian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15413.txt.

Introduction

Pixi Kang and co-authors teach wearable activity trackers to adapt to each wearer with just a few examples, in a 2025 paper. Activity recognition models usually fail on new users because bodies move differently. Their framework first learns a general movement representation across many users. Then, directly on the device, it fine-tunes light classifier layers from a handful of labeled samples from the new wearer.

The team ran the system on an energy-sipping RISC-V microcontroller chip. Across three benchmarks covering gym exercise, hand gestures, and ultrasound gestures, adaptation lifted accuracy by about four, seventeen, and four percentage points. The gains came with minimal computing and memory cost. The authors release the framework openly. They argue on-device few-shot learning makes wearables both personal and practical without cloud help.

Catalog record

CREATORPixi Kang, Julian Moosmann, Mengxi Liu, Bo Zhou, Michele Magno, Paul Lukowicz, Sizhen Bian
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15413

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging Generalization and Personalization in Wearable Human Activity Recognition via On-Device Few-Shot Learning DOI: XXXXXXX.XXXXXXX CCS: Human-centered computing Interaction design CCS: Human-centered computing Pixi Kang, Julian Moosmann, Mengxi Liu, Bo Zhou, Michele Magno, Paul Lukowicz, Sizhen Bian Abstract . Human Activity Recognition (HAR) with wearable devices requires both strong generalization across diverse users and efficient personalization for individuals. However, conventional HAR models often fail to generalize when faced with user-specific variations, leading to degraded performance. To address this challenge, we propose a novel on-device few-shot learning framework that bridges generalization and personalization in wearable HAR. Our method first trains a generalizable representation across users and then rapidly adapts to new users with only a few labeled samples, updating lightweight classifier layers directly on resource-constrained devices. This approach achieves robust on-device learning with minimal computation and memory cost, making it practical for real-world deployment. We implement our framework on the energy-efficient RISC-V GAP9 microcontroller and evaluate it on three benchmark datasets (RecGym, QVAR-Gesture, Ultrasound-Gesture). Across these scenarios, post-deployment adaptation improves accuracy by 3.73%, 17.38%, and 3.70%, respectively. These results demonstrate that few-shot on-device learning enables scalable, user-aware, and energy-efficient wearable human activity recognition by seamlessly uniting generalization and personalization 1 1 1 https://github.com/kangpx/onlineTiny2023 . 1. Introduction Wearable Human Activity Recognition (HAR) plays a crucial role in fitness tracking ( Bian et al. 2019 ) , healthcare monitoring ( Iqbal et al. 2021 ) , and smart assistance systems ( Saleem et al. 2023 ; Singh et al. 2023 ) . These systems rely on a wide range of sensors embedded in consumer devices such as smartwatches, fitness bands, and body-worn nodes to collect time-series data related to movement ( Bian et al. 2025b ) , posture ( Salaorni et al. 2024 ) , and gestures ( Liu et al. 2025 ) . As deep learning methods have grown in popularity, many HAR models have adopted powerful architectures trained on large-scale datasets to generalize across multiple users and contexts ( Hou 2020 ; Ordóñez and Roggen 2016 ) . However, a fundamental limitation remains: models trained on a broad population often underperform when deployed to new individuals ( Mohamed et al. 2024 ; Hokka 2024 ) . This discrepancy is primarily caused by user-induced concept drift (UICD) ( Mathur 2020 ; Bian et al. 2022a ) , where each user exhibits unique behavioral signatures, sensor placements, and body mechanics that deviate from the training distribution. This observation is consistent with recent findings on the scaling laws in HAR ( Hoddes et al. 2025 ) , which show that adding more users to a dataset yields greater performance gains than simply increasing the amount of data per user. As a common result, the accuracy of generalized HAR models degrades significantly in real-world deployments, leading to a poor user experience and limiting the scalability of such solutions ( Hokka 2024 ; Holko et al. 2022 ) . To address this issue, we advocate a two-stage approach: generalize first using full data to build a broadly applicable model, and then personalize rapidly using few-shot learning directly on the device. This strategy offers a path to robust, user-aware inference while respecting hardware limitations and privacy constraints. We focus on enabling such adaptation on resource-constrained microcontrollers, specifically using the RISC-V GAP9 platform, and evaluate the solution with RecGym ( Bian et al. 2022b ) , a dataset that combines Inertial Measurement Unit (IMU) and human body capacitance (HBC) signals to capture diverse gym activity patterns. This work makes the following key contributions: • We quantify the impact of user-induced concept drift in wearable HAR across three representative scenarios. Using the RecGym, QVAR, and Ultra datasets, we observe accuracy drops of 0.74%, 25.89%, and 6.00%, respectively, when generalizing to unseen users. • We propose an efficient few-shot on-device learning strategy that updates only the dense classifier layer using streaming samples from the target user, allowing rapid personalization with minimal memory overhead. • We implement a real-time on-device training engine optimized for the GAP9 microcontroller, enabling adaptation with a latency of sub-ms and energy consumption of \mu J-level per parameter update. • We demonstrate that our hybrid approach improves average recognition accuracy post-deployment by 3.73% (RecGym), 17.38% (QVAR), and 3.70% (Ultra), validating its robustness and effectiveness across diverse sensing modalities and activity types. 2. Related Work Sensor-based human activity recognition (HAR) has primarily relied on inertial measurement units (IMUs) and camera-based methods ( Hou 2020 ; Ordóñez and Roggen 2016 ) , which offer rich information but face challenges such as accumulated drift, occlusion, and privacy concerns. Novel sensing modalities such as radar ( Zhou et al. 2024 ) , ultrasound ( Ling et al. 2022 ) , and electrostatic charge variation sensors ( Reinschmidt et al. 2022 ) have been proposed to enhance robustness, but these systems remain sensitive to inter-user variability and often require heavy preprocessing or domain-specific model design. To tackle user-induced concept drift (UICD), transfer learning and meta-learning approaches have been explored. Works such as ( Mathur 2020 ; An et al. 2023 ) apply domain adaptation techniques to bridge the gap between training and deployment users, but these methods typically assume access to labeled data during retraining and lack practical on-device implementations. Other studies like ( Craighero et al. 2023 ; Llisterri Giménez et al. 2022 ) investigate on-device adaptation using MCUs, but they either focus on simplified HAR scenarios or limit training to very constrained models, affecting final accuracy. Few-shot adaptation has emerged as a promising paradigm to address personalization under low-resource settings. Solutions like TinyOL ( Ren et al. 2021 ) and DaCapo ( Khan et al. 2023 ) enable continuous learning on microcontrollers but are primarily validated on vision or speech tasks. In ( Ravaglia et al. 2021 ) , a continual learning framework using quantized latent replay is proposed, yet the method requires additional memory for buffer storage and is not evaluated on real-time wearable applications. From a hardware perspective, platforms like STM32, MAX78000 ( Devices 2023 ) , and GAP9 ( Bian et al. 2022b ) offer increasing support for AI workloads, including CNN accelerators and parallel compute clusters. However, few efforts combine hardware-efficient deployment with real-time adaptation tailored to sensor-based HAR. In summary, while prior work has laid the foundation for model personalization and on-device learning, gaps remain in implementing efficient on-device adaptation pipelines for wearable HAR, and quantifying the trade-offs between generalization, personalization, and energy-latency efficiency in realistic settings. Our work addresses these limitations by demonstrating an end-to-end system for few-shot on-device user adaptation. 3. Methodology 3.1. Network Design We employ a lightweight yet effective 1D Convolutional Neural Network (1D-CNN) tailored for multi-channel time-series data typical in wearable HAR. The model is structured in two distinct parts: a fixed feature extractor (backbone) and a trainable dense classifier for personalization. The backbone begins with a 1D convolutional layer, followed by batch normalization, a ReLU activation, and dropout. This is succeeded by three residual blocks, each containing convolutional layers with shortcut connections to retain temporal information while reducing gradient vanishing. The output is then flattened and passed into the classifier. The classifier is a single dense layer followed by a softmax activation. During on-device adaptation, only this layer is

Read the complete text