TinierHAR: Towards Ultra-Lightweight Deep Learning Models for Efficient Human Activity Recognition on Edge Devices CCS: Human-centered computing Ubiquitous computing CCS: Computing methodologies Artificial intelligence CCS: Computer systems organization Embedded hardware CCS: Computing methodologies

Sizhen Bian, Mengxi Liu, Vitor Fortes Rey, Daniel Geissler, Paul Lukowicz · 2025

Read TinierHAR: Towards Ultra-Lightweight Deep Learning Models for Efficient Human Activity Recognition on Edge Devices CCS: Human-centered computing Ubiquitous computing CCS: Computing methodologies Artificial intelligence CCS: Computer systems organization Embedded hardware CCS: Computing methodologies by Sizhen Bian, Mengxi Liu, Vitor Fortes Rey, Daniel Geissler, Paul Lukowicz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07949.txt.

Introduction

Sizhen Bian and co-authors shrank activity-recognition models for wearables in this 2025 paper. A watch or band must spot walking, sitting, and other actions on tiny hardware, so the model must be small yet accurate. Their design, TinierHAR, mixes slim convolutions with memory units and a time-averaging step. Across fourteen public data sets, it kept the average accuracy of bigger rivals.

Against its predecessor it used 2.7 times fewer parameters and 6.4 times fewer operations; against a classic deep model the savings ran far larger. The team also ran the first careful part-by-part study across all three models, showing what each piece contributes. They close with design rules for future tiny recognizers and release everything for others to benchmark.

Catalog record

CREATORSizhen Bian, Mengxi Liu, Vitor Fortes Rey, Daniel Geissler, Paul Lukowicz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-07949

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TinierHAR: Towards Ultra-Lightweight Deep Learning Models for Efficient Human Activity Recognition on Edge Devices CCS: Human-centered computing Ubiquitous computing CCS: Computing methodologies Artificial intelligence CCS: Computer systems organization Embedded hardware CCS: Computing methodologies Online learning settings Sizhen Bian, Mengxi Liu, Vitor Fortes Rey, Daniel Geissler, Paul Lukowicz Abstract . Human Activity Recognition (HAR) on resource-constrained wearable devices demands inference models that harmonize accuracy with computational efficiency. This paper introduces TinierHAR, an ultra-lightweight deep learning architecture that synergizes residual depthwise separable convolutions, gated recurrent units (GRUs), and temporal aggregation to achieve SOTA efficiency without compromising performance. Evaluated across 14 public HAR datasets, TinierHAR reduces Parameters by 2.7× (vs. TinyHAR) and 43.3× (vs. DeepConvLSTM), and MACs by 6.4× and 58.6×, respectively, while maintaining the averaged F1-scores. Beyond quantitative gains, this work provides the first systematic ablation study dissecting the contributions of spatial-temporal components across proposed TinierHAR, prior SOTA TinyHAR, and the classical DeepConvLSTM, offering actionable insights for designing efficient HAR systems. We finally discussed the findings and suggested principled design guidelines for future efficient HAR. To catalyze edge-HAR research, we open-source all materials in this work for future benchmarking 1 1 1 https://github.com/zhaxidele/TinierHAR . 1. Introduction Human Activity Recognition (HAR) has emerged as a cornerstone technology for enabling context-aware applications in fields like healthcare ( Serpush et al. 2022 ; Luder et al. 2024 ; Amft et al. 2020 ) , fitness tracking ( Phukan et al. 2022 ; Bian et al. 2019 ) , smart environments ( Igwe et al. 2022 ) , and assistive robotics ( Fiorini et al. 2021 ; Liu et al. 2022 ) . By inferring human activities from sensor data captured via wearable or embedded devices, HAR systems empower real-time decision-making ( Xu and Qiu 2021 ; Bonazzi et al. 2024 ) , personalized interventions ( Mhalla and Favreau 2024 ; Kang et al. 2024 ) , and enhanced user experiences ( Zhang et al. 2022 ; Bian and Lukowicz 2021b ) . However, deploying HAR models on resource-constrained edge devices introduces a critical challenge: achieving high recognition accuracy while adhering to stringent computational, memory, and energy constraints ( Muhoza et al. 2023 ) . Traditional deep learning architectures, though accurate, often prove infeasible for on-device inference due to their excessive parameter counts and computational demands ( Ronald et al. 2021 ) . Conversely, overly simplified models risk sacrificing performance, limiting their practical utility in real-world scenarios ( Bian and Lukowicz 2021a ) . Recent advancements in lightweight HAR neural architectures, such as TinyHAR ( Zhou et al. 2022 ) and MLPHAR ( Zhou et al. 2024 ) , have sought to address the trade-off of computational demands and inference performance by optimizing model efficiency. Yet, we noticed that there is still a large volume to further push the envelope of resource usage while synergistically maintaining or even enhancing modeling. This work introduces TinierHAR, an ultra-lightweight architecture designed to achieve state-of-the-art efficiency without compromising accuracy for HAR. Building on the synergized residual depthwise separable convolutions (to capture hierarchical sensor signal patterns with minimal parameters), gated recurrent units (to efficiently encode sequential dependencies), and temporal aggregation (to reduce redundancy in temporal feature maps), TinierHAR optimizes spatial-temporal feature learning while significantly minimizing computational overhead. We evaluate TinierHAR on 14 publicly available HAR datasets, representing the largest scale evaluation of its kind to date, encompassing a wide range of sensor modalities, activity categories, and application domains. Compared to TinyHAR and DeepConvLSTM, TinierHAR achieves an average reduction in model size by 2.7× and 43.3×, respectively, and reduces multiply-accumulate operations (MACs) by 6.4× and 58.6×, while matching their average F1-scores. Beyond these quantitative gains, we also contribute: (1) a comprehensive ablation study to dissect the impact of each architectural component across the three models; (2) a systematic scaling analysis to explore the scaling laws in aspect of model size for HAR applications; and (3), an in-depth discussion about the findings based on the quantitative result and future directions. We hope that such takeaways could offer actionable insights for designing future efficient HAR systems. Figure 1. The architecture of TinierHAR 2. Related Work Deploying HAR models on edge devices has spurred research into efficiency-oriented architectures. A common strategy involves replacing standard convolutions with depthwise separable convolutions ( Zhu et al. 2021 ; Bian et al. 2024 ) . Recent studies ( Lalwani and Ganeshan 2024 ; Batool et al. 2024 ) also suggest that traditional recurrent networks remain popular for temporal modeling in HAR due to their strong ability to capture sequential dependencies. However, their computational overhead has motivated alternatives such as temporal pooling ( Song et al. 2018 ) and dilated convolutions ( Hamad et al. 2021 ; Bian et al. 2025 ) . Work like ( Kang et al. 2025 ) proposed pruning GRU layers to reduce latency, but this often sacrifices temporal granularity critical for fine-grained activity recognition. Beyond architectural innovations, techniques like quantization ( Yi et al. 2023 ) , knowledge distillation ( Deng et al. 2023 ) , and neural architecture search (NAS) ( Lim et al. 2023 ) have been applied for efficient HAR. Recent work from KIT introduced TinyHAR ( Zhou et al. 2022 ) , a lightweight architecture that combines temporal convolutional blocks, self-attention mechanisms, LSTM layers, and temporal aggregation to optimize both spatial-temporal feature extraction and efficiency. TinyHAR achieves competitive accuracy while significantly reducing model size and computational costs. Despite advancements in recent lightweight HAR research, a few critical domain knowledge remain unaddressed: (1) Insufficient Methodological Rigor: prior works lack granular analyses of architectural component efficacy, impeding evidence-based model design; (2) Limited Robustness: existing architectures exhibit weak generalizability explorations across heterogeneous sensor configurations and activity taxonomies. (3) Inadequate Scalability: considering diverse edge-device constraints, current approaches seldom systematically explore scalable architectures that balance accuracy and efficiency. To address those limitations, we propose TinierHAR, pushing the frontier of edge HAR in both efficiency and performance. Our work advances the field through: (1) An ultra-lightweight deep learning architecture for HAR that combines residual depthwise separable convolutions with bidirectional GRU and temporal aggregation reaching the SOTA tradeoff of performance and efficiency among its kind; (2) The first systematic ablation study quantifying component-level contributions in different architectures across 14 datasets and the validation of architectural scalability. (3) The in-depth explanation of the findings of edge HAR based on the qualitative result and a few insights on future directions for principled design guidelines. 3. Architecture Design TinierHAR is designed for edge HAR and integrates spatiotemporal feature learning, temporal sequence modeling, and adaptive aggregation into a cohesive framework. The architecture is modular, enabling systematic ablation studies and scalability across diverse sensor configurations (Figure 1 ). The model is composed of the following units: Hierarchical Spatial Feature Extraction with Residual Separable CNN : The spatial processing backbone employs a cascade of Residual Depthwise Separable Convolution blocks to capture multi-scale motion patterns while minimizing computational costs. Each block replaces standard convolutions with a two-step operation: the depthwise convolution, which applies a temporal kernel independently to each input channel to extract local features; And the pointwise convolution, which merges cross-channel correlations via 1×1 convolutions. Each block includes a residual shortcut to mitigate gradient degradation: using 1×1 convolutions with batch normalization when channels of

Read the complete text