Channel-Free Human Activity Recognition via Inductive-Bias-Aware Fusion Design for Heterogeneous IoT Sensor Environments

Tatsuhito Hasegawa · 2026

Read Channel-Free Human Activity Recognition via Inductive-Bias-Aware Fusion Design for Heterogeneous IoT Sensor Environments by Tatsuhito Hasegawa (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21369.txt.

Introduction

Tatsuhito Hasegawa tackles human activity recognition across varied IoT sensors, where channel counts, orders, devices, body spots, and sensing types all vary. Usual channel-fixed models fail to transfer because their inputs cling to preset channel structures. His strict channel-free system encodes each channel on its own with a shared encoder, fuses with metadata-based late fusion, and jointly trains channel-level and fused predictions. Sensor metadata like body spot, sensing type, and axis recovers structure that channel-by-channel processing alone loses.

Catalog record

CREATORTatsuhito Hasegawa
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67975
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21369

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Channel-Free Human Activity Recognition via Inductive-Bias-Aware Fusion Design for Heterogeneous IoT Sensor Environments Tatsuhito Hasegawa Abstract Human activity recognition (HAR) in Internet of Things (IoT) environments must cope with heterogeneous sensor settings that vary across datasets, devices, body locations, sensing modalities, and channel compositions. This heterogeneity makes conventional channel-fixed models difficult to reuse across sensing environments because their input representations are tightly coupled to predefined channel structures. To address this problem, we investigate strict channel-free HAR, in which a single shared model performs inference without assuming a fixed number, order, or semantic arrangement of input channels, and without relying on sensor-specific input layers or dataset-specific channel templates. We argue that fusion design is the central issue in this setting. Accordingly, we propose a channel-free HAR framework that combines channel-wise encoding with a shared encoder, metadata-conditioned late fusion via conditional batch normalization, and joint optimization of channel-level and fused predictions through a combination loss. The proposed model processes each channel independently to handle varying channel configurations, while sensor metadata such as body location, modality, and axis help recover structural information that channel-independent processing alone cannot retain. In addition, the joint loss encourages both the discriminability of individual channels and the consistency of the final fused prediction. Experiments on PAMAP2, together with robustness analysis on six HAR datasets, ablation studies, sensitivity analysis, efficiency evaluation, and cross-dataset transfer learning, demonstrate three main findings: 1) channel-free late fusion achieves strong robustness under channel perturbations; 2) metadata conditioning consistently improves the channel-free model while remaining tolerant to mild signal–metadata inconsistency; and 3) the resulting framework remains competitive with conventional channel-fixed architectures while enabling transfer across heterogeneous sensor configurations without input-layer redesign. These results suggest that channel-free modeling designed from inductive-bias considerations is a practical step toward scalable and transferable HAR in real-world IoT environments. I Introduction Human activity recognition (HAR) aims to infer a wearer’s activities from diverse sensor signals and is a key technology for Internet of Things (IoT) applications such as health monitoring, assisted living, sports analytics, and context-aware services. As summarized in Table I , existing sensor-based HAR studies cover highly diverse input settings. Many benchmark datasets focus on daily activity recognition using only a tri-axial accelerometer [ 19 , 17 , 29 ] , whereas others additionally employ gyroscopes and magnetometers [ 2 , 40 ] , or place sensors on multiple body locations such as the hand, chest, ankle, and waist [ 42 , 5 , 1 , 37 ] . In general, increasing the number and variety of sensors enables richer observation of real-world human behavior, but it also makes data processing substantially more complex. In this sense, sensor-based HAR is inherently a multimodal learning problem in which the number, type, and semantic meaning of channels vary markedly across datasets and deployment environments. TABLE I: Benchmark datasets of sensor-based HAR. The “# of ch.” column lists the raw channel count reported by each dataset; as described in Section IV-A , PAMAP2 is used with 40 channels in our experiments because the orientation measurements are excluded due to known recording issues. Dataset Cite Sensors Location # of ch. # of act. # of subj. Freq. [Hz] WISDM [ 19 ] A Pocket 3 6 29 20 HASC [ 17 ] A - 3 6 116 10–100 † UniMiB SHAR [ 29 ] A Pocket 3 17 30 \approx 50 UCI-HAR [ 2 ] A,G Waist 9 6 30 50 CHAD [ 40 ] A,G,M Pocket, Wrist 12 13 10 50 HHAR [ 42 ] A,G Waist, Hand 12 6 9 50–200 ‡ MHEALTH [ 5 ] A,G,M,H Hand, Chest, Ankle 23 12 10 50 DSADS [ 1 ] A,G,M 5 positions 45 19 8 25 PAMAP2 [ 37 ] A,G,M,H,T Hand, Chest, Ankle 52 18 9 100 § A: accelerometer, G: gyroscope, M: magnetic, H: heart rate, and T: temperature. † HASC corpus stores recordings with varying sampling rates; commonly reported as 10–100 Hz. ‡ HHAR is device-dependent; common smartphone rates span 50, 100, 150, and 200 Hz. § PAMAP2 IMUs are sampled at 100 Hz, while the heart-rate monitor is approximately 9 Hz. Despite this diversity, most existing HAR algorithms are implemented using machine learning or deep learning under a channel-fixed assumption [ 19 , 8 ] . Typical approaches either extract features from individual channels separately [ 19 ] or jointly convolve all channels from the first layer [ 8 ] . In both cases, the model is built for a predefined input structure, that is, a fixed number, order, and semantic meaning of channels. For example, a model trained for only three channels of right-hand acceleration is not directly applicable to a different configuration that additionally includes three channels of left-hand gyroscope data. Consequently, different sensor configurations usually require different models, even when the target task itself remains the same. This design is workable in closed benchmark settings, but it fundamentally limits scalability across heterogeneous IoT sensing environments. In contrast, foundation models have become the dominant paradigm in computer vision and natural language processing [ 6 ] . A foundation model is a large-scale pretrained model that can be transferred to a wide range of downstream tasks. Representative examples include Grounding DINO for object detection [ 24 ] , SAM for segmentation [ 18 ] , and GPT for natural language processing [ 35 ] . Such models are realized by training high-capacity architectures on extremely large and diverse datasets, with or without dense task-specific annotations. Their success suggests that, rather than designing a separate model for each individual benchmark, a more scalable direction is to build a single model family that can absorb heterogeneous data distributions and transfer across tasks and domains. To realize foundation models for HAR, at least two requirements must be satisfied: (1) large-scale training data and (2) a model architecture that can uniformly process sensor time series with different channel configurations. Regarding the first requirement, as shown in Table I , many HAR datasets are available, but each individual dataset is relatively limited in scale compared with the data regimes commonly used for foundation models. To alleviate this issue, recent studies have begun to explore cross-dataset utilization, such as domain generalization [ 33 , 14 ] and data-mixtured pretraining [ 55 , 4 ] . These directions suggest that heterogeneous HAR datasets can be jointly exploited to improve generalization. However, the second requirement remains insufficiently addressed: existing HAR models are still largely tied to dataset-specific channel structures, making it difficult to learn from multiple datasets in a unified and scalable manner. From this perspective, we argue that channel-free design is a key requirement for future HAR foundation models. Here, “channel-free” means that a model can accept sensor inputs with different numbers and compositions of channels without assuming a fixed channel template in advance. This property is essential when training on heterogeneous IoT sensor data collected from different devices, sensing modalities, and body locations. At the same time, achieving high accuracy under a channel-free constraint is nontrivial. If channel-specific assumptions are removed naively, the model may lose structural biases that are implicitly exploited by conventional channel-fixed architectures. Therefore, the core challenge is not merely to make HAR models flexible to variable channels, but

Read the complete text