Edge-Efficient Two-Stream Multimodal Architecture for Non-Intrusive Bathroom Fall Detection

Haitian Wang 1 * , Yiren Wang 1 , Xinyu Wang 1 , Sheldon Fung 1 , Atif Mansoor 1 · 2026

Read Edge-Efficient Two-Stream Multimodal Architecture for Non-Intrusive Bathroom Fall Detection by Haitian Wang 1 * , Yiren Wang 1 , Xinyu Wang 1 , Sheldon Fung 1 , Atif Mansoor 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17069.txt.

Introduction

Wang and co-authors build a privacy preserving fall detector for bathrooms, aimed at seniors living alone. Their system fuses radar motion data with floor vibration data. A Motion-Mamba branch reads long range motion patterns. An Impact-Griffin branch reads impact transients in the vibration signal. Fusion aligns the two streams and suppresses false alarms from dropped objects. The model runs in real time on a Raspberry Pi 4B. On their benchmark, it reached accuracy above 96 percent and cut latency sharply.

Catalog record

CREATORHaitian Wang 1 * , Yiren Wang 1 , Xinyu Wang 1 , Sheldon Fung 1 , Atif Mansoor 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30895
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.17069

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Edge-Efficient Two-Stream Multimodal Architecture for Non-Intrusive Bathroom Fall Detection Haitian Wang 1 * , Yiren Wang 1 , Xinyu Wang 1 , Sheldon Fung 1 , Atif Mansoor 1 Abstract Falls in wet bathroom environments are a major safety risk for seniors living alone. Recent work has shown that mmWave-only, vibration-only, and existing multimodal schemes, such as vibration-triggered radar activation, early feature concatenation, and decision-level score fusion, can support privacy-preserving, non-intrusive fall detection. However, these designs still treat motion and impact as loosely coupled streams, depending on coarse temporal alignment and amplitude thresholds, and do not explicitly encode the causal link between radar-observed collapse and floor impact or address timing drift, object drop confounders, and latency and energy constraints on low-power edge devices. To this end, we propose a two-stream architecture that encodes radar signals with a Motion–Mamba branch for long-range motion patterns and processes floor vibration with an Impact–Griffin branch that emphasizes impact transients and cross-axis coupling. Cross-conditioned fusion uses low-rank bilinear interaction and a Switch–MoE head to align motion and impact tokens and suppress object-drop confounders. The model keeps inference cost suitable for real-time execution on a Raspberry Pi 4B gateway. We construct a bathroom fall detection benchmark dataset with frame-level annotations, comprising more than 3 h of synchronized mmWave radar and triaxial vibration recordings across eight scenarios under running water, together with subject-independent training, validation, and test splits. On the test split, our model attains 96.1% accuracy, 94.8% precision, 88.0% recall, a 91.1% macro F1 score, and an AUC of 0.968. Compared with the strongest baseline, it improves accuracy by 2.0 percentage points and fall recall by 1.3 percentage points, while reducing latency from 35.9 ms to 15.8 ms and lowering energy per 2.56 s window from 14200 mJ to 10750 mJ on the Raspberry Pi 4B gateway. I Introduction The proportion of seniors living alone continues to rise, making home safety an increasingly critical concern [ 11 , 23 ] . Bathrooms represent the highest-risk environment due to wet floors, hard surfaces, and confined layouts, with studies reporting that the majority of household falls occur in this setting [ 24 ] . Commercial solutions have not addressed this challenge effectively: caregiver monitoring is costly and lacks scalability [ 3 ] , wearable devices are often neglected or cannot function reliably in wet conditions [ 17 ] , and camera-based or microphone-based systems introduce privacy concerns that prevent their use in bathrooms [ 9 ] . These limitations have directed attention toward non-intrusive, privacy-preserving sensing approaches that can operate reliably in such environments [ 21 , 6 ] . Among non-intrusive sensing technologies, radar and floor-mounted vibration sensors have emerged as two of the most studied options for unobtrusive fall detection in private indoor environments [ 14 , 8 , 5 , 4 ] . Continuous-wave and millimeter-wave radars provide range–Doppler and micro-motion signatures that capture pre-impact trajectories and body-posture evolution, yet existing systems still report false alarms when objects are dropped and when strong specular reflections or multi-path clutter distort the Doppler trace in confined rooms [ 5 , 22 , 18 ] . Floor vibration approaches exploit structural coupling to obtain a high signal-to-noise ratio at impact and can detect events over a wide area with a small number of sensors [ 27 , 13 , 20 , 4 ] . However, they observe only the impact phase; their response is highly dependent on floor construction and sensor mounting, and non-human impacts with similar energy profiles remain difficult to reject [ 27 , 13 , 20 , 4 ] . Multimodal designs that combine inertial or visual streams with other sensors often use simple early feature concatenation or decision-level score averaging, which treats each sensor as an independent classifier and does not explicitly model the causal relationship between a motion pattern and the subsequent impact or correct for sampling-rate mismatch and clock drift [ 1 , 26 , 25 , 12 ] . Most of these systems are evaluated under laboratory conditions and only a few report end-to-end latency or energy on embedded processors, so their suitability for continuous bathroom monitoring on low-power edge platforms remains unclear. Fig. 1: Overall architecture of the proposed fall detection framework. Radar signals are processed by the Motion–Mamba stream and vibration signals by the Impact–Griffin stream. The two branches are fused through cross–conditioned interaction, low–rank bilinear coupling, and a fusion Switch–MoE. To address these gaps, we propose a two-stream mmWave radar and floor vibration architecture whose fusion is explicitly alignment-aware and temporally coherent while remaining suitable for low-power embedded deployment in wet, cluttered bathrooms. The radar stream uses large, selective kernels and a linear-time state-space module to capture pre-impact motion and collapse over several seconds, and to suppress clutter patterns produced by specular reflections and water. The vibration stream applies selective filtering, gated recurrent memory, and inter-channel weighting to preserve sharp impact transients and short-duration ringing while absorbing axis-dependent coupling into the feature representation. Motion and impact tokens are then cross-conditioned in time and combined by a low-rank bilinear module with a compact Switch–MoE adapter. This links radar-observed collapse to the subsequent impact, reduces false alarms from object drops, improves robustness to sampling mismatch and packet loss, and keeps fusion cost proportional to sequence length. Since there is no public benchmark that jointly records mmWave radar and floor vibration in bathrooms, we also construct a benchmark dataset with more than three hours of synchronized recordings that cover eight representative fall and non-fall scenarios under running water, together with frame-level labels and subject-independent train, validation, and test splits. On the held-out test split, the proposed method reaches 96.1% window-level accuracy, 94.8% precision, 88.0% recall, and a 91.1% macro F1 score with an AUC of 0.968. Compared with the strongest baseline on this dataset, it raises accuracy from 94.1% to 96.1%, increases fall recall from 86.7% to 88.0%, reduces latency from 35.9 ms to 15.8 ms, and lowers the energy per 2.56 s window from 14200 mJ to 10750 mJ on the Raspberry Pi 4B gateway. Our main contributions are as follows: • We propose an end-to-end sensing and inference pipeline for privacy-preserving bathroom fall detection on low-power edge hardware. • We design a two-stream mmWave radar and floor-vibration network architecture that performs alignment-aware multimodal fusion for robust fall detection. II Methodology Our method converts raw radar and vibration signals into synchronized feature sequences, processes them through two modality–specific streams, and fuses the resulting tokens for fall detection, as illustrated in Fig. 1 . II-A Multimodal Signal Preprocessing Raw triaxial vibration x_{v}[n]\in\mathbb{R}^{3} and mmWave radar streams x_{r}(t) are first mapped to a common rate f_{s}=100 Hz. Radar frames are converted to per-frame kinematic descriptors and linearly interpolated to a uniform sequence x_{r}^{\text{uni}}[n] . The inter sensor delay \Delta\tau is estimated from vibration and radar energy envelopes e_{v}[n] and e_{r}[n] using GCC-PHAT [ 10 ] , \hat{\Delta\tau}=\arg\max_{\tau}\,\mathcal{F}^{-1}\!\left\{\frac{X_{v}(\omega)\,X_{r}^{*}(\omega)}{|X_{v}(\omega)\,X_{r}(\omega)|}\right\}[\tau], (1) with X_{v} and X_{r} the discrete time Fourier transforms of e_{v} and e_{r} . This estimator is less sensitive to tiled-bathroom reverberation than direct time-domain correlation. Residual clock drift is modeled by a linear function \tau(n)=\alpha n+\beta fitted to local correlation peaks, which gives a simple affine warp of x_{r}^{\text{uni}}[n] instead of a full

Read the complete text