DETACH : Decomposed Spatio-Temporal Alignment for Exocentric Video and Ambient Sensors with Staged Learning
Junho Yoon, Jaemo Jung, Hyunju Kim, Dongman Lee · 2025
Read DETACH : Decomposed Spatio-Temporal Alignment for Exocentric Video and Ambient Sensors with Staged Learning by Junho Yoon, Jaemo Jung, Hyunju Kim, Dongman Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-20409.txt.
Description
Junho Yoon, Jaemo Jung, Hyunju Kim, and Dongman Lee align room cameras with ambient sensors to recognize human actions. Wearable-based systems work, but they burden users, raise privacy worries, and scale poorly. Fixed exocentric video plus room sensors is a gentler alternative, provided the two streams can be aligned well.
Global alignment, the standard trick, washes out subtle motions and confuses actions with similar timing but different meaning. DETACH instead decomposes alignment into spatial and temporal parts. New sensor-spatial features, found by online clustering, ground the alignment in context. Mutual supervision sets spatial correspondence first; a weighted contrastive loss then handles time. On two public data sets, the method improves substantially over adapted wearable-based benchmarks.
Catalog record
| CREATOR | Junho Yoon, Jaemo Jung, Hyunju Kim, Dongman Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-20409