DETACH : Decomposed Spatio-Temporal Alignment for Exocentric Video and Ambient Sensors with Staged Learning

Junho Yoon, Jaemo Jung, Hyunju Kim, Dongman Lee · 2025

Read DETACH : Decomposed Spatio-Temporal Alignment for Exocentric Video and Ambient Sensors with Staged Learning by Junho Yoon, Jaemo Jung, Hyunju Kim, Dongman Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-20409.txt.

Description

Junho Yoon, Jaemo Jung, Hyunju Kim, and Dongman Lee align room cameras with ambient sensors to recognize human actions. Wearable-based systems work, but they burden users, raise privacy worries, and scale poorly. Fixed exocentric video plus room sensors is a gentler alternative, provided the two streams can be aligned well.

Global alignment, the standard trick, washes out subtle motions and confuses actions with similar timing but different meaning. DETACH instead decomposes alignment into spatial and temporal parts. New sensor-spatial features, found by online clustering, ground the alignment in context. Mutual supervision sets spatial correspondence first; a weighted contrastive loss then handles time. On two public data sets, the method improves substantially over adapted wearable-based benchmarks.

Catalog record

CREATORJunho Yoon, Jaemo Jung, Hyunju Kim, Dongman Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-20409

Browse the full library · About the Tower of Babel