Multimodal Skeleton-Based Action Representation Learning via Decomposition and Composition

Hongsong Wang, Heng Fei, Bingxuan Dai, Jie Gui · 2025

Read Multimodal Skeleton-Based Action Representation Learning via Decomposition and Composition by Hongsong Wang, Heng Fei, Bingxuan Dai, Jie Gui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-21064.txt.

Description

Hongsong Wang, Jie Gui, and two co-authors teach machines to recognize human actions from skeleton data gathered in several kinds at once. Fusing the kinds late is accurate but expensive; fusing them early through one shared backbone is cheap but weaker. Their self-supervised framework, Decomposition and Composition, splits the difference. It first pulls fused features apart into single-kind features and aligns each with its true single-kind counterpart, then recomposes the parts so each kind guides the joint features.

On the NTU RGB+D 60 and 120 benchmarks and PKU-MMD II, the approach lands a rare good balance of computing cost against accuracy. For action-recognition systems that must run on modest hardware, drones, cameras, rehabilitation monitors, getting fused quality without fused bills is the practical win.

Catalog record

CREATORHongsong Wang, Heng Fei, Bingxuan Dai, Jie Gui
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-21064

Browse the full library · About the Tower of Babel