EgoMusic-driven Human Dance Motion Estimation with Skeleton Mamba

Quang Nguyen, Nhat Le, Baoru Huang, Minh Nhat Vu, Chengcheng Tang, Van Nguyen, Ngan Le, Thieu Vo, Anh Nguyen · 2025

Read EgoMusic-driven Human Dance Motion Estimation with Skeleton Mamba by Quang Nguyen, Nhat Le, Baoru Huang, Minh Nhat Vu, Chengcheng Tang, Van Nguyen, Ngan Le, Thieu Vo, Anh Nguyen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10522.txt.

Description

Quang Nguyen and co-authors tackle dance motion capture in their 2025 paper. They want to guess a dancer's full body pose from a head-worn camera view plus the music. The view from the head hides much of the body, so the task is hard.

The team first built a new data set, called EgoAIST++, with more than thirty-six hours of dance paired with first-person video and music. Their model uses a part called Skeleton Mamba, which tracks the body's bone structure through time. Tests show the method beats prior tools and still works on real-world clips. Studios could use it for games, film, and virtual worlds.

Catalog record

CREATORQuang Nguyen, Nhat Le, Baoru Huang, Minh Nhat Vu, Chengcheng Tang, Van Nguyen, Ngan Le, Thieu Vo, Anh Nguyen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-10522

Browse the full library · About the Tower of Babel