SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarios

Lingwei Dang, Ruizhi Shao, Hongwen Zhang, Wei MIN, Yebin Liu , Qingyao Wu · 2025

Read SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarios by Lingwei Dang, Ruizhi Shao, Hongwen Zhang, Wei MIN, Yebin Liu , Qingyao Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02444.txt.

Description

Lingwei Dang and co-authors generate hand-object play as matched video and 3D motion in this 2025 paper. Older motion tools need ready-made object models and lab-captured moves, which limits them. Video tools chase pretty pixels and often break physics. The team's framework, SViMo, runs one synced diffusion process for both outputs.

A tri-modal modulation step aligns words, looks, and motion traits. Full 3D attention then models ties within and across those streams. A second model reads out exact 3D interaction sequences and feeds them back to correct the loop. Tests beat prior methods on realism and consistency, even in scenes the system had never seen.

Catalog record

CREATORLingwei Dang, Ruizhi Shao, Hongwen Zhang, Wei MIN, Yebin Liu , Qingyao Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-02444

Browse the full library · About the Tower of Babel