SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarios
Lingwei Dang, Ruizhi Shao, Hongwen Zhang, Wei MIN, Yebin Liu , Qingyao Wu · 2025
Read SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarios by Lingwei Dang, Ruizhi Shao, Hongwen Zhang, Wei MIN, Yebin Liu , Qingyao Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02444.txt.
Description
Lingwei Dang and co-authors generate hand-object play as matched video and 3D motion in this 2025 paper. Older motion tools need ready-made object models and lab-captured moves, which limits them. Video tools chase pretty pixels and often break physics. The team's framework, SViMo, runs one synced diffusion process for both outputs.
A tri-modal modulation step aligns words, looks, and motion traits. Full 3D attention then models ties within and across those streams. A second model reads out exact 3D interaction sequences and feeds them back to correct the loop. Tests beat prior methods on realism and consistency, even in scenes the system had never seen.
Catalog record
| CREATOR | Lingwei Dang, Ruizhi Shao, Hongwen Zhang, Wei MIN, Yebin Liu , Qingyao Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-02444