DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitation
Hyeonwoo Kim, Jeonghwan Kim, Kyungwon Cho, Hanbyul Joo, [0.6em] Seoul National University · 2026
Read DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitation by Hyeonwoo Kim, Jeonghwan Kim, Kyungwon Cho, Hanbyul Joo, [0.6em] Seoul National University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-20841.txt.
Description
Kim, Kim, Cho, Lee, and Joo present DeVI, a system that learns physics-based character control for dexterous human-object interaction by copying text-conditioned synthetic videos. To handle unreliable 3D object motion rebuild, they build hybrid imitation targets that mix rebuilt 3D human motion with tracked 2D object paths. Their Visual HOI Alignment further tunes the human reference to match the made video and the starting 3D object setup. Tests show the hybrid form beats baselines and that Visual HOI Alignment lifts imitation success.
Catalog record
| CREATOR | Hyeonwoo Kim, Jeonghwan Kim, Kyungwon Cho, Hanbyul Joo, [0.6em] Seoul National University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56322 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.20841