DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitation

Hyeonwoo Kim, Jeonghwan Kim, Kyungwon Cho, Hanbyul Joo, [0.6em] Seoul National University · 2026

Read DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitation by Hyeonwoo Kim, Jeonghwan Kim, Kyungwon Cho, Hanbyul Joo, [0.6em] Seoul National University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-20841.txt.

Description

Kim, Kim, Cho, Lee, and Joo present DeVI, a system that learns physics-based character control for dexterous human-object interaction by copying text-conditioned synthetic videos. To handle unreliable 3D object motion rebuild, they build hybrid imitation targets that mix rebuilt 3D human motion with tracked 2D object paths. Their Visual HOI Alignment further tunes the human reference to match the made video and the starting 3D object setup. Tests show the hybrid form beats baselines and that Visual HOI Alignment lifts imitation success.

Catalog record

CREATORHyeonwoo Kim, Jeonghwan Kim, Kyungwon Cho, Hanbyul Joo, [0.6em] Seoul National University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56322
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.20841

Browse the full library · About the Tower of Babel