DAViD: Modeling Dynamic Affordance of 3D Objects Using Pre-trained Video Diffusion Models

Hyeonwoo Kim Sangwon Baik Hanbyul Joo Seoul National University https://snuvclab.github.io/david/ · 2025

Read DAViD: Modeling Dynamic Affordance of 3D Objects Using Pre-trained Video Diffusion Models by Hyeonwoo Kim Sangwon Baik Hanbyul Joo Seoul National University https://snuvclab.github.io/david/ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-08333.txt.

Description

Hyeonwoo Kim, Sangwon Baik, and Hanbyul Joo teach a generative model how people and objects move together over time, learning from videos a diffusion model dreams up. Their paper appeared in two thousand twenty-five. Assistants and robots need dynamic affordance: knowing what motions an object invites. Real four-dimensional interaction data are scarce.

Their pipeline first generates two-dimensional interaction videos of a target object with a video diffusion model. Those videos are then lifted into three dimensions to synthesize training samples. The model itself pairs a human motion generator, lightly fine-tuned, with an object pose generator. New motion concepts blend with pretrained motions, even several at once. Experiments show the system beating baselines at synthesizing interactions. The trick is manufacturing the missing data dimension. It could generalize wherever motion capture is impractical.

Catalog record

CREATORHyeonwoo Kim Sangwon Baik Hanbyul Joo Seoul National University https://snuvclab.github.io/david/
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-08333

Browse the full library · About the Tower of Babel