VideoAfford: Grounding 3D Affordance from Human-Object-Interaction Videos via Multimodal Large Language Model
2026
Read VideoAfford: Grounding 3D Affordance from Human-Object-Interaction Videos via Multimodal Large Language Model (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09638.txt.
Description
3D affordance grounding highlights the actionable regions on 3D objects, crucial for robot manipulation. Hanqing Wang and eleven co-authors note that prior research learns affordance knowledge mostly from static cues like language and images, which miss the dynamic interaction context revealing temporal and causal signals. Their 2026 paper collects VIDA, a video-based 3D affordance dataset of tens of thousands of human-object-interaction videos across sixteen affordance types, dozens of object categories, and thousands of point clouds.
From VIDA comes VideoAfford, a baseline activating multimodal language models with extra affordance segmentation, joining world knowledge reasoning with fine-grained affordance grounding. A latent action encoder extracts dynamic interaction priors from interaction videos, and a spatial-aware loss builds comprehensive 3D spatial knowledge. Evaluations show the model beating well-established methods with strong open-world generalization. All datasets and code will be publicly released.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-09638