AGILE: Hand-Object Interaction Reconstruction from Video via Agentic Generation
Jin-Chuan Shi, Binhong Ye, Tao Liu, Junzhe He, Yangjinhui Xu, Xiaoyang Liu, Zeju Li, Hao Chen, Chunhua Shen · 2026
Read AGILE: Hand-Object Interaction Reconstruction from Video via Agentic Generation by Jin-Chuan Shi, Binhong Ye, Tao Liu, Junzhe He, Yangjinhui Xu, Xiaoyang Liu, Zeju Li, Hao Chen, Chunhua Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04672.txt.
Description
Jin-Chuan Shi and 8 co-authors reconstruct hands interacting with objects from plain video in a 2026 paper called AGILE. Such data feed robot training and digital twins, but heavy occlusion and fragile camera work often break prior methods.
Instead of pure reconstruction, AGILE generates the object first. A vision-language model guides a generator to produce a complete, textured mesh, unaffected by occlusion. Pose tracking starts at one contact frame using a base model, avoiding brittle structure-from-motion. A contact-aware step then enforces physical plausibility through semantic, geometric, and stability rules. Across several benchmarks and wild footage, AGILE beat baselines in geometric accuracy and stayed robust where rivals collapsed.
Catalog record
| CREATOR | Jin-Chuan Shi, Binhong Ye, Tao Liu, Junzhe He, Yangjinhui Xu, Xiaoyang Liu, Zeju Li, Hao Chen, Chunhua Shen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04672