AGILE: Hand-Object Interaction Reconstruction from Video via Agentic Generation

Jin-Chuan Shi, Binhong Ye, Tao Liu, Junzhe He, Yangjinhui Xu, Xiaoyang Liu, Zeju Li, Hao Chen, Chunhua Shen · 2026

Read AGILE: Hand-Object Interaction Reconstruction from Video via Agentic Generation by Jin-Chuan Shi, Binhong Ye, Tao Liu, Junzhe He, Yangjinhui Xu, Xiaoyang Liu, Zeju Li, Hao Chen, Chunhua Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04672.txt.

Description

Jin-Chuan Shi and 8 co-authors reconstruct hands interacting with objects from plain video in a 2026 paper called AGILE. Such data feed robot training and digital twins, but heavy occlusion and fragile camera work often break prior methods.

Instead of pure reconstruction, AGILE generates the object first. A vision-language model guides a generator to produce a complete, textured mesh, unaffected by occlusion. Pose tracking starts at one contact frame using a base model, avoiding brittle structure-from-motion. A contact-aware step then enforces physical plausibility through semantic, geometric, and stability rules. Across several benchmarks and wild footage, AGILE beat baselines in geometric accuracy and stayed robust where rivals collapsed.

Catalog record

CREATORJin-Chuan Shi, Binhong Ye, Tao Liu, Junzhe He, Yangjinhui Xu, Xiaoyang Liu, Zeju Li, Hao Chen, Chunhua Shen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04672

Browse the full library · About the Tower of Babel