DexImit: Learning Bimanual Dexterous Manipulation from Monocular Human Videos

Juncheng Mu, Sizhe Yang, Yiming Bao, Hojin Bae, Tianming Wei, Linning Xu, Boyi Li, Huazhe Xu, Jiangmiao Pang, Equal contribution, Corresponding author Project Page: https://mujc2021.github.io/deximit/ · 2026

Read DexImit: Learning Bimanual Dexterous Manipulation from Monocular Human Videos by Juncheng Mu, Sizhe Yang, Yiming Bao, Hojin Bae, Tianming Wei, Linning Xu, Boyi Li, Huazhe Xu, Jiangmiao Pang, Equal contribution, Corresponding author Project Page: https://mujc2021.github.io/deximit/ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-10105.txt.

Description

Two-handed dexterous manipulation needs data that is expensive to collect from real robot hands. A 2026 paper led by Juncheng Mu, with eight co-authors, proposes DexImit, a framework that converts single-camera human manipulation videos into lifelike robot data with no extra information. The pipeline runs in four stages. It reconstructs hand-object interaction at near-metric scale, decomposes subtasks with bimanual scheduling, synthesizes consistent robot trajectories, and augments data for zero-shot real-world deployment.

DexImit can draw on internet videos or generated videos and handles varied tasks, from cutting an apple to making a beverage to stacking cups. By bridging the embodiment gap between human and robot hands, it offers a path to scale robot learning from the vast supply of human video.

Catalog record

CREATORJuncheng Mu, Sizhe Yang, Yiming Bao, Hojin Bae, Tianming Wei, Linning Xu, Boyi Li, Huazhe Xu, Jiangmiao Pang, Equal contribution, Corresponding author Project Page: https://mujc2021.github.io/deximit/
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-10105

Browse the full library · About the Tower of Babel