DexterCap: An Affordable and Automated System for Capturing Dexterous Hand-Object Manipulation CCS: Computing methodologies Motion capture

Yutong Liang, Shiyi Xu, Yulong Zhang, Bowen Zhan, He Zhang, Libin Liu · 2026

Read DexterCap: An Affordable and Automated System for Capturing Dexterous Hand-Object Manipulation CCS: Computing methodologies Motion capture by Yutong Liang, Shiyi Xu, Yulong Zhang, Bowen Zhan, He Zhang, Libin Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05844.txt.

Description

Yutong Liang and 5 co-authors build DexterCap in 2026, an affordable optical system for capturing dexterous hand-object manipulation in fine detail. Fingers close together hide each other from cameras, and in-hand motions are subtle. Professional motion capture solves this with expensive rigs and heavy manual cleanup, while cheap vision methods lose accuracy under occlusion.

DexterCap uses dense, character-coded marker patches that stay trackable even under severe self-occlusion. An automated reconstruction pipeline needs minimal manual effort. With the system, the team created DexterHand, a dataset spanning simple shapes to articulated objects such as a Rubik's Cube. Both dataset and code are released to support research on dexterous hand-object interaction.

Catalog record

CREATORYutong Liang, Shiyi Xu, Yulong Zhang, Bowen Zhan, He Zhang, Libin Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05844

Browse the full library · About the Tower of Babel