DexterCap: An Affordable and Automated System for Capturing Dexterous Hand-Object Manipulation CCS: Computing methodologies Motion capture
Yutong Liang, Shiyi Xu, Yulong Zhang, Bowen Zhan, He Zhang, Libin Liu · 2026
Read DexterCap: An Affordable and Automated System for Capturing Dexterous Hand-Object Manipulation CCS: Computing methodologies Motion capture by Yutong Liang, Shiyi Xu, Yulong Zhang, Bowen Zhan, He Zhang, Libin Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05844.txt.
Description
Yutong Liang and 5 co-authors build DexterCap in 2026, an affordable optical system for capturing dexterous hand-object manipulation in fine detail. Fingers close together hide each other from cameras, and in-hand motions are subtle. Professional motion capture solves this with expensive rigs and heavy manual cleanup, while cheap vision methods lose accuracy under occlusion.
DexterCap uses dense, character-coded marker patches that stay trackable even under severe self-occlusion. An automated reconstruction pipeline needs minimal manual effort. With the system, the team created DexterHand, a dataset spanning simple shapes to articulated objects such as a Rubik's Cube. Both dataset and code are released to support research on dexterous hand-object interaction.
Catalog record
| CREATOR | Yutong Liang, Shiyi Xu, Yulong Zhang, Bowen Zhan, He Zhang, Libin Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-05844