Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Gloves
Xinyu ZhangZiyi KouChuan QinMia HuangErgys RistaniAnkit KumarLele ChenKun He, Abdeslam BoulariasLi Guan, Meta Reality Labs Rutgers University mlzxy.github.io/glove2hand · 2026
Read Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Gloves by Xinyu ZhangZiyi KouChuan QinMia HuangErgys RistaniAnkit KumarLele ChenKun He, Abdeslam BoulariasLi Guan, Meta Reality Labs Rutgers University mlzxy.github.io/glove2hand (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20850.txt.
Description
Zhang and co-authors build Glove2Hand, a system that turns sensing glove videos into realistic bare hand videos. Ordinary hand videos miss contact forces and motion signals, and hands are often blocked from view. Their method keeps the true physical contact while it renders the hand. It uses a 3D Gaussian hand model and a diffusion based restorer. They also release HandSense, a data set with tactile and motion signals. The authors report gains in contact estimation and hand tracking under heavy occlusion.
Catalog record
| CREATOR | Xinyu ZhangZiyi KouChuan QinMia HuangErgys RistaniAnkit KumarLele ChenKun He, Abdeslam BoulariasLi Guan, Meta Reality Labs Rutgers University mlzxy.github.io/glove2hand |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49442 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20850