Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Gloves

Xinyu ZhangZiyi KouChuan QinMia HuangErgys RistaniAnkit KumarLele ChenKun He, Abdeslam BoulariasLi Guan, Meta Reality Labs Rutgers University mlzxy.github.io/glove2hand · 2026

Read Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Gloves by Xinyu ZhangZiyi KouChuan QinMia HuangErgys RistaniAnkit KumarLele ChenKun He, Abdeslam BoulariasLi Guan, Meta Reality Labs Rutgers University mlzxy.github.io/glove2hand (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20850.txt.

Description

Zhang and co-authors build Glove2Hand, a system that turns sensing glove videos into realistic bare hand videos. Ordinary hand videos miss contact forces and motion signals, and hands are often blocked from view. Their method keeps the true physical contact while it renders the hand. It uses a 3D Gaussian hand model and a diffusion based restorer. They also release HandSense, a data set with tactile and motion signals. The authors report gains in contact estimation and hand tracking under heavy occlusion.

Catalog record

CREATORXinyu ZhangZiyi KouChuan QinMia HuangErgys RistaniAnkit KumarLele ChenKun He, Abdeslam BoulariasLi Guan, Meta Reality Labs Rutgers University mlzxy.github.io/glove2hand
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49442
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.20850

Browse the full library · About the Tower of Babel