HandProxy: Expanding the Affordances of Speech Interfaces in Immersive Environments with a Virtual Proxy Hand Conference: ; March; 2025 ISBN: XXX-X-XXXX-XXXX-X/XX/XX CCS: Human-centered computing Interactive systems and tools
Chen Liang, Yuxuan Liu, Martez Mott, Anhong Guo · 2025
Read HandProxy: Expanding the Affordances of Speech Interfaces in Immersive Environments with a Virtual Proxy Hand Conference: ; March; 2025 ISBN: XXX-X-XXXX-XXXX-X/XX/XX CCS: Human-centered computing Interactive systems and tools by Chen Liang, Yuxuan Liu, Martez Mott, Anhong Guo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-10029.txt.
Description
Chen Liang, Yuxuan Liu, Martez Mott, and Anhong Guo present HandProxy in a 2025 paper on virtual reality input. Hand gestures are the main way to act in immersive spaces, but injury, disability, or the setting can make them hard to use. Voice control exists, yet it usually covers only a few fixed commands.
HandProxy gives the user a virtual proxy hand that speech can steer in detail. The user describes an action in natural words, and the system turns the speech into a sequence of hand controls in real time. In a study with 20 people, every task was completed, with high accuracy on spoken commands. Users could also vary how much control they took, from broad goals to fine moves.
Catalog record
| CREATOR | Chen Liang, Yuxuan Liu, Martez Mott, Anhong Guo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 93 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-10029