HandProxy: Expanding the Affordances of Speech Interfaces in Immersive Environments with a Virtual Proxy Hand Conference: ; March; 2025 ISBN: XXX-X-XXXX-XXXX-X/XX/XX CCS: Human-centered computing Interactive systems and tools

Chen Liang, Yuxuan Liu, Martez Mott, Anhong Guo · 2025

Read HandProxy: Expanding the Affordances of Speech Interfaces in Immersive Environments with a Virtual Proxy Hand Conference: ; March; 2025 ISBN: XXX-X-XXXX-XXXX-X/XX/XX CCS: Human-centered computing Interactive systems and tools by Chen Liang, Yuxuan Liu, Martez Mott, Anhong Guo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-10029.txt.

Description

Chen Liang, Yuxuan Liu, Martez Mott, and Anhong Guo present HandProxy in a 2025 paper on virtual reality input. Hand gestures are the main way to act in immersive spaces, but injury, disability, or the setting can make them hard to use. Voice control exists, yet it usually covers only a few fixed commands.

HandProxy gives the user a virtual proxy hand that speech can steer in detail. The user describes an action in natural words, and the system turns the speech into a sequence of hand controls in real time. In a study with 20 people, every task was completed, with high accuracy on spoken commands. Users could also vary how much control they took, from broad goals to fine moves.

Catalog record

CREATORChen Liang, Yuxuan Liu, Martez Mott, Anhong Guo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-10029

Browse the full library · About the Tower of Babel