Gazeify Then Voiceify: Physical Object Referencing Through Gaze and Voice Interaction with Displayless Smart Glasses DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; March 23–26, 2026; Paphos, Cyprus ISBN: 978-1-4503-XXXX-X/18/06 Co

Zheng Zhang, Mengjie Yu, Tianyi Wang, Kashyap Todi, Ajoy Savio Fernandes, Yue Liu, Haijun Xia, Tovi Grossman, Tanya Jonker · 2026

Read Gazeify Then Voiceify: Physical Object Referencing Through Gaze and Voice Interaction with Displayless Smart Glasses DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; March 23–26, 2026; Paphos, Cyprus ISBN: 978-1-4503-XXXX-X/18/06 Co by Zheng Zhang, Mengjie Yu, Tianyi Wang, Kashyap Todi, Ajoy Savio Fernandes, Yue Liu, Haijun Xia, Tovi Grossman, Tanya Jonker (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19281.txt.

Description

Zheng Zhang and eight co-authors let smart glasses users point with their eyes and speak to confirm. Smart glasses watch the world through head mounted cameras, but they lack a screen for the usual visual feedback. The team introduces a two step way to refer to real objects around the wearer.

First the user gazes at the object, then speaks to name or confirm it: gazeify, then voiceify. Eyes are fast pointers, and voice is a natural second channel. The pairing could make hands free control of smart glasses feel less like guesswork for everyday tasks.

Catalog record

CREATORZheng Zhang, Mengjie Yu, Tianyi Wang, Kashyap Todi, Ajoy Savio Fernandes, Yue Liu, Haijun Xia, Tovi Grossman, Tanya Jonker
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19281

Browse the full library · About the Tower of Babel