AuthGlass: Enhancing Voice Authentication on Smart Glasses via Air-Bone Acoustic Features DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Do Not Use This Code Ge
Weiye Xu, Zhang Jiang, Siqi Zheng, Xiyuxing Zhang, Yankai Zhao, Changhao Zhang, Jian Liu, Weiqiang Wang, Yuntao Wang · 2025
Read AuthGlass: Enhancing Voice Authentication on Smart Glasses via Air-Bone Acoustic Features DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Do Not Use This Code Ge by Weiye Xu, Zhang Jiang, Siqi Zheng, Xiyuxing Zhang, Yankai Zhao, Changhao Zhang, Jian Liu, Weiqiang Wang, Yuntao Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20799.txt.
Introduction
Smart glasses make voice commands easy, but recorded voices can fool them. Weiye Xu and seven co-authors build AuthGlass, a 2025 benchmark for voice liveness detection and authentication on smart glasses. No public dataset existed for this setting before their work, they note.
The team collected sixteen-channel audio from forty-two subjects, plus attack samples of two kinds. From that data they propose two methods. One checks liveness using the shape of the sound field across the glasses' microphones. The other authenticates users by combining several acoustic signals. They also benchmark seven existing liveness methods on the new dataset. The work was submitted to the IMWUT 2026 conference on wearable computing.
Catalog record
| CREATOR | Weiye Xu, Zhang Jiang, Siqi Zheng, Xiyuxing Zhang, Yankai Zhao, Changhao Zhang, Jian Liu, Weiqiang Wang, Yuntao Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-20799
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AuthGlass: Enhancing Voice Authentication on Smart Glasses via Air-Bone Acoustic Features DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Do Not Use This Code Generate the Correct Terms for Your Paper CCS: Do Not Use This Code Generate the Correct Terms for Your Paper CCS: Do Not Use This Code Generate the Correct Terms for Your Paper CCS: Do Not Use This Code Generate the Correct Terms for Your Paper Weiye Xu, Zhang Jiang, Siqi Zheng, Xiyuxing Zhang, Yankai Zhao, Changhao Zhang, Jian Liu, Weiqiang Wang, Yuntao Wang Abstract . With the rapid advancement of smart glasses, voice interaction has become widely deployed due to its naturalness and convenience. However, its practicality is often undermined by the vulnerability to spoofing attacks and interference from surrounding sounds, making seamless voice authentication crucial for smart glasses usage. To address this challenge, we propose AuthGlass, a voice authentication approach that leverages both air- and bone-conducted speech features to enhance accuracy and liveness detection. Aiming to gain comprehensive knowledge on speech-related acoustic and vibration features, we built a smart glasses prototype with redundant synchronized microphones: 14 air-conductive microphones and 2 bone-conductive units. In a study with 42 participants, we validated that combining sound-field and vibration features significantly improves authentication robustness and attack resistance. Furthermore, experiments demonstrated that AuthGlass maintains competitive accuracy even under various practical scenarios, highlighting its applicability and scalability for real-world deployment. 1. Introduction Nowadays, smart glasses have been rapidly advancing, with commercial products such as Microsoft HoloLens ( Mic 2025 ) and Ray-Ban Meta Glasses ( Met 2025 ) demonstrating their potential across diverse domains, including entertainment, healthcare, education, and industrial applications. As smart glasses are closely integrated with the user’s head that allows unique interaction potential, researchers explored numerous application scenarios accessibility support for visually impaired users ( Rajendran et al. 2020a ; Khan and Prakash 2017 ) and context-aware services ( Wang et al. 2024 ; Meyer et al. 2022 ) . Among various interaction modalities, voice commands have emerged as one of the most widely adopted approaches on smart glasses ( Rok 2025 ; Met 2025 ) . Voice interaction is intuitive, hands-free, and well-suited to scenarios where users’ hands are occupied, such as driving ( He et al. 2015 ; Chang et al. 2018 ) and cooking ( Majil et al. 2022 ; Bouchard et al. 2020 ) . However, as smart glasses are exposed to ambient voices, such interactions are susceptible to potential attacks, leading to severe security risks ( Peng et al. 2016 ) . To migrate this issue, various authentication methods has be proposed, including password entry ( Islam et al. 2018 ) , iris recognition ( Khade et al. 2021 ; Li and Huang 2017 ) and gaze features ( Friström et al. 2019 ) . Nevertheless, voice authentication remains the most natural complement to voice command interfaces ( Peng et al. 2016 ) , as it does not require additional interaction modalities and preserves the hands-free advantage ( Rajendran et al. 2020b ) . Although voice authentication has been extensively studied ( Kersta 1962 ; Wang et al. 2019b ; Zhang et al. 2016 ; Yan et al. 2019 ) , achieving that on smart glasses remains challenging, as only limited work has examined acoustic features tailored to this unique form factor. In contrast, for other wearable platforms such as smartphones and earables ( Zhang et al. 2016 ; Li et al. 2020 ; Feng et al. 2017 ; Blue et al. 2018 ; Meng et al. 2022 ; Gao et al. 2021 ) , researchers have investigated a wide range of methods to enable voice authentication ( Zhang et al. 2016 ; Huang et al. 2025 ; Li et al. 2020 ; Li et al. 2024b ; Meng et al. 2022 ; Blue et al. 2018 ) . While these approaches have demonstrated competitive accuracy, their direct transfer to smart glasses is non-trivial due to the unique form factor and acoustic constraints of eyewear. To address this, we present AuthGlass, an approach that leveraged vibration features and sound field features captured by smart glasses to enhance voice authentication. One of the key aspect of our system is to leverage time delay matrix and energy decrease matrix that captures the changes of sound field as the feature for authentication. To design the system, we firstly implemented a smart glasses with 14 air-conductive and 2 bone-conductive microphones to comprehensively explore these two factors. Through multiple experiments, we validated that both vibration features and sound field features were effective for authentication, and achieved even better performance of up to 0.03 equal error rate when combining them together. To evaluate the usability of AuthGlass, we further conducted attack experiments to assess its resilience against different types of attacks. The results show that both feature sets can effectively resist attacks, with success rates below 0.05. To further demonstrate the practical applicability of AuthGlass, we performed multiple experiments incorporating various real-world restrictions. The results indicate that the AuthGlass system maintains robust performance even under these practical limitations. Our key contribution include: • We propose AuthGlass, an approach that leveraged vibration features and sound field features captured by smart glasses to enhance voice authentication. One of the key factor is that we leveraged time delay matrix and energy decrease matrix as sound field feature. • By a 42-subjects experiments, we validated that using vibration features and sound field features could enhance the performance of authentication, reaching an EER of less than 0.03. • Through evaluation on the attack robustness and usability, we further validate the performance of AuthGlass under practical limitations. • We release an high-quality audio dataset of 96kHz of synchronized data among 42 subjects for future researches. 2. Related Works In this section, we briefly reviewed previous works focusing on voice interface on smart glasses, authentication for smart glasses and liveness detection for voice authentication. We also pointed out current gap for voice authentication on smart glasses. 2.1. Voice Interface for Smart Glasses As smart glasses were limited with size and shape, voice user interfaces (VUIs) have long been explored for interactions on smart glasses due to its’ naturalness and convenience. Apart from vision-based and gaze based interaction, which rely on heavy and energy consuming sensors, voice interface only requires lightweight microphones for interaction ( Palermo et al. 2025 ) , making it widely incorporated by commercial products like Ray-ban Meta ( Met 2025 ) , Xreal One Pro ( Xre 2025 ) , Rokid Glasses ( Rok 2025 ) , etc. More importantly, voice input is suitable for real-time communication and conversation-based AI functions. Ray-ban Meta utilized voice interface to control AI-powered services, while researchers also explored AI potentials on smart glasses via voice interface, especially for visual impaired people ( T P et al. 2025 ; Gamage 2024 ; Nithyaa et al. 2023 ; Rajendran et al. 2020a ) . Moreover, voice interface offers a ’touchless’ interaction for users and do not interfere with users’ gaze attention, it is especially suitable for emergency medical services ( Zhang et al. 2025 ) and industries ( Kim et al. 2016