Exploring the Impacts of Background Noise on Auditory Stimuli of Audio-Visual eHMIs for Hearing, Deaf, and Hard-of-Hearing People Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Hu

Wenge Xu, Foroogh Hajiseyedjavadi, Debargha Dey, Tram Thi Minh Tran, Mark Colley · 2026

Read Exploring the Impacts of Background Noise on Auditory Stimuli of Audio-Visual eHMIs for Hearing, Deaf, and Hard-of-Hearing People Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Hu by Wenge Xu, Foroogh Hajiseyedjavadi, Debargha Dey, Tram Thi Minh Tran, Mark Colley (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13098.txt.

Introduction

Wenge Xu, Foroogh Hajiseyedjavadi, Debargha Dey, Tram Thi Minh Tran, and Mark Colley test how noise hurts sound cues from self driving cars. Such cars may use outer screens and sounds to talk to people on foot. The mix is called an audio visual outer interface.

Just as dim light can blur a visual cue, loud noise can mask a sound cue. The team asks how that plays out for three groups. They cover people who hear well, deaf people, and people with weak hearing. The study shows that sound cues cannot be judged in a quiet lab alone. Car teams must test them in real street noise if all walkers are to stay safe.

Catalog record

CREATORWenge Xu, Foroogh Hajiseyedjavadi, Debargha Dey, Tram Thi Minh Tran, Mark Colley
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-13098

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploring the Impacts of Background Noise on Auditory Stimuli of Audio-Visual eHMIs for Hearing, Deaf, and Hard-of-Hearing People Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3791557 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Empirical studies in HCI CCS: Human-centered computing Accessibility design and evaluation methods Wenge Xu, Foroogh Hajiseyedjavadi, Debargha Dey, Tram Thi Minh Tran, Mark Colley Abstract . External Human-Machine Interfaces (eHMIs) have been proposed to enhance communication between automated vehicles (AVs) and pedestrians, with growing interest in multi-modal designs such as audio-visual eHMIs. Just as poor lighting can impair visual cues, a loud background noise may mask the auditory stimuli. However, its effects within these systems have not been examined, and little is known about how pedestrians — particularly Deaf and Hard-of-Hearing (DHH) people — perceive different types of auditory stimuli. We conducted a virtual reality study (Hearing N=25, DHH N=11) to examine the effects of background noise (quiet and loud) on auditory stimuli (baseline, bell, speech) within an audio-visual eHMI. Results revealed that: (1) Crossing experiences of DHH pedestrians significantly differ from Hearing pedestrians. (2) Loud background noise adversely affects pedestrians’ crossing experiences. (3) Providing an additional auditory eHMI (bell/speech) improves crossing experiences. We outlined four practical implications for future eHMI design and research. † † cc-license: by 1. Introduction When crossing in front of vehicles, pedestrians rely on both implicit (e.g., speed, distance, and deceleration) ( 77 ; 81 ) and explicit communication (e.g., driver eye contact, hand gestures, or headlight flashes) ( 85 ) . In automated vehicles (AVs), the absence of a human driver removes these conventional channels. This creates two challenges: (1) The loss of explicit driver signals may increase uncertainty and ambiguity in interactions; (2) people are often poor at judging implicit communication cues, such as speed, stopping distance, and time-to-arrival ( 58 ; 86 ; 74 ) . To address these challenges, researchers have proposed external human-machine interfaces (eHMIs) to facilitate communication between AVs and vulnerable road users, improving safety, subjective crossing experiences, and behaviour ( 22 ; 60 ; 15 ; 27 ) . Yet, eHMI research has rarely involved disabled people, excluding an estimated 430 million (over 5% of the world’s population) deaf and hard-of-hearing (DHH) people in the world and potentially 700 million (i.e., 10% of the whole population) DHH people in 2050 1 1 1 WHO: Deafness and Hearing Loss ; accessed 14.08.2025 . A report from the UK has found that disability of pedestrians is a critical contributory factor to fatal or serious collisions with pedestrians 2 2 2 Reported road casualties in Great Britain: pedestrian factsheet, 2022 ; accessed 14.08.2024 , eHMI design should consider the needs of disabled people to ensure the proposed eHMI is accessible to them and create equality in transport. One proposed approach is multi-modal eHMI ( 7 ; 19 ; 18 ; 43 ) . For instance, it could be an audio-visual eHMI with visual eHMI serving as the foundation ( 35 ; 27 ; 95 ) while using auditory eHMI to enhance perceived safety ( 29 ) . The choice of the auditory eHMI could also benefit low vision and blind people ( 18 ; 88 ) or those who experience situational impairments (e.g., being distracted by secondary activities, occluded view, etc.) ( 20 ) . However, the value of audio-visual eHMI, especially auditory stimuli among DHH people, remains unclear. Environmental factors such as background noise further complicates the issue. Ambient background noise could interfere with pedestrians’ ability to detect and localise vehicles, increasing risks of injuries ( 34 ) . Loud background noise could become excessive and obscure auditory signals intended for pedestrians ( 61 ) . Despite this, only 29% of eHMI studies have included environmental noises (i.e., natural sounds and human-produced sounds), typically to enhance the simulation realism rather than to examine their interaction with auditory stimuli ( 89 ) . The investigation into how practical and useful auditory stimuli are under different noise levels for both hearing and DHH people is overlooked, which is the main gap we address in this paper. In the meantime, we aim to identify accessibility barriers that auditory eHMIs may introduce and ensure that the use of auditory cues does not inadvertently disadvantage DHH people. Contribution Statement ( 92 ) The main contributions of the paper include: (1) the first empirical virtual reality (VR) simulation evaluation of the effects of background noise ( Quiet , Loud ) on auditory stimuli ( Baseline , Bell , Speech ) on crossing experiences (trust, acceptance, perceived safety, mental load) and behaviour (eye gaze, step into the road time, early step into the road count) between hearing participants (N=25) and DHH participants (N=11); (2) four practical implications that pave the way for future eHMI design and research. 2. Related Work 2.1. DHH People and Road Crossing Both hearing and eyesight are important for acting and responding adequately in traffic situations ( 47 ) . DHH pedestrians would face similar visual challenges as Hearing pedestrians when crossing the road (i.e., obstructed views, low lighting, adverse weather conditions, dazzling) ( 40 ; 4 ) . However, they face more difficulties concerning sound direction and distance judgments due to hearing loss, which is essential to judge the location of potential threats or obstacles ( 54 ; 97 ) . A survey by 41 suggested that almost half of DHH teenagers were involved in traffic accidents as a pedestrian, 2-3 times higher than hearing teenagers. A field study in an urban environment with manually driven vehicles by 71 showed that DHH pedestrians often experienced heightened apprehension when initiating a crossing and exercised greater caution toward approaching vehicles to ensure safety. 59 suggest that pedestrians with moderate deafness are at a higher risk of being injured by a vehicle because they have difficulty in identifying the sound direction. Overall, the lack of access to auditory information has reduced feelings of safety among DHH pedestrians ( 46 ) . Over time, this could constitute a negative and fatiguing experience, discourage active travel activities like walking ( 70 ) , resulting in reduced physical activity levels ( 14 ) and broadening inequities in mobility ( 48 ) . According to the World Health Organization ( 94 ) , hearing aids and hearing implants are commonly used hearing technologies to help DHH people with hearing aids mainly intended to help people with mild to moderate hearing loss 3 3 3 https://www.nidcd.nih.gov/health/hearingaids ; accessed 14.08.2025 and hearing implants to help provide a sense of sound to people with severe to profound deafness 4 4 4 https://www.nidcd.nih.gov/health/cochlear-implants ; accessed 14.08.2025 . However, these technologies come with their own issues. Hearing aids have consistently failed to improve sound localisation and could even impair it ( 97 ) . Studies suggest that only about one in five people who would benefit from a hearing aid use one, potentially due to comfort level and perceived benefits not meeting the expectation ( 63 ) . As for hearing implants, they process sounds electronically and transmit electrical stimulation to the

Read the complete text