A dataset and model for recognition of audiologically relevant environments for hearing aids: AHEAD-DS and YAMNet+
Henry Zhong, Jörg M. Buchholz, Julian Maclaren, Simon Carlile, Richard Lyon · 2025
Read A dataset and model for recognition of audiologically relevant environments for hearing aids: AHEAD-DS and YAMNet+ by Henry Zhong, Jörg M. Buchholz, Julian Maclaren, Simon Carlile, Richard Lyon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10360.txt.
Introduction
Henry Zhong and co-authors build a shared sound library and a starter model to help hearing aids recognise where their wearer is, in a 2025 paper. A hearing aid works better when it knows the scene, such as a quiet room or a busy street. Past sound collections were private, patchy, or labelled in ways that do not fit hearing care. The team set out to fix that base problem.
They merged and cleaned several open sound collections into one dataset, AHEAD-DS, with labels that matter for hearing devices. Alongside it they release OpenYAMNet, a sound recognition model small enough to run on a phone linked to hearing aids or earphones. On their test set the model reached strong scores for accuracy and average precision. Both pieces are public, giving other teams a fair way to compare new models.
Catalog record
| CREATOR | Henry Zhong, Jörg M. Buchholz, Julian Maclaren, Simon Carlile, Richard Lyon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-10360
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A dataset and model for recognition of audiologically relevant environments for hearing aids: AHEAD-DS and YAMNet+ Henry Zhong, Jörg M. Buchholz, Julian Maclaren, Simon Carlile, Richard Lyon Abstract Scene recognition of audiologically relevant environments is important for hearing aids; however, it is challenging, in part because of the limitations of existing datasets. Datasets often lack public accessibility, completeness, or audiologically relevant labels, hindering systematic comparison of machine learning models. Deploying these models on resource-constrained edge devices presents another challenge. Our solution is two-fold: we leverage several open source datasets to create AHEAD-DS, a dataset designed for scene recognition of audiologically relevant environments, and introduce YAMNet+, a sound recognition model. AHEAD-DS aims to provide a standardised, publicly available dataset with consistent labels relevant to hearing aids, facilitating model comparison. YAMNet+ is designed for deployment on edge devices like smartphones connected to hearing devices, such as hearing aids and wireless earphones with hearing aid functionality; serving as a baseline model for sound-based scene recognition. YAMNet+ achieved a mean average precision of 0.83 and accuracy of 0.93 on the testing set of AHEAD-DS across fourteen categories of audiologically relevant environments. We found that applying transfer learning from the pretrained YAMNet model was essential. We demonstrated real-time sound-based scene recognition capabilities on edge devices by deploying YAMNet+ to an Android smartphone. Even with a Google Pixel 3 (a phone with modest specifications, released in 2018), the model processes audio with approximately 50ms of latency to load the model, and an approximate linear increase of 30ms per 1 second of audio. Our website and code https://github.com/Australian-Future-Hearing-Initiative . Keywords : scene recognition, sound recognition, audiologically relevant labels, machine hearing, computer audition, AHEAD-DS, YAMNet+ 1 Introduction State of the art hearing devices incorporate scene recognition in order to identify audiological environments and apply appropriate processing (filters, amplification, beam forming, etc) to improve a user’s hearing experience [ 3 ] . Several machine learning (ML) models have been proposed for scene recognition [ 24 ] . However, there are several limitations: ML models are challenging to port to edge devices [ 4 ] and datasets have inconsistent labels (As outlined in Table 1 ). It is important that models can run on edge devices to preserve privacy by avoiding the transmission of sensitive data and to minimise the cost of data transmission. However, not all models are immediately deployable to devices, such as hearing aids and wireless earphones with hearing aid functionality (henceforth will be collectively referred to as hearing devices), or to portable devices such as smartphones that operate in tandem with hearing devices. Resource constraints and data format compatibility must be overcome for model deployment on the edge [ 23 ] . Models are trained and tested using datasets with different scene labels and are thus not directly comparable. These datasets are either not public or incomplete, and general-purpose sound datasets do not have labels that are necessarily relevant to hearing devices [ 15 ] . We were motivated to address these problems for several reasons: There is a gap in publicly available standardised datasets for scene recognition of audiologically relevant environments for hearing devices, and an open-source baseline ML model designed for edge devices is currently unavailable. Our ultimate goal is to improve the hearing experience for users of hearing devices. This paper makes the following contributions: • A description of a sound dataset named Another HEaring AiD scenes Data Set (AHEAD-DS). This dataset was created for the purpose of scene recognition of audiologically relevant environments for hearing devices, which allows comparison of models using a standardised dataset with consistent labels. The dataset is released under a permissive licence, in a ready-to-use state, divided into training/validation/testing sets and annotated with the ground truth. • A description of a ML model called YAMNet+ for sound based scene recognition. The model can act as a baseline model for further development of sound based scene recognition models. The model is released under a permissive licence, including model definitions, training, testing code, and code to convert it into a format deployable to edge devices. • We implemented YAMNet+, trained it using AHEAD-DS, and presented benchmark results including precision, recall and inference speed. We have deployed the model to a smartphone to demonstrate it works on an edge device. This paper is organised as follows. The second section presents an overview of existing datasets and audiologically relevant environment labels. The third section presents an overview of several sound recognition models. The fourth section provides a description of AHEAD-DS and how the dataset was created. The fifth section describes the YAMNet+ sound recognition model. Section six presents the results of training and testing YAMNet+ using AHEAD-DS. Section seven discusses the overall findings of this paper and describes the possible future direction of the research. Section eight draws some conclusions. 2 Scene Recognition Datasets for Hearing Devices There are several relevant studies (Table 1 ) involving scene recognition of audiologically relevant environments for hearing devices. The availability of a standardised dataset helped drive tremendous advancements in computer vision [ 2 ] . It is hoped that a dataset for scene recognition for hearing devices will similarly drive advancements. Hence, we sought such a dataset, but noted the following challenges with existing datasets relevant to hearing devices. • Datasets may be proprietary, with a restrictive licence and not uploaded to a publicly accessible repository. This was an issue with four studies [ 33 , 8 , 11 , 39 ] . • Data used in the studies were not recorded. Data was processed on-the-fly and raw sound discarded in three studies [ 14 , 18 , 5 ] . • In one study [ 15 ] , the dataset available online does not match the description in the published paper. • The dataset is a mix of secondary sources, but the specific subset from these sources are unknown. This was an issue for three studies [ 15 , 33 , 31 ] . • The dataset is a mix of secondary sources but there is ambiguity in the mixing procedure. For example, there may be pseudo random procedures during processing of sound files, which are not clearly explained in the paper. This was an issue with two studies [ 15 , 31 ] . • Each study uses datasets with different labels; therefore, they are not easily comparable. This is the case for all studies in Table 1 . Additionally, several large general-purpose datasets exist for sound recognition. Datasets such as AudioSet [ 9 ] , UrbanSound8K [ 28 ] , ESC50 [ 27 ] , and TAU scenes [ 35 ] provide extensive training material for ML models. However, labels are either too specific or too general to be used directly for the purpose here. For example, in AudioSet recordings can be labelled bus or truck. This level of granular sound recognition is unnecessary: it is only necessary to recognise and respond to motor vehicle noises to improve the hearing experience. However, data can still be used through transfer learning or labels can be remapped to more broad labels. Conversely, TAU scenes provide location-based recordings which are too general, such as at airports and metro stations. The sound of a motor vehicle