Improving Pretrained YAMNet for Enhanced Speech Command Detection via Transfer Learning
Sidahmed Lachenani, Hamza Kheddar, Mohamed Ouldzmirli · 2025
Read Improving Pretrained YAMNet for Enhanced Speech Command Detection via Transfer Learning by Sidahmed Lachenani, Hamza Kheddar, Mohamed Ouldzmirli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19030.txt.
Introduction
Sidahmed Lachenani, Hamza Kheddar, and Mohamed Ouldzmirli sharpen a pretrained audio model so it can hear spoken commands, in a 2025 paper. Voice commands drive many smart devices, and accuracy decides whether they feel helpful or clumsy. Rather than build a model from zero, the team took YAMNet, a network already trained on broad audio, and retrained it for commands by transfer learning. They used a standard, richly labeled command data set.
Careful data augmentation and feature choices lifted the model step by step. The final version recognized the set commands with 95.28 percent accuracy. The authors present the result as a fresh benchmark for command recognition. They also frame it as proof that transfer learning can turn a general ear into a precise one at modest cost.
Catalog record
| CREATOR | Sidahmed Lachenani, Hamza Kheddar, Mohamed Ouldzmirli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-19030
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Pretrained YAMNet for Enhanced Speech Command Detection via Transfer Learning Sidahmed Lachenani, Hamza Kheddar, Mohamed Ouldzmirli Abstract This work addresses the need for enhanced accuracy and efficiency in speech command recognition systems, a critical component for improving user interaction in various smart applications. Leveraging the robust pretrained YAMNet model and transfer learning, this study develops a method that significantly improves speech command recognition. We adapt and train a YAMNet deep learning model to effectively detect and interpret speech commands from audio signals. Using the extensively annotated Speech Commands dataset (speech_commands_v0.01), our approach demonstrates the practical application of transfer learning to accurately recognize a predefined set of speech commands. The dataset is meticulously augmented, and features are strategically extracted to boost model performance. As a result, the final model achieved a recognition accuracy of 95.28%, underscoring the impact of advanced machine learning techniques on speech command recognition. This achievement marks substantial progress in audio processing technologies and establishes a new benchmark for future research in the field. I Introduction Speech command recognition is increasingly pivotal in applications such as voice-activated assistants and smart devices, enabling seamless human-computer interaction [ 1 ] . However, traditional methods often demand significant computational resources and extensive datasets, presenting challenges for real-time performance in resource-limited environments [ 2 ] . Recent advances in deep learning ( DL ( DL )) have transformed audio processing, making speech recognition models more accurate and resilient [ 3 ] . Among these is YAMNet ( YAMNet ), a DL model optimized for audio classification [ 4 ] . Pre-trained on extensive audio data, YAMNet supports transfer learning ( TL ( TL )), enabling adaptation to new tasks with minimal retraining. This study leverages TL to improve speech command recognition by fine-tuning YAMNet . Using MATLAB’s Audio Toolbox, we adapted YAMNet to recognize a specific set of commands. The Speech Commands dataset [ 5 ] , a well-regarded benchmark, was used for training and evaluation, providing 32,465 samples across 12 classes. The goal is to achieve high recognition accuracy by extracting unique acoustic features through advanced TL techniques. This system aims to significantly enhance voice-controlled applications and expand potential use in smart home environments. The findings have implications for advancing robust speech recognition, improving interaction with voice-activated devices, and supporting decision-making in IoT applications. The contributions of this research include: • Enhanced YAMNet feature extraction for speech command recognition, leveraging pre-trained capabilities to improve recognition of specific commands. • Comprehensive model configuration testing , identifying the optimal architecture for effective speech command classification. • Targeted hyperparameter optimization , fine-tuning variables like learning rate and batch size to maximize accuracy on unseen data. The paper is organized as follows: Section II reviews related studies, establishing the foundation for this research. Section III -A introduces the dataset, describing composition and preprocessing. Section III -B details the proposed model, especially YAMNet adaptation for improved feature extraction. Section III -C describes model configuration and performance optimization. Section IV discusses findings and model performance, while Section V concludes with future research directions and implications for advancing speech recognition. II Related work Recent advancements in speech command recognition have been largely driven by the integration of deep learning ( DL ) techniques. Traditional approaches, such as HMM and GMM , have been widely employed in speech recognition. However, these methods often fall short in terms of accuracy and efficiency, especially in resource-constrained environments. They typically require substantial amounts of training data and computational resources, which can limit their practicality in real-time applications [ 6 , 7 ] . The advent of DL has revolutionized the field of audio processing, enabling the development of more sophisticated models capable of handling the complexities of speech recognition with greater precision. \Acp CNN, RNN , and their variants, including LSTM ( LSTM ) networks [ 8 , 9 ] , have been successfully applied to various speech recognition tasks, including biomedical applications [ 10 , 11 ] . These models have demonstrated superior performance in capturing the temporal and spectral features of audio signals, resulting in significant improvements in speech recognition accuracy [ 12 ] . One of the most notable advancements in this domain is the application of TL . TL involves adapting a pre-trained model, originally trained on a large dataset, to a new but related task with minimal additional training. This approach has proven particularly effective in speech recognition, where large labeled datasets are often scarce. For instance, models like Google’s Speech Commands Model [ 13 ] and OpenAI’s Wav2Vec [ 14 ] have leveraged TL to achieve high performance in recognizing short speech commands with limited training data. YAMNet , developed by Google, is another exemplary DL model specifically designed for audio classification tasks. Pre-trained on a large-scale audio dataset, YAMNet has been applied in various applications, including environmental sound classification and audio event detection. Its architecture, based on the MobileNetV1 model, is lightweight and well-suited for TL , making it an ideal candidate for tasks like speech command recognition in resource-constrained environments. Recent investigations have demonstrated the effectiveness of TL in diverse speech recognition applications. For example, Tang et al. [ 15 ] illustrate the utilization of deep residual learning for compact keyword detection, highlighting how TL optimizes performance with limited datasets. Similarly, McMahan and colleagues [ 16 ] describe how integrating different datasets, such as UrbanSounds, with speech recognition models enhances noise immunity and robustness. Additionally, in another application, Valliappan [ 17 ] uses YAMNet to identify gun models from audio clips effectively. This study capitalizes on YAMNet ’s architecture to extract pivotal features from gunshot sounds, demonstrating its versatility in audio classification for enhancing forensic and security solutions. This research builds on these advancements by applying TL to the YAMNet model for the specific task of speech command recognition. It aims to enhance the model’s performance by leveraging the distinct acoustic features of the Speech Commands dataset, contributing to the development of more efficient and accurate voice-controlled systems. Our work not only advances the understanding of TL in speech recognition but also provides practical insights into its application in intelligent personal assistants and IoT ( IoT ) devices. III Methodology III-A Dataset Summary A notable contribution to the field of speech command recognition is the Speech Commands dataset, introduced by [ 5 ] . This dataset serves as a standard benchmark for developing and evaluating speech command recognition models. It contains 65,000 one-second utterances of 30 short words, recorded by thousands of individuals, making it particularly suitable for training models to detect simple speech commands in noisy environments. This study uses a subset of the dataset, including 32,465 audio samples. Each sample is associated with one of 12 categories (”yes”, ”no”, ”up”, ”down”, ”left”, ”right”, ”on”, ”off”, ”stop”, ”go”), along with ”unknown” and ”background” sounds. To enhance the dataset and improve model robustness, we augmented the audio data by adding background noise segments. This augmentation allows the model to better recognize spoken commands in real-world, noisy environments, thereby increasing both accuracy and reliability in speech command detection tasks. The distribution of audio samples across these categories is illustrated in Figure 1 , providing a visual overview of the number of samples per category.