Investigation of Whisper ASR Hallucinations Induced by Non-Speech Audio

Mateusz Barański, Jan Jasiński, Julitta Bartolewska, Stanisław Kacprzak, Marcin Witkowski, Konrad Kowalczyk · 2025

Read Investigation of Whisper ASR Hallucinations Induced by Non-Speech Audio by Mateusz Barański, Jan Jasiński, Julitta Bartolewska, Stanisław Kacprzak, Marcin Witkowski, Konrad Kowalczyk (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11378.txt.

Introduction

Mateusz Barański and co-authors study fake speech from silence in the Whisper recognizer in a 2025 paper. Speech models can hallucinate words, and this team asks what non speech sounds trigger Whisper to invent text. Sounds of many kinds were fed to the model at test time to provoke false transcripts.

A set of stock hallucinations showed up again and again across sounds. Mixing such sounds into real speech bred more of the same fakes. The team then built a bag of known hallucinations that can scrub transcripts after the fact. That cleanup cut word error rates and guards users from the worst false lines.

Catalog record

CREATORMateusz Barański, Jan Jasiński, Julitta Bartolewska, Stanisław Kacprzak, Marcin Witkowski, Konrad Kowalczyk
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11378

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Investigation of Whisper ASR Hallucinations Induced by Non-Speech Audio Thanks: This research was supported by the National Science Centre, Poland under Grant 2021/42/E/ST7/00452, the National Centre for Research and Development, Poland under Grant INFOSTRATEG-IV/0029/2022, and by program ”Excellence initiative – research university” for the AGH University of Krakow. We gratefully acknowledge Polish high-performance computing infrastructure PLGrid (HPC Centers: ACK Cyfronet AGH) for providing computer facilities and support within computational Grant PLG/2024/017135. For the purpose of Open Access, the author has applied a CC-BY public copyright licence to any Author Accepted Manuscript (AAM) version arising from this submission. Mateusz Barański, Jan Jasiński, Julitta Bartolewska, Stanisław Kacprzak, Marcin Witkowski, Konrad Kowalczyk Abstract Hallucinations of deep neural models are amongst key challenges in automatic speech recognition (ASR). In this paper, we investigate hallucinations of the Whisper ASR model induced by non-speech audio segments present during inference. By inducting hallucinations with various types of sounds, we show that there exists a set of hallucinations that appear frequently. We then study hallucinations caused by the augmentation of speech with such sounds. Finally, we describe the creation of a bag of hallucinations (BoH) that allows to remove the effect of hallucinations through the post-processing of text transcriptions. The results of our experiments show that such post-processing is capable of reducing word error rate (WER) and acts as a good safeguard against problematic hallucinations. I Introduction Recent improvements in Artificial Intelligence (AI), especially deep neural models, allow for impressive results in many tasks. However, with the increase of performance approaching (or sometimes surpassing) capabilities of the human brain, those systems exhibit tendencies to make errors that also mimic the failures of a human. In this work, we investigate the errors of Automatic Speech Recognition (ASR) that occur when an ASR system generates a transcript for audio that does not contain any speech content. Anthropomorphisation of those systems leads to labeling these errors as hallucinations . The issue of hallucination in the context of AI is most often discussed in reference to Natural Language Generation (NLG) and Large Language Models (LLM) to describe general falsehoods produced by those systems [ 1 , 2 ] . However, in most cases confabulation would be a better analogy, with researchers also categorizing some false responses as lies and deception [ 3 , 4 ] . The term hallucinations better fits the specific errors of false perception of input signals in Computer Vision (CV) [ 5 ] , ASR [ 6 ] or Neural Machine Translation (NMT) [ 7 ] systems. Their cause can be attributed to over-reliance on patterns from training [ 8 ] , overconfidence in model predictions [ 9 ] , and unreliable training data. However, not all errors of those systems should be categorized as hallucinations. For instance, in ASR mishearing could be better described as phonetic errors caused by ambiguous stimuli or phoneme confusion (”the sky” recognized as ”this guy” [ 10 ] ). In [ 6 ] hallucinations are defined as predictions without phonetic or semantic connection to the reference, a definition we agree on, but still find problematic since those connections are difficult to estimate. In this work, we omit this problem by working with transcriptions generated by ASR from non-speech audio. In this study, we focus on the Whisper ASR model [ 11 ] that provides state-of-the-art recognition for multiple languages [ 12 ] . Despite the high quality of Whisper’s outputs and a set of Whisper’s internal heuristics that help to avoid failure cases [ 11 ] , it does have a tendency to generate hallucinations and produce incorrect repetitions of previously recognized text (known as looping), e.g. ”Welcome to the New York City City of New York City of New York”. We classify looping as one type of hallucinations, as opposed to [ 6 ] where it is treated as a separate type of error. It has also been shown that Whisper hallucinations can be of a violent or sexual nature, which can cause serious problems in real-world applications [ 13 ] . This paper investigates how Whisper hallucinates based on its responses to non-speech audio, effectively analyzing its vulnerability to ”accidental” adversarial example attacks [ 14 ] . Firstly, we examine how the type of sound and its duration affects hallucination frequency and the created outputs. Then, we analyze how the augmentation of speech utterances with such audio (including noises and natural sounds) can influence the rate of hallucinations. Based on inference results for non-speech audio signals, we further create a so-called Bag of Hallucinations (BoH). It consists of the most commonly hallucinated outputs filtered for use in hallucination identification and removal tasks. Finally, we propose a post-processing algorithm that aims to reduce the impact of hallucinations, and show that it can be used to reduce Word Error Rate (WER) of transcriptions generated by the ASR model. II Collecting hallucinations from non-speech audio recordings and their analysis We begin our study by performing inference using Whisper ASR on an exhaustive set of audio recordings that do not contain any speech. This way, any text recognized by the model can be categorized as a hallucination, eliminating uncertainties in hallucination detection. We collect a raw list of such hallucinations and study error patterns in Whisper’s transcriptions, focusing on the most frequently appearing hallucinations and text repetitions known as looping. II-A Experimental setup In our experiments we use the Whisper [ 11 ] large-v3 model 1 1 1 https://github.com/openai/whisper as current state-of-the-art ASR. Unless stated otherwise, we set language to English, temperature to zero (for deterministic inference), while other parameters are left at default values (e.g. greedy decoding). Transcriptions are normalized using the provided OpenAI basic normalizer. Next, we detect and remove looping (understood as a subsequent repetition of the previously recognized text fragment). In experiment 1, we aim to collect an exhaustive list of hallucinations induced by non-speech audio input. To this end, we create a large dataset which contains various types of sound files, composed of Audioset [ 15 ] , Musan [ 16 ] , UrbanSound8K [ 17 ] , and FSD50K [ 18 ] . Based on the provided tags, all audio files that could include speech, human voices and singing, were removed from the dataset. We also removed all music since tagging was not reliable enough to discriminate between instrumental and vocal songs. The resulting dataset includes 253 278 files from Audioset, 931 from Musan, 8 733 from UrbanSound8K, 29 074 from FSD50K. We extended this dataset with white and pink noises of varying lengths (0.1s to 30s in 0.1s steps) at different volumes (-30 to -2 dBFS in 2dB steps). Files of silence were also added at the aforementioned lengths, which yielded 9 301 noise and silence files. The final dataset of non-speech audio consists of 301 317 audio files. In experiment 2, which analyses hallucinations depending on the length of non-speech audio, we create a dataset of non-speech audio files of various duration ranging from 1 s to 30 s, by selecting a subset of 200 audio files from the dataset used in experiment 1, which were next either cropped or concatenated (and then cut) to obtain audio files of the desired duration. In experiment 3, we

Read the complete text