Investigating Safety Vulnerabilities of Large Audio-Language Models under Speaker Emotional Variations
Bo-Han Feng, Chien-Feng Liu, Yu-Hsuan Li Liang, Chih-Kai Yang, Szu-Wei Fu, Zhehuai Chen, Ke-Han Lu, Sung-Feng Huang, Chao-Han Huck Yang, Yu-Chiang Frank Wang, Yun-Nung Chen, Hung-yi Lee · 2025
Read Investigating Safety Vulnerabilities of Large Audio-Language Models under Speaker Emotional Variations by Bo-Han Feng, Chien-Feng Liu, Yu-Hsuan Li Liang, Chih-Kai Yang, Szu-Wei Fu, Zhehuai Chen, Ke-Han Lu, Sung-Feng Huang, Chao-Han Huck Yang, Yu-Chiang Frank Wang, Yun-Nung Chen, Hung-yi Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16893.txt.
Introduction
Bo-Han Feng leads eleven co-authors in a 2025 study of voice-based AI safety. Large audio-language models hear speech and answer in language. Safety testing has mostly used flat, neutral voices. Real users, though, speak with feelings that change how words land.
The team built harmful spoken requests recorded in several emotions. Each request also came at different emotional strengths. They then tested several leading audio models for unsafe replies. Safety swung widely depending on which emotion the speaker used. Medium-strength emotion often proved riskiest, not the strongest delivery. The authors argue that safety training must include emotional voices. Without that step, real-world use stays less safe than lab tests suggest.
Catalog record
| CREATOR | Bo-Han Feng, Chien-Feng Liu, Yu-Hsuan Li Liang, Chih-Kai Yang, Szu-Wei Fu, Zhehuai Chen, Ke-Han Lu, Sung-Feng Huang, Chao-Han Huck Yang, Yu-Chiang Frank Wang, Yun-Nung Chen, Hung-yi Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16893
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Investigating Safety Vulnerabilities of Large Audio-Language Models under Speaker Emotional Variations Bo-Han Feng, Chien-Feng Liu, Yu-Hsuan Li Liang, Chih-Kai Yang, Szu-Wei Fu, Zhehuai Chen, Ke-Han Lu, Sung-Feng Huang, Chao-Han Huck Yang, Yu-Chiang Frank Wang, Yun-Nung Chen, Hung-yi Lee Abstract Large audio-language models (LALMs) extend text-based LLMs with auditory understanding, offering new opportunities for multimodal applications. While their perception, reasoning, and task performance have been widely studied, their safety alignment under paralinguistic variation remains underexplored. This work systematically investigates the role of speaker emotion. We construct a dataset of malicious speech instructions expressed across multiple emotions and intensities, and evaluate several state-of-the-art LALMs. Our results reveal substantial safety inconsistencies: different emotions elicit varying levels of unsafe responses, and the effect of intensity is non-monotonic, with medium expressions often posing the greatest risk. These findings highlight an overlooked vulnerability in LALMs and call for alignment strategies explicitly designed to ensure robustness under emotional variation, a prerequisite for trustworthy deployment in real-world settings. † † address: National Taiwan University NVIDIA 1 Introduction Recent advances in large language models (LLMs) [ 1 , 2 ] have revolutionized AI research, extending their impact to speech processing [ 3 , 4 ] . In particular, large audio-language models (LALMs) [ 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 ] augment text-based LLMs with auditory understanding, opening new possibilities for multimodal models and speech technologies. Although LALMs’ auditory perception [ 17 ] , downstream performance [ 18 , 19 , 20 , 21 ] , reasoning ability [ 22 , 23 , 24 ] , and biases [ 25 ] have been extensively studied, research on their safety alignment has only just begun [ 26 , 27 , 28 , 29 ] . Safety alignment, which aims to prevent harmful outputs such as misinformation or self-harm, is particularly challenging for LALMs because their behavior can be influenced not only by semantic content but also by paralinguistic and acoustic cues. Prior work has shown that factors such as sound effects [ 27 ] , languages [ 29 ] , accents [ 27 , 29 ] , and intonation [ 27 ] can bypass safety mechanisms, yet the impact of speaker emotion, a fundamental aspect of communication, remains underexplored. Investigating whether emotions can trigger safety vulnerabilities is essential for two reasons. First, if certain emotional expressions consistently elicit harmful behaviors, they may provide a new pathway for jailbreaking [ 30 ] , where models are manipulated to bypass safety guardrails. Second, even when users act in good faith, they may unintentionally provoke unsafe responses from LALMs, which could in turn lead to real-world social harms. Motivated by this, we systematically investigate how speaker emotion affects LALM safety. We construct a dataset of malicious speech instructions synthesized with a text-to-speech model [ 31 ] under controlled conditions: each instruction is expressed across multiple emotions and intensities, with semantic content and speaker identity held identical. Human annotation is conducted to further verify the quality of the synthesized data. Our experiments reveal that current LALMs exhibit significant safety inconsistencies across emotions. Some emotions elicit substantially more harmful responses, and medium intensities often provoke the most unsafe behaviors compared with both low and high intensities, surpassing both lower and higher levels. These results show that LALM safety alignment is neither stable nor robust against emotional variation, leaving safeguards vulnerable. Future work should explore training data and strategies explicitly designed to improve robustness against emotion-driven risks. Overall, our contributions are: (1) the first study to examine the interaction between speakers’ emotions and the safety alignment of LALMs, and (2) uncovering the inconsistency of LALMs’ safety alignment under emotional variations, where certain emotions and intensities disproportionately provoke unsafe and harmful responses. Our dataset is available at https://huggingface.co/LALM-emotional-vulnerability . 2 Related Work Prior studies have examined how the safety alignment of LALMs can be compromised through the speech modality. Yang et al. [ 26 ] show that LALMs are more susceptible to safety failures from spoken inputs than from textual inputs with the same semantic content. Xiao et al. [ 27 ] and Hughes et al. [ 28 ] demonstrate that paralinguistic and acoustic cues such as tone, emphasis, speaking rate, and noises can further destabilize model behavior. Roh et al. [ 29 ] investigate jailbreak attempts that exploit variations in languages and accents of spoken instructions. There are also several benchmarks assessing the safety alignment of LALMs [ 32 , 33 ] . However, these efforts do not provide a systematic study of how emotional cues may introduce safety vulnerabilities, despite emotion being a central component of human communication. This gap motivates this study. Figure 1: Overview of our dataset construction and experiments. AdvBench supplies prompts for the TTS model, and CREMA-D provides emotional reference speech. The generated queries are verified by calibrated annotators, and after safety testing on LALMs, two metrics, the non-refusal rate (NRR) and the unsafe rate (UR), are reported to assess the impact of emotions on LALMs’ response safety. 3 Dataset Construction We describe the dataset construction process, illustrated in Fig. 1 , to analyze the safety vulnerabilities of LALMs under different speaker emotions. The dataset construction process consists of three phases: (1) harmful query collection , where we first gather harmful queries, (2) speech query synthesis , where the collected queries are verbalized as emotional speech using a text-to-speech (TTS) model, and (3) human annotation , where annotators label both the emotion and its corresponding intensity for subsequent analysis. The details of these phases are described in the following subsections. 3.1 Harmful Query Collection We begin by collecting harmful queries to synthesize malicious speech instructions. Harmful queries are prompts that request unsafe information or actions, such as instructions for producing illegal drugs. Following prior work [ 26 , 27 , 32 ] , we adopt AdvBench [ 34 ] , which contains 520 textual queries across five security categories: misinformation, disinformation, toxicity, spam, and sensitive information. Its diversity and broad use in LLM safety research [ 35 ] make it a suitable basis for our study. 3.2 Speech Query Synthesis We employ CosyVoice 2 0.5B [ 31 ] as the TTS model to synthesize emotional speech instructions from the harmful queries collected in AdvBench. The speech instructions are generated in six emotions: neutral, angry, disgusted, fearful, happy, and sad. To ensure that the synthesized instructions express the intended emotions, we use CREMA-D [ 36 ] as the reference dataset. CREMA-D provides detailed annotations for both emotion categories (the six emotions above) and emotion levels (low, medium, high, and unspecified). Specifically, given a textual query, we synthesize emotional speech instructions by sampling a reference speech from CREMA-D for each non-neutral emotion and each specified intensity level, while keeping speaker characteristics fixed. For the neutral case, a neutral reference sample is used. Each synthesized sample is then manually verified for naturalness, emotional expressiveness, and correctness of the annotated emotion level, as detailed in Sec. 3.3 . Table 1: The non-refusal rate (NRR, %) and unsafe rate (UR, %) of the investigated LALMs. “Text-only” denotes results obtained by directly using the original textual queries instead of synthesized speech