When Good Sounds Go Adversarial: Jailbreaking Audio-Language Models with Benign Inputs
Bodam Kim, Hiskias Dingeto, Taeyoun Kwon, Dasol Choi, DongGeon Lee, Haon Park, JaeHoon Lee, Jongho Shin · 2025
Read When Good Sounds Go Adversarial: Jailbreaking Audio-Language Models with Benign Inputs by Bodam Kim, Hiskias Dingeto, Taeyoun Kwon, Dasol Choi, DongGeon Lee, Haon Park, JaeHoon Lee, Jongho Shin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03365.txt.
Description
Dingeto and co-authors show a sound-based attack on audio language models in a 2025 paper. Their method, WhisperInject, hides harmful payloads inside harmless clips like weather questions. The tweaks stay tiny enough that people still hear the benign message, yet the model can be pushed to output banned content.
A two-stage process first learns what harmful output to aim for, then bakes it into a carrier clip by gradient tuning. Tests hit success rates of sixty to seventy-eight percent across five models and two benchmarks. Readers get a warning that voice interfaces open a covert attack path.
Catalog record
| CREATOR | Bodam Kim, Hiskias Dingeto, Taeyoun Kwon, Dasol Choi, DongGeon Lee, Haon Park, JaeHoon Lee, Jongho Shin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-03365