Audio Hallucination Attacks: Probing the Reliability of Large Audio Language Models

Ashish, Sonal, Ramaneswaran, Nishit, Utkarsh, Prem, Ramani, Dinesh · 2026

Read Audio Hallucination Attacks: Probing the Reliability of Large Audio Language Models by Ashish, Sonal, Ramaneswaran, Nishit, Utkarsh, Prem, Ramani, Dinesh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29263.txt.

Description

Seth and co-authors probe whether large audio language models truly listen to their input. They build AHA-Eval, an attack suite with 6,500 question pairs. Query-based attacks ask about sounds that are absent. Audio-based attacks inject fake speech describing events that never happened. Two leading models fell for attacks at high rates. Audio Flamingo 3 reached a 95.35 percent attack success rate. Their guard dataset, AHA-Guard, cut attack success by up to 49 percent.

Catalog record

CREATORAshish, Sonal, Ramaneswaran, Nishit, Utkarsh, Prem, Ramani, Dinesh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20366
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29263

Browse the full library · About the Tower of Babel