MHSA: A Lightweight Framework for M itigating H allucinations via S teered A ttention in LVLMs DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Intrusion/anomaly detection and malware mitigation
Wei Ding, Yilin Li, Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Yu Wang · 2026
Read MHSA: A Lightweight Framework for M itigating H allucinations via S teered A ttention in LVLMs DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Intrusion/anomaly detection and malware mitigation by Wei Ding, Yilin Li, Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Yu Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14966.txt.
Description
Wei Ding and six others propose MHSA, a light fix for hallucinations in large vision-language models, which sometimes describe things absent from the image. A small three-layer network learns corrected cross-modal attention, guided by a hallucination detector and the model itself. At run time the corrected attention simply replaces the original, with no changes to model weights. Tests show it curbs both kinds of hallucination, in sorting tasks and in free generation, across datasets and models.
Catalog record
| CREATOR | Wei Ding, Yilin Li, Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Yu Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62582 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14966