MHSA: A Lightweight Framework for M itigating H allucinations via S teered A ttention in LVLMs DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Intrusion/anomaly detection and malware mitigation

Wei Ding, Yilin Li, Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Yu Wang · 2026

Read MHSA: A Lightweight Framework for M itigating H allucinations via S teered A ttention in LVLMs DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Intrusion/anomaly detection and malware mitigation by Wei Ding, Yilin Li, Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Yu Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14966.txt.

Description

Wei Ding and six others propose MHSA, a light fix for hallucinations in large vision-language models, which sometimes describe things absent from the image. A small three-layer network learns corrected cross-modal attention, guided by a hallucination detector and the model itself. At run time the corrected attention simply replaces the original, with no changes to model weights. Tests show it curbs both kinds of hallucination, in sorting tasks and in free generation, across datasets and models.

Catalog record

CREATORWei Ding, Yilin Li, Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Yu Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62582
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14966

Browse the full library · About the Tower of Babel