Object Hallucination-Free Reinforcement Unlearning for Vision-Language Models
Kaidi Jia, Yujie Lin, Chengyi Yang, Jiayao Ma, Jinsong Su · 2026
Read Object Hallucination-Free Reinforcement Unlearning for Vision-Language Models by Kaidi Jia, Yujie Lin, Chengyi Yang, Jiayao Ma, Jinsong Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08031.txt.
Description
Kaidi Jia and coauthors tackle machine unlearning for vision-language models, which may need to forget private or copyrighted content. Older methods retrain mainly the language part, so visual knowledge often survives and the model may invent objects that are not in an image.
Their framework, HFRU, works on the vision encoder to remove meaning at a deeper level. A two-stage design first disrupts alignment, then applies reinforcement optimization with rewards that favor valid substitute answers and punish hallucination. On object recognition and face identity tasks, the method reports over ninety-eight percent forgetting and retention with very little added hallucination.
Catalog record
| CREATOR | Kaidi Jia, Yujie Lin, Chengyi Yang, Jiayao Ma, Jinsong Su |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08031