Seeing Through the Chain: Mitigate Hallucination in Multimodal Reasoning Models via CoT Compression and Contrastive Preference Optimization

Hao Fang ∗, Jinyu Li ∗, Jiawei Kong, Tianqu Zhuang, Kuofeng Gao, Bin Chen, Shu-Tao Xia, Yaowei Wang · 2026

Read Seeing Through the Chain: Mitigate Hallucination in Multimodal Reasoning Models via CoT Compression and Contrastive Preference Optimization by Hao Fang ∗, Jinyu Li ∗, Jiawei Kong, Tianqu Zhuang, Kuofeng Gao, Bin Chen, Shu-Tao Xia, Yaowei Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03380.txt.

Description

Multimodal models that reason step by step still invent details that are not in the image. Hao Fang and 6 co-authors tackle that hallucination problem in a 2026 paper. They trace the cause to reasoning chains that lean on language habits, carry few visual cues, and waste tokens on redundant text.

Their framework, called C3PO, first compresses the chain of thought by filtering out redundant thinking tokens. It then applies contrastive preference training, pairing good reasoning traces with deliberately induced bad ones so the model learns to prefer grounded answers. The authors give a theoretical argument for the design and report steady hallucination reductions across several multimodal reasoning models and benchmarks.

Catalog record

CREATORHao Fang ∗, Jinyu Li ∗, Jiawei Kong, Tianqu Zhuang, Kuofeng Gao, Bin Chen, Shu-Tao Xia, Yaowei Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03380

Browse the full library · About the Tower of Babel