MM-THEBench: Do Reasoning MLLMs Think Reasonably?

Zhidian Huang, Zijun Yao, Ji Qi, Shangqing Tu, Junxian Ma, Jinxin Liu, Weichuan Liu, Xiaoyin Che, Lei Hou, Juanzi Li · 2026

Read MM-THEBench: Do Reasoning MLLMs Think Reasonably? by Zhidian Huang, Zijun Yao, Ji Qi, Shangqing Tu, Junxian Ma, Jinxin Liu, Weichuan Liu, Xiaoyin Che, Lei Hou, Juanzi Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22735.txt.

Description

Zhidian Huang and a large team ask whether reasoning multimodal models actually think in a sound way. New models reason step by step about images and text. Their 2026 preprint, MM-THEBench, probes whether that thinking cuts hallucination, or adds new kinds of it.

Self-checking thought can steady a model, yet each extra step can also drift. The bench sorts those gains and harms across tasks. Honest grades for reasoning are now a core need. The work gives the field a shared test. It asks a sharp question in its title, and answers with data.

Catalog record

CREATORZhidian Huang, Zijun Yao, Ji Qi, Shangqing Tu, Junxian Ma, Jinxin Liu, Weichuan Liu, Xiaoyin Che, Lei Hou, Juanzi Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22735

Browse the full library · About the Tower of Babel