UReason: Benchmarking the Reasoning Paradox in Unified Multimodal Models

Cheng Yang, Chufan Shi, Bo Shui, Yaokang Wu, Muzi Tao, Huijuan Wang, Ivan Yee Lee Yong Liu Xuezhe Ma Taylor Berg-Kirkpatrick · 2026

Read UReason: Benchmarking the Reasoning Paradox in Unified Multimodal Models by Cheng Yang, Chufan Shi, Bo Shui, Yaokang Wu, Muzi Tao, Huijuan Wang, Ivan Yee Lee Yong Liu Xuezhe Ma Taylor Berg-Kirkpatrick (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08336.txt.

Description

Models that both understand and generate images are meant to mix text and vision in one system, but nobody knew how well their words and pictures actually line up. Cheng Yang and nine co-authors build UReason, a benchmark that tests this alignment through reasoning-guided image generation: the model thinks in words first, then draws. Their 2026 arXiv paper uses two thousand hand-checked cases across code, arithmetic, spatial, attribute, and text tasks.

Surprisingly, stripping the reasoning away and drawing from a cleaned-up prompt alone beats reasoning-guided drawing by a wide margin, even though reasoning still beats drawing with no guidance. The intended meaning in the text reasoning often fails to reach the picture. Readers get a sharp diagnostic for the next generation of unified models, and a warning that unified training does not guarantee aligned outputs.

Catalog record

CREATORCheng Yang, Chufan Shi, Bo Shui, Yaokang Wu, Muzi Tao, Huijuan Wang, Ivan Yee Lee Yong Liu Xuezhe Ma Taylor Berg-Kirkpatrick
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08336

Browse the full library · About the Tower of Babel