UReason: Benchmarking the Reasoning Paradox in Unified Multimodal Models
Cheng Yang, Chufan Shi, Bo Shui, Yaokang Wu, Muzi Tao, Huijuan Wang, Ivan Yee Lee Yong Liu Xuezhe Ma Taylor Berg-Kirkpatrick · 2026
Read UReason: Benchmarking the Reasoning Paradox in Unified Multimodal Models by Cheng Yang, Chufan Shi, Bo Shui, Yaokang Wu, Muzi Tao, Huijuan Wang, Ivan Yee Lee Yong Liu Xuezhe Ma Taylor Berg-Kirkpatrick (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08336.txt.
Description
Models that both understand and generate images are meant to mix text and vision in one system, but nobody knew how well their words and pictures actually line up. Cheng Yang and nine co-authors build UReason, a benchmark that tests this alignment through reasoning-guided image generation: the model thinks in words first, then draws. Their 2026 arXiv paper uses two thousand hand-checked cases across code, arithmetic, spatial, attribute, and text tasks.
Surprisingly, stripping the reasoning away and drawing from a cleaned-up prompt alone beats reasoning-guided drawing by a wide margin, even though reasoning still beats drawing with no guidance. The intended meaning in the text reasoning often fails to reach the picture. Readers get a sharp diagnostic for the next generation of unified models, and a warning that unified training does not guarantee aligned outputs.
Catalog record
| CREATOR | Cheng Yang, Chufan Shi, Bo Shui, Yaokang Wu, Muzi Tao, Huijuan Wang, Ivan Yee Lee Yong Liu Xuezhe Ma Taylor Berg-Kirkpatrick |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08336