MIRAGE: A Multi-modal Benchmark for Spatial Perception, Reasoning, and Intelligence

Chonghan Liu 1 and Haoran Wang 2 and Felix Henry 1 and Pu Miao 3 and Yajie Zhang 1 and Yu Zhao 4 Peiran Wu 5 1 Independent Researcher 2 Tsinghua University 3 shopee 4 Alibaba International Digital Commerce 5 University of Bristol Evaluation Code Mirage Bench · 2025

Read MIRAGE: A Multi-modal Benchmark for Spatial Perception, Reasoning, and Intelligence by Chonghan Liu 1 and Haoran Wang 2 and Felix Henry 1 and Pu Miao 3 and Yajie Zhang 1 and Yu Zhao 4 Peiran Wu 5 1 Independent Researcher 2 Tsinghua University 3 shopee 4 Alibaba International Digital Commerce 5 University of Bristol Evaluation Code Mirage Bench (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10604.txt.

Description

Chonghan Liu and co-authors wrote a 2025 paper that sets a new test for machine models of space. Knowing what things are, where they sit next to each other, and how scenes change sits at the heart of human thought. Vision models still show clear gaps on those basic skills.

Their test, called MIRAGE, grades three skills in steps of rising demand. Models count objects, judge spatial links, and then count with links in mind. Scenes are built to need fine reading, not rough guesses. Top models still fell short in clear ways on the test. The authors say the gaps point to weak inner maps of space. They offer the test as a path toward models that reason about space and time.

Catalog record

CREATORChonghan Liu 1 and Haoran Wang 2 and Felix Henry 1 and Pu Miao 3 and Yajie Zhang 1 and Yu Zhao 4 Peiran Wu 5 1 Independent Researcher 2 Tsinghua University 3 shopee 4 Alibaba International Digital Commerce 5 University of Bristol Evaluation Code Mirage Bench
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-10604

Browse the full library · About the Tower of Babel