MIRAGE: A Multi-modal Benchmark for Spatial Perception, Reasoning, and Intelligence
Chonghan Liu 1 and Haoran Wang 2 and Felix Henry 1 and Pu Miao 3 and Yajie Zhang 1 and Yu Zhao 4 Peiran Wu 5 1 Independent Researcher 2 Tsinghua University 3 shopee 4 Alibaba International Digital Commerce 5 University of Bristol Evaluation Code Mirage Bench · 2025
Read MIRAGE: A Multi-modal Benchmark for Spatial Perception, Reasoning, and Intelligence by Chonghan Liu 1 and Haoran Wang 2 and Felix Henry 1 and Pu Miao 3 and Yajie Zhang 1 and Yu Zhao 4 Peiran Wu 5 1 Independent Researcher 2 Tsinghua University 3 shopee 4 Alibaba International Digital Commerce 5 University of Bristol Evaluation Code Mirage Bench (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10604.txt.
Description
Chonghan Liu and co-authors wrote a 2025 paper that sets a new test for machine models of space. Knowing what things are, where they sit next to each other, and how scenes change sits at the heart of human thought. Vision models still show clear gaps on those basic skills.
Their test, called MIRAGE, grades three skills in steps of rising demand. Models count objects, judge spatial links, and then count with links in mind. Scenes are built to need fine reading, not rough guesses. Top models still fell short in clear ways on the test. The authors say the gaps point to weak inner maps of space. They offer the test as a path toward models that reason about space and time.
Catalog record
| CREATOR | Chonghan Liu 1 and Haoran Wang 2 and Felix Henry 1 and Pu Miao 3 and Yajie Zhang 1 and Yu Zhao 4 Peiran Wu 5 1 Independent Researcher 2 Tsinghua University 3 shopee 4 Alibaba International Digital Commerce 5 University of Bristol Evaluation Code Mirage Bench |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-10604