GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal Models
Yushuo Zheng, Jiangyong Ying, Huiyu Duan, Chunyi Li, Zicheng Zhang, Jing Liu, Xiaohong Liu, Guangtao Zhai · 2025
Read GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal Models by Yushuo Zheng, Jiangyong Ying, Huiyu Duan, Chunyi Li, Zicheng Zhang, Jing Liu, Xiaohong Liu, Guangtao Zhai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-13259.txt.
Introduction
Yushuo Zheng and 7 co-authors release GeoX-Bench, a benchmark for finding where a ground photo was taken by matching it to satellite views. Large multimodal models do well on many tasks, yet their skill at cross-view location and pose had not been tested. Such skill matters for navigation, self-driving, and outdoor robots.
GeoX-Bench pairs panoramic and satellite images from many cities and countries, with a large set of questions for training and testing. The authors test twenty-five leading models on location and pose tasks. Models handled location fairly well but dropped sharply on pose, and extra training on the bench data lifted their cross-view skill a great deal.
Catalog record
| CREATOR | Yushuo Zheng, Jiangyong Ying, Huiyu Duan, Chunyi Li, Zicheng Zhang, Jing Liu, Xiaohong Liu, Guangtao Zhai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-13259
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal Models Yushuo Zheng, Jiangyong Ying, Huiyu Duan, Chunyi Li, Zicheng Zhang, Jing Liu, Xiaohong Liu, Guangtao Zhai Abstract Large multimodal models (LMMs) have demonstrated remarkable capabilities across a wide range of tasks, however their knowledge and abilities in the cross-view geo-localization and pose estimation domains remain unexplored, despite potential benefits for navigation, autonomous driving, outdoor robotics, etc . To bridge this gap, we introduce GeoX-Bench , a comprehensive Bench mark designed to explore and evaluate the capabilities of LMMs in cross -view Geo -localization and pose estimation. Specifically, GeoX-Bench contains 10,859 panoramic-satellite image pairs spanning 128 cities in 49 countries, along with corresponding 755,976 question-answering (QA) pairs. Among these, 42,900 QA pairs are designated for benchmarking, while the remaining are intended to enhance the capabilities of LMMs. Based on GeoX-Bench, we evaluate the capabilities of 25 state-of-the-art LMMs on cross-view geo-localization and pose estimation tasks, and further explore the empowered capabilities of instruction-tuning. Our benchmark demonstrate that while current LMMs achieve impressive performance in geo-localization tasks, their effectiveness declines significantly on the more complex pose estimation tasks, highlighting a critical area for future improvement, and instruction-tuning LMMs on the training data of GeoX-Bench can significantly improve the cross-view geo-sense abilities. The GeoX-Bench is available at https://github.com/IntMeGroup/GeoX-Bench . 1 Introduction Accurately determining the geographic location and pose of the camera is a fundamental challenge in computer vision and robotics, with broad implications for applications such as autonomous driving, robotic navigation, and embodied AI agents operating in real-world environments. These scenarios often involve degraded or unavailable GPS signals and magnetic interference, necessitating robust visual-based geospatial reasoning, i.e. , cross-view geo-localization and pose estimation. However, the inherent complexity of the physical world, manifested in its large-scale spatial layout and diverse visual appearance, makes this task particularly difficult. Recent advances in large multimodal models (LMMs), such as GPT-4V ( 29 ) and LLaVA ( 24 ) have demonstrated impressive capabilities in free-form visual reasoning across a range of tasks. Despite this progress, their proficiency in geospatial grounding, the ability to understand and reason about geographic location and spatial orientation, remains largely unexamined, due to the absence of standardized, large-scale benchmarks specifically designed to assess such capabilities. Existing efforts to evaluate the geographic understanding of LMMs have primarily focused on satellite image geo-localization, which provides only coarse-grained location information and lacks the estimation of camera pose ( 14 ) . Another task, geo-guessing, requires models to predict the approximate location of a ground-level image only based on its visual content ( 33 ) . However, this task does not involve the cross-view geo-localization and pose estimation problem, which aims to determine both the geographic location and pose based on the captured ground-level image and the aerial perspective image. This more comprehensive task demands a deeper and more structured understanding of spatial relationships in the visual scene, presenting a more rigorous test of LMMs’ geospatial reasoning capabilities. Figure 1: Geographic composition of the GeoX-Bench dataset by land cover type. The benchmark is weighted toward developed regions, with Urban/Built-up (36.33%) and Residential/Commercial (27.75%) areas constituting the majority. Natural and rural environments, including Forests (14.26%), Agriculture (12.60%), and Rangeland/Barren (9.05%), provide a geospatially representative representative diverse settings for evaluation. In this paper, we introduce a new benchmark termed GeoX-Bench for evaluating the capabilities of LMMs on cross-view geo-localization and pose estimation tasks.GeoX-Bench comprises 10,859 panoramic-satellite image pairs covering 128 cities across 49 countries, along with 755,976 carefully curated corresponding question-answering (QA) pairs. Among these, 42,900 QA pairs are curated for standardized benchmarking, while the remaining are intended to enhance model capabilities through instruction tuning. GeoX-Bench defines two core tasks, including (1) geo-localization , i.e. , predicting the geographic location of a ground-level perspective image given a satellite image; and (2) geo-pose estimation , i.e. , inferring the camera’s orientation of a ground-level perspective image given a satellite image. Based on GeoX-Bench, we establish rigorous evaluation protocols, and evaluate the capabilities of 25 state-of-the-art LMMs and instruction-tuned LMMs on cross-view geo-localization and pose estimation tasks. Our experimental results reveal that while contemporary LMMs achieve promising performance on geo-localization, their capabilities degrade considerably on the more challenging pose estimation task. Moreover, the significant improvement brought by the instruaction-tuning suggests that the capabilities of LMMs on both cross-view geo-localization and pose estimation tasks can be further improved. Our main contributions are as follows: • We introduce GeoX-Bench, a large-scale benchmark comprising 10,859 panoramic-satellite image pairs and 755,976 curated QA pairs designed for evaluating LMMs’ capabilities on cross-view geo-localization and pose estimation. • We propose rigorous evaluation metrics for both tasks and benchmark 25 state-of-the-art LMMs and instruction-tuned variants. • We provide a comprehensive analysis of the performance of LMMs on both tasks, highlighting the strengths and weaknesses of current models and identifying critical areas for future improvement. Figure 2: Illustration of the GeoX-Bench benchmark tasks. The tasks include heading estimation with known or unknown camera locations, location verification on a satellite map, location selection, and map selection from candidates. These tasks evaluate models’ abilities to reason over ground-to-satellite image pairs for localization and pose understanding. 2 Related Work 2.1 Large Multimodal Models and Their Spatial Reasoning Capability The rapid evolution from Large Language Models (LLMs) ( 3 ) to Large Multimodal Models (LMMs) such as LLaVA ( 24 ) , GPT-4 ( 29 ) , and Gemini ( 11 ) has unlocked advanced capabilities in processing both text and vision ( 8 ; 9 ; 36 ; 35 ) . LMMs have been increasingly applied to embodied intelligence ( 27 ) , where spatial awareness is essential ( 19 ) . Early explorations, such as LLMGeo ( 32 ) for coarse location reasoning, LLaVA-3D ( 43 ) for pose understanding, and All-Angles Bench ( 38 ) , demonstrate emerging capabilities, while recent competitive benchmarks ( 42 ) broaden evaluation perspectives. However, existing studies address spatial skills in isolation and lack the precision required for real-world applications. To address this, our work proposes fine-grained cross-view localization and pose-estimation tasks that more directly evaluate integrated spatial reasoning. 2.2 Cross-View Geo-Localization and Geo-Pose Estimation Evaluation methods have evolved alongside vision–language models. Foundational benchmarks such as VQA ( 12 ) established multimodal reasoning, while recent works like MME ( 10 ) and MMMU ( 39 ) assess complex, expert-level tasks. Broader evaluation platforms ( 40 ) and perceptual studies ( 5 ) further diversify assessment frameworks. In remote sensing, benchmarks like RSVQA ( 26 ) and GeoChat ( 20 ) focus primarily on aerial imagery, while immersive-environment benchmarks ( 15 ; 18 ; 16 ; 17 ) assess medical or panoramic understanding. Despite these efforts, a gap persists: systematic evaluation of ground-to-satellite spatial reasoning. Existing cross-view datasets—CVUSA ( 34 ) , VIGOR ( 45 ) , OmniCity ( 23 ) , LLMGeo ( 32 ) , CVGlobal ( 46 ) —provide strong foundations yet remain fragmented and geographically biased. GeoX-Bench unifies six diverse datasets to create the first geographically broad, multi-view benchmark designed specifically to assess both fine-grained geo-localization and orientation reasoning, as illustrated in Figure 1 . 3 GeoX-Bench Figure 3: The GeoX-Bench data curation pipeline, from source sampling to final quality control.