GeoVista: Visually Grounded Active Perception for Ultra-High-Resolution Remote Sensing Understanding
Jiashun Zhu, Ronghao Fu, Jiasen Hu, Nachuan Xing, Xu Na, Xiao Yang, Zhiwen Lin, Weipeng Zhang, Lang Sun, Zhiheng Xue, Haoran Liu, Weijie Zhang, Bo Yang, College of Computer Science, Technology, Jilin University, China, [-3pt] Key Laboratory of Symbolic Computation, Knowledge Engineering of Ministry of Education {zhujs25,hujs5522}@mails.jlu.edu.cn , {furh,ybo}@jlu.edu.cn · 2026
Read GeoVista: Visually Grounded Active Perception for Ultra-High-Resolution Remote Sensing Understanding by Jiashun Zhu, Ronghao Fu, Jiasen Hu, Nachuan Xing, Xu Na, Xiao Yang, Zhiwen Lin, Weipeng Zhang, Lang Sun, Zhiheng Xue, Haoran Liu, Weijie Zhang, Bo Yang, College of Computer Science, Technology, Jilin University, China, [-3pt] Key Laboratory of Symbolic Computation, Knowledge Engineering of Ministry of Education {zhujs25,hujs5522}@mails.jlu.edu.cn , {furh,ybo}@jlu.edu.cn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14475.txt.
Introduction
Jiashun Zhu and colleagues propose GeoVista, a planning perception framework for ultra-high-resolution remote sensing. Existing models inspect regions with zooming tools, but single paths can lose context and revisit evidence. GeoVista builds a global plan first, then verifies regions through branch inspection while maintaining an evidence state. The team introduces APE-GRO, a cold-start corpus for Global-Region-Object reasoning. An Observe-Plan-Track mechanism handles observation, inspection and tracking, with GRPO rewards. Experiments on RSHR-Bench, XLRS-Bench and LRS-VQA show top performance.
Catalog record
| CREATOR | Jiashun Zhu, Ronghao Fu, Jiasen Hu, Nachuan Xing, Xu Na, Xiao Yang, Zhiwen Lin, Weipeng Zhang, Lang Sun, Zhiheng Xue, Haoran Liu, Weijie Zhang, Bo Yang, College of Computer Science, Technology, Jilin University, China, [-3pt] Key Laboratory of Symbolic Computation, Knowledge Engineering of Ministry of Education {zhujs25,hujs5522}@mails.jlu.edu.cn , {furh,ybo}@jlu.edu.cn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60926 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14475
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GeoVista: Visually Grounded Active Perception for Ultra-High-Resolution Remote Sensing Understanding Jiashun Zhu, Ronghao Fu, Jiasen Hu, Nachuan Xing, Xu Na, Xiao Yang, Zhiwen Lin, Weipeng Zhang, Lang Sun, Zhiheng Xue, Haoran Liu, Weijie Zhang, Bo Yang, College of Computer Science, Technology, Jilin University, China, [-3pt] Key Laboratory of Symbolic Computation, Knowledge Engineering of Ministry of Education {zhujs25,hujs5522}@mails.jlu.edu.cn , {furh,ybo}@jlu.edu.cn Abstract Interpreting ultra-high-resolution (UHR) remote sensing images requires models to search for sparse and tiny visual evidence across large-scale scenes. Existing remote sensing vision-language models can inspect local regions with zooming and cropping tools, but most exploration strategies follow either a one-shot focus or a single sequential trajectory. Such single-path exploration can lose global context, leave scattered regions unvisited, and revisit or count the same evidence multiple times. To this end, we propose GeoVista , a planning-driven active perception framework for UHR remote sensing interpretation. Instead of committing to one zooming path, GeoVista first builds a global exploration plan, then verifies multiple candidate regions through branch-wise local inspection, while maintaining an explicit evidence state for cross-region aggregation and de-duplication. To enable this behavior, we introduce APEX-GRO , a cold-start supervised trajectory corpus that reformulates diverse UHR tasks as Global-Region-Object interactive reasoning processes with a unified, scale-invariant spatial representation. We further design an Observe-Plan-Track mechanism for global observation, adaptive region inspection, and evidence tracking, and align the model with a GRPO-based strategy using step-wise rewards for planning, localization, and final answer correctness. Experiments on RSHR-Bench, XLRS-Bench, and LRS-VQA show that GeoVista achieves state-of-the-art performance. Code and dataset are available at GeoVista . 1 Introduction Ultra-high-resolution (UHR) remote sensing images typically cover large geographic areas ( 6 ; 16 ) , while task-relevant evidence may appear as sparse, tiny, and spatially scattered regions. This mismatch between scene scale and evidence scale makes UHR interpretation different from natural image understanding. A model is expected not only to recognize local visual patterns, but also to decide where to search, which regions warrant closer inspection, and how to integrate evidence observed at different scales. Therefore, UHR remote sensing tasks naturally call for multi-scale observation, progressive evidence acquisition, and sequential decision-making ( 22 ; 35 ) . Existing studies mainly address this challenge from two directions. One line of work reduces visual redundancy through one-shot region selection or static visual pruning, including text-guided visual pruning methods, GeoLLaVA-8K ( 34 ) , and C2F ( 22 ) . These methods improve efficiency by selecting compact visual evidence, but their focusing decisions are usually made before reasoning proceeds and cannot be easily revised. Another line of work equips models with interactive observation operations, such as cropping, resolution adjustment, and local zooming, as in ZoomEarth ( 19 ) and GeoEyes ( 35 ) . These methods enable fine-grained inspection during inference, but their exploration is often organized as a fixed or single-path process, making it difficult to coordinate multiple candidate regions under complex scene layouts. Figure 1: Comparison of active perception paradigms and performance. As illustrated in Figure 1 , this design leads to a recurring limitation that we refer to as single-trajectory bias . Single-focus approaches, such as ZoomEarth ( 19 ) , perform one-shot cropping to enlarge local details, but they may discard global context and miss spatially scattered targets. Repeated-focus approaches, such as GeoEyes ( 35 ) , support iterative observation through multi-step zooming, but their search process often follows a depth-first trajectory toward a single local region. Once the model commits to an incomplete or incorrect path, other relevant regions may remain unexplored. Moreover, without an explicit evidence state, the model cannot reliably distinguish newly discovered evidence from regions that have already been verified, resulting in missed detections or duplicated counting. As shown in Figure 2 , most existing models invoke observation tools only once or twice on average, which is insufficient for complex UHR tasks that require multi-region evidence acquisition. Figure 2: Performance comparison of different models on XLRS-Bench. The blue bars represent the Mean Accuracy, while the red dashed line indicates the Average Turns required for each method. This motivates a central question: how can a model decide where to look, at what scale to inspect, and when to stop, while coordinating global search, local verification, and evidence aggregation? To answer this question, we propose GeoVista , a planning-driven active perception framework for UHR remote sensing understanding. Given a task and a global observation, GeoVista first generates a structured exploration plan over multiple candidate regions of interest. It then performs branch-wise verification, adaptively re-focuses uncertain regions, and updates an explicit evidence state that records inspected locations, verified findings, and their spatial references. The final answer is produced by aggregating evidence across branches, which expands search coverage while preserving global context and reducing duplicated evidence. Training such a framework is challenging because standard VQA-style supervision provides only final answers and does not specify how a model should search across scales. We therefore construct APEX-GRO , a cold-start supervised trajectory corpus that teaches the model to express UHR tasks as cross-scale interactive reasoning processes with a discrete, scale-invariant spatial syntax across Global, Region, and Object levels. Based on this initialization, we introduce an Observe-Plan-Track mechanism to coordinate global observation, region planning, branch-wise inspection, and evidence tracking. Finally, we apply a GRPO-based alignment strategy with step-wise rewards for planning quality, localization progress, and final answer correctness. As shown in Figure 2 , GeoVista achieves the highest mean accuracy on XLRS-Bench. The higher average-turn curve reflects that the model spends additional observations when adaptive multi-region verification is needed, rather than following a fixed single-path process., GeoVista achieves the highest mean accuracy on XLRS-Bench. The higher average-turn curve reflects that the model spends additional observations when adaptive multi-region verification is needed, rather than following a fixed single-path process. 2 Related Works Remote Sensing Vision-Language Models. Recent multimodal large language models (MLLMs), including proprietary systems such as GPT-4 ( 1 ) and Gemini ( 32 ) , as well as open-source model families such as LLaVA ( 18 ; 17 ; 15 ) and Qwen-VL ( 3 ; 39 ; 4 ) , have shown strong visual-language understanding capabilities. To adapt such models to aerial and satellite imagery, remote sensing VLMs align RS-specific visual encoders with large language models, leading to systems such as RSGPT ( 11 ) , SkyEyeGPT ( 45 ) , GeoChat ( 14 ) , EarthMind ( 27 ) , and EarthVL ( 38 ) . Recent high-resolution extensions, such as GeoLLaVA-8K ( 34 ) , further enlarge the visual context for remote sensing images. However, most of these methods still treat UHR interpretation as a one-shot encoding problem, where a fixed visual token budget must balance global coverage and local granularity. This makes it difficult to capture tiny, sparse, and spatially distributed evidence in large-scale scenes. Tool-Interleaved Visual Reasoning. Beyond static image-text understanding, recent work has explored tool-interleaved visual reasoning, where models dynamically acquire visual evidence during the reasoning process. The “Thinking with Images” paradigm ( 29 ) extends textual Chain-of-Thought reasoning by inserting visual perception steps into intermediate reasoning trajectories. General-domain systems such as DeepEyes ( 46 ) , SenseNova-MARS ( 7 ) , Vision-R1 ( 12 ) , and MedVR ( 13 )