Lifting Vision: Ground to Aerial Localization with Reasoning Guided Planning
Soham Pahari, M Srinivas, [1.0ex] School of Computer Science, UPES · 2025
Read Lifting Vision: Ground to Aerial Localization with Reasoning Guided Planning by Soham Pahari, M Srinivas, [1.0ex] School of Computer Science, UPES (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-24404.txt.
Introduction
Soham Pahari and M Srinivas reason about places using pictures alone. Most AI reasoning systems lean on text as their main medium. That limits them in spatial tasks like navigation and geo-localization. Ground-to-aerial localization is the target problem here. Given street-level images, the system must find where they sit from above.
Their framework, ViReLoc, plans and localizes in the visual domain. Step-by-step inference is encoded as images, not words. Reinforcement-style objectives train the planning. Contrastive learning aligns the ground and aerial views. Adaptive feature interaction reduces the gap between viewpoints. Experiments span diverse navigation and localization scenarios. Spatial reasoning accuracy improved consistently. Cross-view retrieval improved as well. The authors note a side benefit: no live GPS data is needed, which suits more secure navigation.
Catalog record
| CREATOR | Soham Pahari, M Srinivas, [1.0ex] School of Computer Science, UPES |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-24404
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Lifting Vision: Ground to Aerial Localization with Reasoning Guided Planning Soham Pahari, M Srinivas, [1.0ex] School of Computer Science, UPES Abstract Multimodal intelligence development recently show strong progress in visual understanding and high level reasoning. Though, most reasoning system still reply on textual information as the main medium for inference. This limit their effectiveness in spatial tasks such as visual navigation and geo-localization. This work discuss about the potential scope of this field and eventually propose an idea visual reasoning paradigm Geo-Consistent Visual Planning, our introduced framework called Visual Reasoning for Localization, or ViReLoc, which performs planning and localization using only visual representations. The proposed framework learns spatial dependencies and geometric relations that text based reasoning often suffer to understand. By encoding step by step inference in the visual domain and optimizing with reinforcement based objectives, ViReLoc plans routes between two given ground images. The system also integrates contrastive learning and adaptive feature interaction to align cross view perspectives and reduce viewpoint differences. Experiments across diverse navigation and localization scenarios show consistent improvements in spatial reasoning accuracy and cross view retrieval performance. These results establish visual reasoning as a strong complementary approach for navigation and localization, and show that such tasks can be performed without real time global positioning system data, leading to more secure navigation solutions. K eywords Ground-to-Aerial Localization \cdot Vision \cdot Reasoning Guided Planning \cdot Deep Learning \cdot Robotics 1 Introduction In this current era of large language models(LLM) [ 3 , 8 , 43 ] and at a extend to that multimodal large language models(MLLM) [ 46 , 27 ] , visual understanding has improved at a solid pace. These models show strong perception across many domains and often complete visual tasks with high accuracy [ 14 , 31 , 32 , 36 ] . Still, there are areas where progress could be done. One such area is Cross View Geo Localization through visual planning. This task predicts the location of a ground image by matching it with satellite imagery [ 9 , 22 , 24 ] and navigates between two or more locations through a visual chain of thoughts. Over the years, many methods have explored feature extraction, contrastive learning, and viewpoint transfer for this problem [ 13 , 10 , 34 ] . These models solve retrieval well, but most of them do not consider planning. They do not ask a simple but important question. Can a framework plan a journey only from visual input ? Recent work by Xi and colleagues [ 62 ] provides a strong motivation. Their study on Large Visual Models (LVM) shows that a model can produce a visual chain of thoughts with the help of reinforcement learning [ 59 ] . They call this process Visual Planning via Reinforcement Learning (VPRL). The model generates intermediate images while reasoning about the task. These images form a sequence that guides the model through complex visual steps. It also improves planning ability inside the visual space. The system reaches strong navigation results, even without language supervision. On the other side, Huang and collaborators studied city level Cross View geo-localization [ 25 ] . Their work shows the importance of robust feature learning for matching ground and aerial views. They also highlight how hard it is to deal with large viewpoint gaps, occlusion, season change, or missing information in aerial images. Their analysis shows that even with strong encoders, the model still struggles to infer geometry that is not directly visible. Traditional CVGL systems use retrieval, and the process stops there. They do not create a full understanding of the environment. They do not infer free space. They do not generate a map. They do not plan movement. Other recent studies strengthen this idea. Many multimodal systems reason mostly in text [ 19 , 68 ] . They convert visual input into language tokens and then perform logical steps. This often creates a gap between visual input and textual reasoning. Tasks that rely on spatial cues or geometric patterns usually suffer. Navigation, physical prediction, or map inference require continuous visual reasoning [ 5 , 30 ] . Language based reasoning becomes less effective for these tasks. These limitations raise a new direction. A Cross View and Geo-Localization (CVGL) system should not only retrieve a location. It should also reason through visual steps and plan movement. Learn how the ground view transforms into the aerial view also, fill gaps where aerial images lack clarity. It should recover free space and support route planning inside a connected map. This requires a unified pipeline that combines perception, reasoning, and planning. In this work we propose Visual Reasoning for Localization. We call it ViReLoc. It introduces visual reasoning into CVGL. Allows the model to think through sequential visual states. It connects these states to a navigable aerial map. It learns both retrieval and planning in a single system. Most importantly, it provides a secure way to navigate without sharing GPS (Global Positioning System), data. Our contributions are: i. Unified architecture that links cross view encoding, visual reasoning, map construction, and navigation planning. ii. Visual reasoning module that produces intermediate states to bridge the gap between ground and aerial views. iii. Differentiable planning system that constructs free space and plans routes using joint training with reward signals. This article follows a simple structure. We begin with a review of related work in section 2 . We then describe our proposed method and each stage of the process in section 3 . We list our contributions in detail. We present used datasets, experiments, evaluation metrics, and results in experiments section 4 . The article ends with a conclusion that summarizes our findings and impact in 5 section. 2 Related Work Figure 1: Dataset of sample of aerial and ground images. (a) Represent University-1632 dataset. (b) Represent CVUSA dataset. (c) Represent VIGOR dataset Cross view geo localization has grown fast with better feature learning. Yet strong viewpoint changes still cause problems. Navigation remains hard. Work on visual reasoning shows that models can plan with only images. This avoids limits from language based reasoning. Our work links ideas from both areas. 2.0.1 From Manual Features to Deep Architectures in Geo Localization: Early geo localization systems used hand made features. These features were weak under large view changes. Lin et al. [ 34 ] used HOG [ 12 ] , Gist [ 41 ] , and color histograms for aerial to ground matching. Viswanathan [ 55 ] used cross view transforms with SIFT [ 39 ] , SURF [ 7 ] , and FREAK [ 1 ] . These features were simple and clear but not strong under heavy geometry changes. They focused only on matching. They did not model how one view turns into another. They also gave no help for later navigation tasks. Deep learning changed the field. Learned features gave stronger cross view matching. Lin et al. [ 35 ] showed that CNNs work for this task. They reached 80 percent top 20 accuracy but left room to improve. Workman et al. [ 61 ] improved the design and released CVUSA. Tian et al. [ 53 ] used Faster R CNN [ 47 ] with twin networks for