REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization

Yong Li, Furong Jia, Dacheng Yin, Kang Rong, Fengyun Rao Jing LYU Fan Zhang · 2026

Read REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization by Yong Li, Furong Jia, Dacheng Yin, Kang Rong, Fengyun Rao Jing LYU Fan Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26861.txt.

Introduction

Li and six colleagues build REVERSE, a framework that trains image geo-localization agents to search for evidence and check it, rather than guessing from landmarks alone. The system learns three choices: where to look, what to query, and which evidence to trust, with rewards for grounding, query value, and evidence quality. With a 4B model, it beats strong retrieval baselines and rivals far larger models on Im2GPS3k and YFCC4k.

Catalog record

CREATORYong Li, Furong Jia, Dacheng Yin, Kang Rong, Fengyun Rao Jing LYU Fan Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51256
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.26861

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization Yong Li, Furong Jia, Dacheng Yin, Kang Rong, Fengyun Rao Jing LYU Fan Zhang Abstract Image geo-localization aims to determine where a photograph was taken, a task that often requires more than recognizing visible landmarks. Human experts typically solve it through an iterative workflow: they inspect informative regions, form location hypotheses, seek external evidence, and revise their judgments as new clues appear. Existing methods only partially capture this process: direct prediction methods bypass evidence acquisition altogether, while retrieval-augmented methods introduce external evidence but usually provide limited supervision on the intermediate decisions of where to search, how to query, and how to filter noisy results. We present REVERSE, a framework that reinforces the interplay between evidence search and verification to enable multi-turn agentic reasoning. REVERSE teaches three intermediate decisions: where to look, what to query, and what evidence to trust. To support this, we construct tool-grounded trajectories with annotated region selections, search observations, and geo-informative evidence labels, and introduce process rewards for visual grounding, query utility, and evidence discrimination. An offline search cache makes retrieval observations stable and reusable during reinforcement learning, enabling dense supervision over noisy search results. With a 4B model, REVERSE outperforms strong retrieval-augmented baselines and rivals substantially larger models on Im2GPS3k and YFCC4k. Code is available at https://github.com/yonglleee/REVERSE . Figure 1: (A) Agentic geo-localization fails when a model crops the wrong region and follows misleading results, or retrieves the right candidate but cannot filter distractors. (B) REVERSE fixes both: spatial supervision grounds region selection, evidence labels annotate search results, and process rewards train the model via agentic RL. 1 Introduction Image geo-localization estimates the geographic location of a photograph from its visual content [ 18 , 1 ] , with applications in navigation, urban analysis, and remote sensing. Prior methods either partition the Earth into cells and train classifiers [ 31 , 22 , 19 ] , match the image against geo-tagged databases [ 28 , 7 , 39 ] , or use large vision-language models to reason toward coordinate predictions [ 14 , 32 , 16 ] . All commit to a single prediction without querying or verifying external evidence, so performance is bounded by what the model already knows when the scene contains unfamiliar landmarks or ambiguous visual cues. Recent agentic methods address this by allowing models to interact with tools across multiple turns [ 13 , 12 , 8 , 30 ] , but tool access alone does not guarantee reliable geo-localization. Figure 1 (A) shows two representative failures: a model that crops the wrong region submits it to image search and follows misleading results to a wrong prediction; a model that retrieves the right candidate cannot separate it from distractors and again predicts incorrectly. Both failures reveal that agentic geo-localization hinges on three intermediate decisions: where to look (identifying which visual cues are geographically informative), how to query (formulating a query that retrieves relevant external evidence), and what to trust (discriminating genuine evidence from visually similar distractors). Yet none receives explicit supervision under standard final-coordinate training, and no existing method addresses all three. We present REVERSE ( R einforcing E vidence Ver ification and Se arch for Agentic Image Geo-localization), which treats these three decisions as explicit optimization targets. If the model must make observable choices at each step ( where to look , how to query , what to trust ), each choice can be supervised directly. We build a data pipeline that generates teacher trajectories annotated with region selections and per-result evidence labels, providing ground truth where final-coordinate training has none. We design process rewards for each decision and train offline against a pre-built search cache, so the full agentic reasoning loop is directly optimizable. We evaluate on Im2GPS3k [ 29 ] and YFCC4k [ 27 ] . With a 4B model, REVERSE reaches 48.3% accuracy at 25 km on Im2GPS3k, outperforming all retrieval-augmented baselines and matching models more than an order of magnitude larger. In summary, our contributions are threefold. • We introduce REVERSE , an agentic image geo-localization framework that reinforces evidence search and verification by jointly aligning tool use with spatial region selection, query formulation, and evidence discrimination across multi-turn reasoning chains. • We build a tool-grounded data generation pipeline that annotates not only final locations, but also region selections, search observations, and geo-informative evidence labels, enabling supervision over where to search, how to query, and what to trust during reasoning. • We perform agentic reinforcement learning with a composite reward that combines geographical accuracy, format compliance, tool-use quality, and evidence discrimination, allowing a 4B vision-language model to achieve strong performance on geo-localization benchmarks. 2 Related work 2.1 Image geo-localization Image geo-localization aims to predict the geographic location of a given image and has broad applications in urban analysis, navigation, remote sensing, and geospatial data mining. It has long been studied as a visual recognition problem, with early methods predicting locations through geographic partitioning, hierarchical classification, or retrieval from geo-tagged image databases [ 31 , 22 , 19 , 29 ] . Later work improves visual-location modeling with stronger backbones, and contrastive image-location alignment [ 20 , 3 , 28 , 7 ] . With the emergence of large vision-language models, recent methods increasingly cast geo-localization as a language-mediated reasoning problem, where visual cues can be described, compared, retrieved, and verified using external knowledge. Retrieval-augmented approaches ground predictions with candidate images, geographic databases, or web evidence [ 39 , 14 , 15 ] , showing the value of external database beyond closed-book visual prediction. Beyond retrieval, recent LVLM-based methods further strengthen geographic reasoning through reinforcement learning [ 17 , 32 , 16 ] . More recent agentic methods further explore multi-agent collaboration, map-based interaction, reinforced geographic reasoning, and tool-augmented hypothesis verification [ 8 , 12 , 13 ] . These works demonstrate the value of external evidence and multi-step reasoning for image geo-localization, but the search and verification process itself is rarely an explicit optimization target. 2.2 Multimodal agentic easoning. Large vision-language models are increasingly extended from static perception to interactive reasoning with external tools. Early tool-augmented systems connect foundation models with visual modules, program execution, web search, and structured environments, showing that complex multimodal tasks often require iterative perception, action, and evidence aggregation [ 35 , 21 , 26 , 34 , 33 ] . More recent work further internalizes such behaviors through cold start trajectories and reinforcement learning, enabling models to decide when to invoke tools, how to combine visual operations with textual search [ 9 , 10 , 36 , 11 , 5 , 37 ] . These studies indicate a broader shift from static multimodal understanding toward long-horizon evidence acquisition. However, most existing settings focus on general visual question answering or open-domain research tasks, where evidence only needs to support a textual answer. Image geo-localization requires spatially and geographically discriminative evidence for coordinate prediction, making reliable search and verification particularly challenging. 3 Method REVERSE recasts image geo-localization as an iterative process of visual inspection, evidence retrieval, and hypothesis verification. As illustrated in Figure 1 , effective agentic geo-localization requires the model to make three intermediate decisions: where to look , how to query ,

Read the complete text