MULTI-AGENT GEOSPATIAL COPILOTS FOR REMOTE SENSING WORKFLOWS
Heming Liao † , Fuxun Yu † , Ruopu Li ¶ , Iraklis Anagnostopoulos § , Dimitrios Stamoulis ‡∗ · 2025
Read MULTI-AGENT GEOSPATIAL COPILOTS FOR REMOTE SENSING WORKFLOWS by Heming Liao † , Fuxun Yu † , Ruopu Li ¶ , Iraklis Anagnostopoulos § , Dimitrios Stamoulis ‡∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16254.txt.
Introduction
Satellite images guide work in farming, forests, cities, and climate study, but a single AI agent can struggle as the tasks grow. A 2025 paper by Chaehong Lee and co-authors presents GeoLLM-Squad, a system that splits the work among a team of software agents. One part plans and assigns jobs, while expert sub-agents carry out the remote sensing tasks.
The system rests on two open frameworks, AutoGen and GeoLLM-Engine, so new tools can be added in a modular way. Jobs range from watching city growth to guarding forests and tracking farm land. In tests, the multi-agent setup held up as tasks got harder, while single-agent systems fell behind. It scored 17 percent higher on correct agent behavior than the best prior systems in the comparison.
Catalog record
| CREATOR | Heming Liao † , Fuxun Yu † , Ruopu Li ¶ , Iraklis Anagnostopoulos § , Dimitrios Stamoulis ‡∗ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-16254
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MULTI-AGENT GEOSPATIAL COPILOTS FOR REMOTE SENSING WORKFLOWS Thanks: ∗ Equal contribution ⋄ \diamond Work while at Microsoft; currently new affiliations. Heming Liao † , Fuxun Yu † , Ruopu Li ¶ , Iraklis Anagnostopoulos § , Dimitrios Stamoulis ‡∗ Abstract We present GeoLLM-Squad, a geospatial Copilot that introduces the novel multi-agent paradigm to remote sensing (RS) workflows. Unlike existing single-agent approaches that rely on monolithic large language models (LLM), GeoLLM-Squad separates agentic orchestration from geospatial task-solving , by delegating RS tasks to specialized sub-agents. Built on the open-source AutoGen and GeoLLM-Engine frameworks, our work enables the modular integration of diverse applications, spanning urban monitoring, forestry protection, climate analysis, and agriculture studies. Our results demonstrate that while single-agent systems struggle to scale with increasing RS task complexity, GeoLLM-Squad maintains robust performance, achieving a 17% improvement in agentic correctness over state-of-the-art baselines. Our findings highlight the potential of multi-agent AI in advancing RS workflows. Chaehong Lee †∗⋄ , Varatheepan Paramanayakam §∗ , Andreas Karatzas § , Yanan Jian † , Michael Fore †⋄ , I Introduction Remote sensing (RS) workflows are inherently complex, requiring diverse datasets, tools, and analytical methods, all employed with tacit geoscientific expertise [ 1 , 2 , 3 , 4 , 5 ] . Consider a geoscientist: if they use surface land temperature (SLT) products or electro-optical (EO) imagery under clear-sky conditions, they might substitute these with ground-station temperature data or synthetic aperture radar (SAR) images when cloud coverage exceeds a threshold. Unfortunately, encoding such nuanced “SAR-over-EO” logic into existing geospatial Copilots requires cumbersome prompting [ 6 ] . Monolithic large language models (LLMs) become a bottleneck for achieving meaningful spatiotemporal scale in real-world RS applications due to their finite context windows and token capacities [ 7 ] . Multi-agent Copilots have emerged as a novel paradigm, allowing agents to be added to or removed from a team of experts without extra prompt tuning, enabling extensibility and simplifying development across numerous tasks [ 8 ] . This work aims to harness the untapped potential of multi-agency in RS workflows. We present GeoLLM-Squad, a multi-agent system that separates agentic orchestration and geospatial task-solving , capable of scaling to various RS tasks, including urban analysis, forestry, agriculture, and climate studies. Built on the open-source AutoGen [ 9 ] and GeoLLM-Engine [ 5 ] frameworks, we conduct comprehensive assessment of recent advancements in multi-agent orchestration [ 8 , 10 ] and workflow-based reasoning [ 11 , 12 , 13 , 14 ] against human-expert curated workflows. Through this study, we identify key limitations of existing methods in geospatial contexts and propose a hybrid multi-agent approach that outperforms state-of-the-art baselines by up to 17% in agentic correctness. TABLE I: Overview of recent geospatial agent paradigms. Tool usage Agency Application Methods Single-turn/tool Single-agent Satellite Vision, Urban [ 15 , 16 , 17 , 18 , 19 , 20 , 21 ] , [ 22 , 23 ] Map, Agriculture, Forest [ 24 ] , [ 25 , 26 , 27 , 28 , 29 , 30 , 31 ] Multi-turn/tool Single-agent Satellite Vision [ 1 , 2 , 3 , 4 , 5 ] DataOps, Climate [ 32 , 33 ] , [ 34 ] Multi-turn/tool Multi-agent Satellite Vision, Map GeoLLM-Squad DataOps, Agriculture, Climate, Urban, Forest II Background and Novelty There is rapid progress in applying geospatial foundation models (GFMs) to RS tasks (Table I ). Early approaches follow a single-turn-single-agent paradigm [ 17 , 20 ] , where a fine-tuned LLM performs a narrowly defined task based on predetermined workflows. Recent advancements [ 5 , 33 ] have introduced multi-turn-single-agent schemes that employ multi-tool APIs to support more complex, long-horizon tasks. However, these systems rely on static workflows (e.g., load-detect-plot “chains” in satellite vision) [ 5 ] . More critically, by centralizing all prompting, decision-making, reasoning, and tool execution within a single agent, these methods become bottlenecks when scaling to additional RS tasks [ 6 ] . Fig. 1: GeoLLM-Squad is a multi-agent Copilot for RS workflows that builds on the open-source AutoGen [ 9 ] and GeoLLM-Engine [ 5 ] frameworks. Our orchestrator supports various geospatial agents and API tools to handle diverse workflows such as climate analysis or urban planning tasks. TABLE II: Overview of geospatial products, metrics, and datasets used in GeoLLM-Squad workflows. Application Metric Dataset/Product Resolution/Dates User prompt examples (shortened for illustration) Agriculture NDVI, Ref B2 MOD13A3 [ 35 ] , MOD09GA [ 36 ] 1km, 2024 From NDVI, recommend crop rotation areas in Brisbane Climate LST, AOD550 MYD11A2 [ 37 ] , MCD19A2 [ 38 ] 1km, 2024 From LST, identify dangerous heatwave regions in Bundaberg Urban Built-S, Popul. GHS-BUILT-S/POP [ 39 , 40 ] 3 arcsec, 2020 From 2020 pop., report overpopulation hotspots for Gympie Forest Canopy, Treeloss Tree Cover/Loss GFC [ 41 ] 1 arcsec, 2020 From 2020 canopy, recommend reforestation areas in Ipswich Vision Detection, LCC xView, FAIR, fMoW, ben [ 42 , 43 , 44 , 45 , 46 , 47 , 48 ] – From xView1, detect and plot aiplanes in Sydney Multi-agent orchestration, such as composition-based [ 10 ] and ledger-based scheduling [ 8 ] , represents a novel agentic paradigm. Through comprehensive experimentation, we identify critical shortcomings in existing approaches when applied to RS workflows: ledger orchestration relies on frequent scheduling GPT calls [ 7 ] , which becomes prohibitively expensive for RS tasks that involve loading, processing, analyzing, and plotting geospatial data. In contrast, while ledger-free compositional prompting eliminates this overhead, it struggles with error recovery [ 5 ] . To address these limitations, GeoLLM-Squad introduces a hybrid approach that combines composition-based reasoning with the iterative ledger-reassessment capabilities, as a “best-of-both-worlds” solution. III Methodology Agentic Environment. We implement GeoLLM-Squad (Figure 1 ) on top of two components: GeoLLM-Engine [ 5 ] as the agentic frontend and AutoGen as the model serving backend [ 9 ] . The frontend integrates interactive map UIs with conversational ChatGPT-like functionality and API tools. The backend enables LLM function-calling for multi-agent communication and orchestration schemes [ 8 , 10 ] . Geospatial tasks . We consider five RS workflows (Table II ) related to urban, agriculture, forest, climate, and satellite-vision studies. For forest data, we utilized tree canopy cover and loss from the Global Forest Change dataset [ 41 ] . For urban, we used the (Sentinel-2 and Landsat) GHS-BUILT-S and GHS-POP datasets from the Global Human Settlement layer [ 39 , 40 ] . Climate workflows employed MODIS Terra products, namely 500m and 1km-resolution Aerosol Optical Depth (AOD 055) and land surface temperature (LST) [ 38 , 37 ] . Similarly, for agriculture data, we leveraged 1-Month/1km L3 Vegetation Indices and Band 2 surface reflectance [ 35 , 36 ] . MODIS products were downloaded from NASA Earthdata Search [ 49 ] for the entire year 2024. Without loss of generality, our analysis covers the eastern Australian continent. For satellite vision tasks, we used xView1, xView2 (xBD), FAIR1M, xView3, SARFish, fMoW, and BigEarthNet [ 42 , 43 , 44 , 45 , 46 , 47 , 48 ] . All products (HDF, GeoTIFF) were standardized into GeoPandas formats for frontend-engine integration [ 5 ] . Agent tools . We implement tools APIs to