Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning
Aaron Bell, Amit Aides, Amr Helmy, Arbaaz Muslim, Aviad Barzilai, Aviv Slobodkin, Bolous Jaber, David Schottlander, George Leifman, Joydeep Paul, Mimi Sun, Nadav Sherman, Natalie Williams, Per Bjornsson, Roy Lee, Ruth Alcantara, Thomas Turnbull, Tomer Shekel, Vered Silverman, Yotam Gigi, Adam Boulan · 2025
Read Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning by Aaron Bell, Amit Aides, Amr Helmy, Arbaaz Muslim, Aviad Barzilai, Aviv Slobodkin, Bolous Jaber, David Schottlander, George Leifman, Joydeep Paul, Mimi Sun, Nadav Sherman, Natalie Williams, Per Bjornsson, Roy Lee, Ruth Alcantara, Thomas Turnbull, Tomer Shekel, Vered Silverman, Yotam Gigi, Adam Boulan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18318.txt.
Introduction
Aaron Bell, with Amit Aides and fifty-eight co-authors, introduces Earth AI in a 2025 paper on geospatial analysis. Geospatial data describes places and conditions across the planet, from satellite images to population counts. Its volume, varied scales, and patchiness make thorough analysis hard.
Earth AI combines foundation models, meaning large pretrained models, for imagery, population, and environment data. A Gemini-powered reasoning engine answers multi-step questions across those models and outside data sources. Benchmarks show the combined models predict better together than apart. On a new crisis-scenario benchmark, the agent delivered timely insights that link raw data to decisions people can act on.
Catalog record
| CREATOR | Aaron Bell, Amit Aides, Amr Helmy, Arbaaz Muslim, Aviad Barzilai, Aviv Slobodkin, Bolous Jaber, David Schottlander, George Leifman, Joydeep Paul, Mimi Sun, Nadav Sherman, Natalie Williams, Per Bjornsson, Roy Lee, Ruth Alcantara, Thomas Turnbull, Tomer Shekel, Vered Silverman, Yotam Gigi, Adam Boulan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 124 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-18318
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning Aaron Bell, Amit Aides, Amr Helmy, Arbaaz Muslim, Aviad Barzilai, Aviv Slobodkin, Bolous Jaber, David Schottlander, George Leifman, Joydeep Paul, Mimi Sun, Nadav Sherman, Natalie Williams, Per Bjornsson, Roy Lee, Ruth Alcantara, Thomas Turnbull, Tomer Shekel, Vered Silverman, Yotam Gigi, Adam Boulanger, Alex Ottenwess, Ali Ahmadalipour, Anna Carter, Behzad Vahedi, Charles Elliott, David Andre, Elad Aharoni, Gia Jung, Hassler Thurston, Jacob Bien, Jamie McPike, Juliet Rothenberg, Kartik Hegde, Kel Markert, Kim Philipp Jablonski, Luc Houriez, Monica Bharel, Phing VanLee, Reuven Sayag, Sebastian Pilarski, Shelley Cazares, Shlomi Pasternak, Siduo Jiang, Thomas Colthurst, Yang Chen, Yehonathan Refael, Yochai Blau, Yuval Carny, Yael Maguire, Avinatan Hassidim, James Manyika, Tim Thelin, Genady Beryozkin, Gautam Prasad, Luke Barrington, Yossi Matias, Niv Efron, Shravya Shetty Abstract Geospatial data offers immense potential for understanding our planet. However, the sheer volume and diversity of this data along with its varied resolutions, timescales, and sparsity pose significant challenges for thorough analysis and interpretation. This paper introduces Earth AI, a family of geospatial AI models and agentic reasoning that enables significant advances in our ability to unlock novel and profound insights into our planet. This approach is built upon foundation models across three key domains—Planet-scale Imagery, Population, and Environment—and an intelligent Gemini-powered reasoning engine. We present rigorous benchmarks showcasing the power and novel capabilities of our foundation models and validate that when used together, they provide complementary value for geospatial inference and their synergies unlock superior predictive capabilities. To handle complex, multi-step queries, we developed a Gemini-powered agent that jointly reasons over our multiple foundation models along with large geospatial data sources and tools. On a new benchmark of real-world crisis scenarios, our agent demonstrates the ability to deliver critical and timely insights, effectively bridging the gap between raw geospatial data and actionable understanding. \keepXColumns \reportnumber \uselogo 1 Introduction Understanding signals from our planet and reasoning about their effect on our livelihoods has inspired human curiosity and innovation for millennia, from the earliest origins of folklore as a guide to natural wisdom, to the first applications of computer science for weather forecasting ( Lynch 2008 ) . Decades of siloed geospatial data from satellites ( Donlon et al. 2012 ; Drusch et al. 2012 ) , sensors ( Gorelick et al. 2017 ; Hersbach et al. 2020 ; Muñoz-Sabater et al. 2021 ) , and demographic records ( Data Commons 2025a ; Data Commons 2025b ) have posed a significant challenge to cross-domain analysis. To address this, the field of Geospatial AI (GeoAI) ( Iyer et al. 2025 ) has evolved from specialized models to general-purpose Foundation Models for Earth Observation ( Zhu et al. 2024 ) . This shift, driven by large-scale datasets ( Jakubik et al. 2023 ; Wang et al. 2023 ) and benchmarks ( Mai et al. 2024 ) , has culminated in agentic systems where Large Language Models (LLMs) reason over geospatial data, tested by new frameworks ( Kao et al. 2025 ) and reasoning benchmarks ( Yerramilli et al. 2025 ; Dihan et al. 2025 ) . Our work builds on these foundations to propose a new paradigm for planetary analysis. We introduce “Earth AI”, an interoperable family of geospatial AI models orchestrated by a customizable geospatial reasoning agent to create a holistic, multi-modal view of the Earth. Using Foundation Models (FMs) and LLM based reasoning, we build generalizable systems that surpass the limitations of single-purpose models and are capable of generating novel and actionable insights across a wide spectrum of planetary questions (see Figure 1 for an overview). Our approach leverages three categories of Earth data: Imagery , Population and Environment . For each category, we developed novel, foundation Earth AI Models that demonstrate state of the art performance in benchmark tasks. Imagery incorporates satellite, aerial and ground level imagery, sensor observations and related models ( Gorelick et al. 2017 ) of the planet, including mapping of urban and agricultural landscapes ( Sirko et al. 2021 ; Sirko et al. 2024 ; Goroshin et al. 2023 ; Dua et al. 2024 ) , classifying global land cover ( Brown et al. 2022 ) , discovering temporal urban patterns ( Deng et al. 2025 ) , producing multi-source compact embeddings ( Brown et al. 2025 ) and the Remote Sensing Foundations vision backbones and multimodal models. Population encompasses observation and analysis of humans and their impact on the earth, including maps and data about the built environment ( Weiss et al. 2020 ) , simulation and optimization of mobility patterns and transportation systems (e.g., traffic, migration) ( Aktay et al. 2020 ; Cook et al. 2025 ; Zhang et al. 2024a ; Choudhury et al. 2024 ; Haddad et al. 2024 ) , demographic and socioeconomic patterns ( Data Commons 2025a ) public health and vectors of disease transmission ( Wellenius et al. 2021 ) and our Population Dynamics Foundations integrating human behavior and location ( Agarwal et al. 2024 ) . Environment relates to spatiotemporal signals capturing dynamics of the Earth, including observations and models of weather, air quality, and climate ( Agrawal et al. 2025 ; Lam et al. 2023 ; Kochkov et al. 2024 ; Price et al. 2025 ; Google 2025e ; Google 2025b ) , forecasts and tracking of natural disasters, such as cyclones ( Alet et al. 2025 ) , floods ( Nearing et al. 2024 ) , and wildfires ( Matias 2021 ) , and maps of habitat loss and its underlying drivers ( Sims et al. 2023 ) . To address real-world, multimodal challenges, we orchestrate these individual Earth AI Models with a Gemini-powered Geospatial Reasoning agent. By uniting natural language interactions and model connectivity across multiple domains that are usually analyzed separately, we expand the ability for non-expert users to analyze important questions without needing to download intermediate elements of answers and join or cross-reference results manually. This paradigm greatly expands the range of users to include anyone who can formulate a well-structured question and assess the resulting response. In this way, Earth AI allows for holistic, multi-faceted analysis and insight generation at a scale that was previously intractable. We demonstrate the power of this approach using a new benchmark of complex, real-world crisis response scenarios, showing how the synthesis of diverse data sources can unlock critical and time-sensitive insights. Figure 1: EarthAI Overview: Earth AI builds on diverse geospatial data and tools across many sources and modalities (left) that are processed by specialized sub-agents and models spanning Imagery, Population, and Environment (middle). The Earth AI geospatial reasoning agent (right) ties these together to enable comprehensive geospatial analysis and insight generation. The key findings from our evaluation of the Earth AI approach are summarized below: • State-of-the-Art Earth AI Models: We demonstrate that our Remote Sensing Foundations achieve state-of-the-art (SOTA) performance on tasks such as open-vocabulary object detection and zero-shot cross-modal retrieval. Concurrently, our Population Dynamics Foundations has been independently validated to improve real-world retail and public health applications, and has been extended to provide temporal embeddings at a monthly granularity. • Leading-edge Predictive Power Through Model Synergy: We provide strong evidence that the integration of models from different modalities yields superior predictive capabilities.