UniGeoCLIP : Unified Geospatial Contrastive Learning

Guillaume Astruc, Eduard Trulls, Jan Hosang, Loic Landrieu, Paul-Edouard Sarlin · 2026

Read UniGeoCLIP : Unified Geospatial Contrastive Learning by Guillaume Astruc, Eduard Trulls, Jan Hosang, Loic Landrieu, Paul-Edouard Sarlin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11668.txt.

Introduction

Astruc and four colleagues introduce UniGeoCLIP, a contrastive framework that lines up five geospatial data types in one embedding space. Joint data span aerial photos, street views, height models, text, and coordinates. Past work fuses data types or leans on one central form, but UniGeoCLIP lines up all pairs, so any mix can be compared, found, and reasoned over. A scaled latitude-longitude encoder captures geographic structure at many scales. Tests show it beats single-type models and coordinate-only baselines.

Catalog record

CREATORGuillaume Astruc, Eduard Trulls, Jan Hosang, Loic Landrieu, Paul-Edouard Sarlin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40247
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11668

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UniGeoCLIP : Unified Geospatial Contrastive Learning Guillaume Astruc, Eduard Trulls, Jan Hosang, Loic Landrieu, Paul-Edouard Sarlin Abstract The growing availability of co-located geospatial data spanning aerial imagery, street-level views, elevation models, text, and geographic coordinates offers a unique opportunity for multimodal representation learning. We introduce UniGeoCLIP , a massively multimodal contrastive framework to jointly align five complementary geospatial modalities in a single unified embedding space. Unlike prior approaches that fuse modalities or rely on a central pivot representation, our method performs all-to-all contrastive alignment, enabling seamless comparison, retrieval, and reasoning across arbitrary combinations of modalities. We further propose a scaled latitude-longitude encoder that improves spatial representation by capturing multi-scale geographic structure. Extensive experiments across downstream geospatial tasks demonstrate that UniGeoCLIP consistently outperforms single-modality contrastive models and coordinate-only baselines, highlighting the benefits of holistic multimodal geospatial alignment. A reference implementation is available at gastruc.github.io/unigeoclip . 1 1 footnotetext: Work done during an internship at Google. 1 Introduction Expressive and robust geospatial embeddings that capture both fine-grained semantic content and large-scale spatial structure are critical for automating downstream geospatial tasks such as urban land-use classification Lacoste et al. 2023 , monitoring land cover Hu et al. 2023 , and large-scale socio-economic inference Sun et al. 2024 . Existing work largely falls into three successful paradigms. Embedding fields map geographic coordinates to latent vectors to enable localized interpolation Brown et al. 2025 ; Lindenberger et al. 2025 . Multimodal vision models fuse multiple sensor observations into a single representation Astruc et al. 2024b ; Astruc et al. 2025 ; Tseng et al. 2025 . Finally, contrastive approaches align heterogeneous geospatial data sources in a shared embedding space, most notably GeoCLIP Vivanco Cepeda et al. 2023 and SatCLIP Klemmer et al. 2025 . Despite their success, these paradigms exhibit limitations for general-purpose geospatial reasoning. Embedding fields provide static “snapshots” of a region and struggle to model dynamic. Multimodal fusion models collapse all available modalities into a single representation, preventing cross-modal comparison or retrieval. Existing contrastive approaches typically align geographic coordinates with a single Earth observation modality, most often top-down imagery, and largely ignore textual information despite its central role in modern vision-language models. Text Satellite Street View Elevation models Coordinates Figure 1 : Unified contrastive learning of geospatial data. We jointly train encoders for five modalities (text, aerial imagery, street-level imagery, elevation, and geographic coordinates), which simultaneously are contrasted across all modality pairs. This yields a single unified embedding space that represents heterogeneous geospatial information. (a) Aerial Image. (b) Street View. (c) Surface Model. (d) Location. Situated in Boston’s lively Brighton neighborhood, this area is a convenient urban base close to Boston College and with accessible parks. Everyday conveniences include multiple grocery options, including Whole Foods Market and Star Market, as well as diverse restaurants ranging from Spanish tapas at Barcelona Wine Bar to Korean BBQ at Naksan. For nightlife, there’s the welcoming atmosphere at Harry’s Bar & Grill and The Publick House, and late-night dining at Barcelona Wine Bar. (e) Text Description. Figure 2 : Sample from our multimodal geospatial dataset. Each location is represented through five complementary modalities: aerial imagery, street-level imagery, a Digital Surface Model (DSM), geographic coordinates, and an automatically generated text description. 3 3 3 Analytical use of proprietary data sources was done with special permission from Google. Faces and license plates are anonymized by blurring. All modalities are spatially co-registered and jointly contrasted during training. In this paper, we propose a contrastive and massively multimodal framework that jointly aligns five complementary geospatial modalities, enabling seamless translation, comparison, and retrieval across modalities. Specifically, we contrast high-resolution aerial imagery, geometry-dense Digital Surface Models (DSMs), street-level imagery, rich text descriptions, and raw geographic coordinates, embedded using a novel spatial encoder. Unlike prior multimodal contrastive frameworks in vision, such as UniBind Lyu et al. 2024 or ImageBind Girdhar et al. 2023 , which rely on a central pivot modality (typically images), our approach adopts a fully holistic formulation: all modalities are directly contrasted with one another. This all-to-all alignment strategy yields a unified embedding space that supports robust reasoning under arbitrary availability of modalities. Observing that embeddings derived from raw positional encodings are often limited in expressiveness Rußwurm et al. 2024 and can become a bottleneck when contrasted with richer modalities, we propose a learned multi-scale geographic embedding that substantially increases representational capacity. In summary, we make the following contributions: • UniGeoCLIP : Unified Geospatial Contrastive Learning. We introduce the first purely contrastive framework that jointly aligns an unprecedented set of georeferenced modalities: street-view imagery, aerial imagery, DSMs, text, and geographic coordinates. • Scaled Latitude–Longitude Encoder. We propose a novel coordinate encoder that outperforms standard Fourier-feature and MLP-based embeddings by explicitly modeling multi-scale spatial dependencies. • Strong performance in geospatial tasks. We demonstrate consistent improvements over single-modality contrastive models and coordinate-only baselines across a diverse suite of geospatial probing and downstream tasks. 2 Related Work Multimodal Geospatial Models Recent developments in geospatial representation learning have transitioned from specialized, task-specific encoders to broader foundation models designed to capture both fine-grained semantic content and large-scale spatial structures ( Lacoste et al. 2023 ) . Significant focus has been placed on embedding fields ( Brown et al. 2025 ; Lindenberger et al. 2025 ) , which map geographic coordinates directly to latent features to allow localized spatial interpolation. Although these fields excel at specific downstream tasks, they essentially act as static snapshots–frozen in time and strictly bound to the geographic distribution of their training sets. In parallel, multimodal vision models such as AnySat ( Astruc et al. 2025 ) , Panopticon ( Waldmann et al. 2025 ) , and Galileo ( Tseng et al. 2025 ) have begun to explore the fusion of multiple satellite sensors ( e.g . , SAR, multispectral). However, these models combine all sensor observations into a single representation, preventing cross-modal comparison or retrieval. Moreover, these frameworks remain largely focused on bird’s-eye-view data modalities, ignoring the rich ground-level perspective provided by street-level imagery or textual data. Figure 3 : Multi-Scale Coordinate Encoder. Latitude–longitude coordinates are first projected using multiple random Fourier feature matrices with increasing spectral bandwidths. Each frequency projection is treated as a token and processed through self-attention to enable inter-scale interaction. The resulting tokens are averaged to produce a unified D -dimensional geographic embedding. 1\times 2 2\times\frac{D}{2} M_{1}\sim\mathcal{N}(0,\sigma_{1}) M_{1}\sim\mathcal{N}(0,\sigma_{2}) M_{1}\sim\mathcal{N}(0,\sigma_{K}) 1\times{D} Transformer blocks pool Unified Multimodal Binding and Contrastive Alignment The ”binding” paradigm seeks to align disparate data streams into a single latent space to support arbitrary modality availability. ImageBind ( Girdhar et al. 2023 ) popularized the use of a central pivot modality (typically vision) to align sensors, a strategy recently adapted for ecological data in TaxaBind ( Sastry et al. 2025 ) . In the geospatial domain, contrastive approaches have historically focused on the image-location relationship. Seminal works like SatCLIP ( Klemmer et al. 2025 ) and GeoCLIP ( Vivanco Cepeda et al. 2023 ) established the standard for pairing imagery with geographic coordinates. While these have been refined through improved retrieval functions ( Dhakal et al. 2025 ) , temporal dynamics ( Shatwell et al. 2025 ) , and localized attention ( Liu et al. 2025 ) , they typically align only two modalities at a

Read the complete text