HierLoc: Hyperbolic Entity Embeddings for Hierarchical Visual Geolocation
Hari Krishna Gadi, Hongyi Luo, Daniel Matos, Lu Liu, Yongliang Wang, Yanfeng Zhang, Liqiu Meng · 2026
Read HierLoc: Hyperbolic Entity Embeddings for Hierarchical Visual Geolocation by Hari Krishna Gadi, Hongyi Luo, Daniel Matos, Lu Liu, Yongliang Wang, Yanfeng Zhang, Liqiu Meng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-23064.txt.
Introduction
Hari Krishna Gadi and six co-authors locate photos by learning geography's natural hierarchy. Visual geolocation predicts where an image was taken, a hard task at global scale. Older methods need huge image stores, ignore how places nest inside each other, or blur fine detail.
Their HierLoc embeds entities in hyperbolic space, a geometry that fits tree-like structure well. Continent, country, and city levels can then guide the search together. Better geolocation helps organize photo archives and verify where images were really shot. Hyperbolic embeddings fit geography's nesting naturally, since space in that geometry grows like a tree of regions.
Catalog record
| CREATOR | Hari Krishna Gadi, Hongyi Luo, Daniel Matos, Lu Liu, Yongliang Wang, Yanfeng Zhang, Liqiu Meng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-23064
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HierLoc: Hyperbolic Entity Embeddings for Hierarchical Visual Geolocation Hari Krishna Gadi, Hongyi Luo, Daniel Matos, Lu Liu, Yongliang Wang, Yanfeng Zhang, Liqiu Meng Abstract Visual geolocalization, the task of predicting where an image was taken, remains challenging due to global scale, visual ambiguity, and the inherently hierarchical structure of geography. Existing paradigms rely on either large-scale retrieval, which requires storing a large number of image embeddings, grid-based classifiers that ignore geographic continuity, or generative models that diffuse over space but struggle with fine detail. We introduce an entity-centric formulation of geolocation that replaces image-to-image retrieval with a compact hierarchy of geographic entities embedded in Hyperbolic space. Images are aligned directly to country, region, subregion, and city entities through Geo-Weighted Hyperbolic contrastive learning by directly incorporating haversine distance into the contrastive objective. This hierarchical design enables interpretable predictions and efficient inference with 240k entity embeddings instead of over 5 million image embeddings on the OSV5M benchmark, on which our method establishes a new state-of-the-art performance. Compared to the current methods in the literature, it reduces mean geodesic error by 19.5%, while improving the fine-grained subregion accuracy by 43%. These results demonstrate that geometry-aware hierarchical embeddings provide a scalable and conceptually new alternative for global image geolocation. 1 Introduction Visual geolocalization, inferring where an image was taken from its content alone, is a fundamental challenge with applications in biodiversity monitoring ( 28 ) , cultural heritage preservation ( 6 ) , news verification ( 27 ) , and augmented reality ( 19 ) . However, many real-world images lack geotags in their metadata ( 8 ) , making automated solutions increasingly important. The task remains difficult due to its scale and ambiguity ( 7 ) . The search space spans the entire globe; visual patterns such as beaches or skylines recur across continents; language similarities in the street view images span continents; and geographic space itself is structured hierarchically from continents down to cities. Most existing methods follow one of three paradigms: retrieval-based, classification, and more recently, generative methods. Retrieval-based approaches index millions of image embeddings and return nearest neighbors ( 10 ) , which capture fine-grained similarity but do not scale gracefully and provide limited interpretability. Classification methods ( 1 ; 11 ) tackle this task by predicting a discrete cell, respecting geography but failing to capture cross-continental visual relationships. Generative models, such as diffusion, can model spatial uncertainty, but underperform retrieval methods at fine scales ( 7 ) . We present a geolocation architecture that models the world as a hierarchy of entities such as countries, regions, subregions, and cities, and learns embeddings for each entity instead of indexing individual images. Images are aligned to entity embeddings via a contrastive loss weighted by the scaled haversine distance. Conventional retrieval methods scale linearly, requiring O(N) comparisons against millions of images; approximate nearest neighbor methods reduce runtime but still incur large memory and indexing overheads. Our approach instead operates on a fixed, compact set of entity embeddings which scale sub-linearly, enabling faster inference through hierarchical traversal: predictions are resolved coarsely at higher levels and refined only where needed. This allows for beam search over the hierarchy, allowing efficient exploration of plausible paths. This yields scalable inference, interpretable outputs, and even potential for client-side deployment. By reframing geolocation as “image-to-entity alignment” rather than “image-to-image retrieval,” the method makes the structure of geography central to the task. To encode the geographic hierarchy effectively, we represent entities in hyperbolic space. In Euclidean space, hierarchical structures become increasingly compressed as depth grows: the number of entities expands roughly exponentially from country → region → subregion → city, but Euclidean distances grow only linearly. This mismatch causes deeper-level entities to crowd together, reducing discriminative power during inference. Hyperbolic geometry, by contrast, naturally provides exponential volume growth and therefore allocates proportionally more space to represent large branching factors in deep hierarchies ( 21 ; 4 ) . As a result, related entities can remain close, while fine-grained locations can still be well separated, making hyperbolic space a more faithful and expressive embedding space for geographic hierarchies. This effect can be observed visually in the Figure 2 in the Appendix A.2 . To our knowledge, this is the first application of Hyperbolic embeddings to represent hierarchical geographic entities for geolocation explicitly. In addition to expected continental clusters, Figure 6 in the Appendix shows the semantic relationships between entities directly leveraging strong semantics of modern image encoders such as DINOV3 ( 26 ) . To couple this geometry with geographic structure, we introduce a Geo-Weighted Hyperbolic InfoNCE (GWH-InfoNCE) loss that weights negative logits using the haversine formula. This objective materially improves fine-scale discrimination while preserving global structure. We evaluate our method on OSV5M ( 1 ) , comprising 4.8 million training and 200k test images, and on MediaEval’16 ( 14 ) with 4.7 million training images. On OSV5M, our approach establishes a new state of the art, yielding consistent gains across all hierarchical levels: country (+8.8%), region (+20.1%), subregion (+43.2%), and city (+16.8%), while reducing mean geodesic error by 19.5% relative to the strongest baselines. We further confirm robustness on IM2GPS ( 12 ) , IM2GPS3K ( 29 ) , and YFCC4K ( 29 ) . Beyond these benchmarks, our findings highlight that Hyperbolic embedding spaces provide a principled advantage for multimodal representation learning wherever data exhibit inherent hierarchical structure, with geolocation serving as a particularly suitable testbed. The following are our contributions: • Reduce search complexity by reformulating geolocation as image-to-entity alignment in Hyperbolic space, cutting the search from millions of images to 240k entities while improving accuracy. • Demonstrate that Hyperbolic geometry captures multi-scale geographic relationships for hierarchical representation. • Introduce Geo-Weighted Hyperbolic InfoNCE (GWH-InfoNCE), which incorporates great-circle distance to emphasize geographically proximal negatives. • Achieve state-of-the-art results on OSV5M across all levels (country +8.8%, subregion +43.2%), validating the effectiveness of geometry-aware learning. 2 Related Works Global visual geolocation. Classical work framed geolocation as image retrieval against large galleries, e.g. IM2GPS ( 12 ) , later revisited with stronger deep learning baselines ( 29 ) . An alternative line casts the task as geocell classification, as in PlaNet ( 31 ) and CPlaNet ( 25 ) , while recent methods emphasize scalability (SC retrieval ( 10 ) , PIGEON ( 11 ) ) or generative modeling of geodesic uncertainty ( 7 ) . This trend continues with the work of LocDiff ( 30 ) with multi-scale latent diffusion. Benchmarks such as MediaEval’16 and OSV5M ( 1 ) further standardized evaluation. The emergence of foundational models also resulted in works such as GeoReasonser ( 15 ) and Img2Loc ( 32 ) , which push the boundary forward. Several hybrid approaches combine retrieval and classification, such as Translocator ( 22 ) and GeoDecoder ( 5 ) , but these methods generally assume Euclidean label spaces. Although hierarchy is central to these protocols (e.g., country/region/city splits, quadtrees), prior work has used hierarchy mainly for evaluation or partitioning. By contrast, we treat the hierarchy itself as the object of representation, aligning images directly to entities across levels. Hyperbolic deep learning and vision. Hyperbolic spaces such as the Poincaré disk and Lorentz model are well-suited to tree-like structures due to exponential volume growth