Identifying Origins of Place Names via Retrieval Augmented Generation

Alexis HORDE VO \orcid 0009-0004-3324-3380, Matt DUCKHAM \orcid 0000-0002-7249-6709, Estrid HE \orcid 0000-0002-8994-9532, Rafe BENLI · 2025

Read Identifying Origins of Place Names via Retrieval Augmented Generation by Alexis HORDE VO \orcid 0009-0004-3324-3380, Matt DUCKHAM \orcid 0000-0002-7249-6709, Estrid HE \orcid 0000-0002-8994-9532, Rafe BENLI (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01030.txt.

Introduction

Alexis Horde-Vo, with three co-authors, Matt Duckham, Estrid He, and Rafe Benli, presents a retrieval augmented generation pipeline for identifying origins of place names. Place names in gazetteers serve as spatial references but often lack information about their origins, and enriching them manually requires extensive exploration of archives.

Given a spatial query, their approach extracts sub-graphs from DBpedia that may contain relevant knowledge, then ranks them to generate the final answer using fine-tuned language models including ColBERTv2 and Llama2. Results highlight key challenges, especially the tendency of language models to under-use spatial information in texts as a discriminating factor. The chapter frames wider implications for geographic information retrieval using retrieval augmented generation.

Catalog record

CREATORAlexis HORDE VO \orcid 0009-0004-3324-3380, Matt DUCKHAM \orcid 0000-0002-7249-6709, Estrid HE \orcid 0000-0002-8994-9532, Rafe BENLI
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01030

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Identifying Origins of Place Names via Retrieval Augmented Generation Alexis HORDE VO \orcid 0009-0004-3324-3380, Matt DUCKHAM \orcid 0000-0002-7249-6709, Estrid HE \orcid 0000-0002-8994-9532, Rafe BENLI Abstract Who is the Batman behind “Batman Street” in Melbourne? Understanding the historical, cultural, and societal narratives behind place names can reveal the rich context that has shaped a community. Although place names serve as essential spatial references in gazetteers, they often lack information about place name origins. Enriching these place names in today’s gazetteers is a time-consuming, manual process that requires extensive exploration of a vast archive of documents and text sources. Recent advances in natural language processing and language models (LMs) hold the promise of significant automation of identifying place name origins due to their powerful capability to exploit the semantics of the stored documents. This chapter presents a retrieval augmented generation pipeline designed to search for place name origins over a broad knowledge base, DBpedia. Given a spatial query, our approach first extracts sub-graphs that may contain knowledge relevant to the query; then ranks the extracted sub-graphs to generate the final answer to the query using fine-tuned LM-based models (i.e., ColBERTv2 and Llama2). Our results highlight the key challenges facing automated retrieval of place name origins, especially the tendency of language models to under-use the spatial information contained in texts as a discriminating factor. Our approach also frames the wider implications for geographic information retrieval using retrieval augmented generation. keywords geographic information retrieval \sep open domain question answering \sep retrieval augmented generation \sep place name \sep gazetteer , , and 1 Introduction Although place names are officially recorded by place naming authorities around the world, gazetteers commonly lack information regarding place name origins . To understand the history behind place names, one must typically consult external sources, such as historical archives or web pages. Understanding that history is becoming increasingly important to communities, for example, in better reflecting the contributions of marginalized groups, such as women or Indigenous people, to a place. To increase diversity with commemorative places in Victoria (Australia), for example, gender equality policies face questions such as: what are the existing places named in honor of women? This question implies the detection of such place names as well as the generation of relevant arguments; in other words, what is the origin of a place name? Place names may refer to multiple objects (streets, buildings, cities or even natural features) but streets are most frequently encountered in daily life, e.g. when addressing a parcel or locating a restaurant near our workplaces. Accordingly, there is a growing need for automated tools that can efficiently retrieve relevant information about the origins of a given place name. With its rich available archives, this chapter evaluates these automated tools within the streets of Melbourne, the historic center of Victoria. Developing such automated tools is challenging for at least two reasons. First, spatial queries can be highly ambiguous. For example, place names in Australia often consist of a single identifying word rather than a whole name (e.g., Batman Street in Melbourne, contrary to Avenue Simone Veil in Nice, France). To deal with ambiguity, it is often necessary to clarify the spatial context for a place name, such as the city, state, and country; the neighboring streets and the neighborhood. Our expectations about the most likely name origins vary spatially, for example, depending on whether the name appears in Melbourne, Victoria (where John Batman is a well-known historical figure who played a role in the founding of Melbourne, as well as in numerous massacres of Indigenous Australians) or in Los Angeles, California (where the comic-book character might be more relevant to the spatial context). Second, place name origins often fall within the domain of “long-tail knowledge”: discovering origins may rely on piecing together multiple low-frequency but salient occurrences in a knowledge base. For example, in a knowledge base such as DBpedia the name “Batman” is likely to appear much more frequently in association with the popular superhero than the historical figure. Identifying such long-tail instances often requires a chain of sophisticated reasoning to uncover correct answers. In this chapter, we develop a geographic information retrieval (GIR) system to automatically and effectively identify the origins of place names. We formulate the problem as a retrieval augmented generation task, allowing us to combine the strengths of traditional information retrieval and the generative capabilities of advanced language models (LMs). In our approach, relevant data is first retrieved from external knowledge sources (i.e., DBpedia), and then used to guide the generation of responses by pre-trained LMs (i.e., ColBERTv2 [ 1 ] and Llama2 [ 2 ] ). Consequently, the presented system is capable of processing user queries formulated in natural language and providing responses that are both contextually accurate and linguistically coherent. In order to enhance the spatial understanding of LMs, we inject spatial knowledge to ColBERTv2 by fine-tuning it on a dataset crafted from GeoNames. Figure 1 presents an overview of our approach: the searcher retrieves relevant data from DBpedia, the indexer and the ranker filters the retrieved data via a fine-tuned ColBERTv2, and the generator produces the final answer via Llama2. Figure 1: An overview of our approach. In this study of how best to leverage LMs for GIR, we focus in particular on two key questions: Can traditional LMs adequately reflect spatial relationships and geographic context? We perform controlled experiments to evaluate various components of our model, such as semantic and spatial understanding. When specially tuned to spatial understanding, LMs become more limited in general semantic understanding. Further, these models do not reliably capture spatial containment, nor prioritize spatially proximal objects. Further, introducing in-context spatial filters only helps to partially orient the predictions. Can the use of external knowledge bases increase response accuracy? By providing a context, the generator is driven to produce an output that relates more strongly to the provided ground knowledge, rather than fabricating (i.e., so-called “hallucination”) nonexistent objects. However, we still observe “mirages”: real but spatially distal objects that appear closer in terms of embeddings, and by consequence, acquire greater relevance for language models. Finally, the use of external knowledge restricts the solution space in a way that potentially increases the chance of correct answers; nonetheless, the models still need to learn how to navigate in this space. 2 Background and related work Scope of information retrieval over knowledge bases. Information retrieval aims to find “( query, answer )” pairs. In knowledge bases, data can have an unstructured format with text; a semi-structured format with tables; or a structured format with knowledge graphs [ 3 ] . With the latter, knowledge graphs store information in atomic triplets “( subject, predicate, object )” and respect ontologies for semantic interoperability aspects. For unstructured data, conventional approaches rely on pre-trained language models that capture and compare dense representations with text embeddings [ 4 ] . Querying semi-structured data typically implies converting the query to SQL. For structured data, current approaches either seek to convert the query to SPARQL or to find similarities with graph embeddings [ 5 ] . Modular architectures for information retrieval architectures. DBpedia is a widely used semantic knowledge base. However, it lacks consistency, mixing structured and unstructured data, such as paragraphs in natural

Read the complete text