Towards Scalable Schema Mapping using Large Language Models
Christopher Buss, Mahdis Safari, Arash Termehchy, Stefan Lee, David Maier · 2025
Read Towards Scalable Schema Mapping using Large Language Models by Christopher Buss, Mahdis Safari, Arash Termehchy, Stefan Lee, David Maier (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24716.txt.
Introduction
Christopher Buss and co-authors present a 2025 study on linking data across many sources. Groups that merge data must map fields from one schema to the next, a slow hand task that breaks when sources change. Large language models could help, since they read both field names and plain words. The team asks what blocks that help at large scale.
The authors name three blocks. Model answers shift with small changes in how the task is phrased. Rich mappings strain the short text window the models can hold. Repeat calls to the model cost too much. For the first block they propose sampling many answers and merging them. For the third they propose quick filters, such as sorting by data type first. The work maps a path toward schema tools that grow with the number of sources.
Catalog record
| CREATOR | Christopher Buss, Mahdis Safari, Arash Termehchy, Stefan Lee, David Maier |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-24716
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Scalable Schema Mapping using Large Language Models Christopher Buss, Mahdis Safari, Arash Termehchy, Stefan Lee, David Maier Abstract . The growing need to integrate information from a large number of diverse sources poses significant scalability challenges for data integration systems. These systems often rely on manually written schema mappings, which are complex, source-specific, and costly to maintain as sources evolve. While recent advances suggest that large language models (LLMs) can assist in automating schema matching by leveraging both structural and natural language cues, key challenges remain. In this paper, we identify three core issues with using LLMs for schema mapping: (1) inconsistent outputs due to sensitivity to input phrasing and structure, which we propose methods to address through sampling and aggregation techniques; (2) the need for more expressive mappings (e.g., GLaV), which strain the limited context windows of LLMs; and (3) the computational cost of repeated LLM calls, which we propose to mitigate through strategies like data type prefiltering. 1. Introduction There is a recognized need to collect and connect information from a variety of data sources ( Doan et al., 2012 ; Golshan et al., 2017 ; Foundation and of Health, 2021 ) . As an example, we have recently worked in a large-scale NIH-funded project to augment the information of biomedical entities by querying other biomedical data sources ( Wood et al., 2021 ) . The main focus of this project is to repurpose current drugs to treat or mitigate the symptoms of diseases for which there is insufficient time or resources to develop effective treatments (e.g., new or rare diseases) ( Ashburn and Thor, 2004 ) . To support such a system, its developers must find and combine a patchwork of data sources to get a full picture of a drug (e.g., clinical trials, research literature, and adverse effects). Collecting all this information is resource-intensive and can be a barrier to important discoveries. Data integration systems are complex and often ingest data from a large number of diverse sources. For each source, programmers must manually write mappings that reconcile structural differences. Writing the correct mappings often requires understanding the semantics of the source. Thus, programmers must cross-reference natural-language descriptions (e.g., database documentation), the logical model, and the actual representation of data. Due to the complexity of mappings, the large number of sources, and the fact that sources evolve over time, integration systems have major scalability problems. Often, mappings are source-specific and cannot be reused. Systems not only become more complex as mappings are added, but with each new source, there is a higher probability that any one source will change, disrupting the system until developers repair the affected mappings. This results in high maintenance costs. To contend with the growing number of sources, we must develop new tools to reduce the manual effort required to build and maintain data integration systems. Due to the complicated nature of data integration, it requires human-in-the-loop approaches. Many older works have focused on rule-based tools ( Popa et al., 2002 ; Do and Rahm, 2002 ; Bonifati et al., 2008 ) , which lack semantic understanding, limiting their usefulness. More recent work has proposed training models to expand their ability beyond basic rules ( Zhang et al., 2021 ) . However, doing so requires preparing labeled data specific to certain domains. Recent studies have explored how large language models (LLMs) can be used to generate schema mappings ( Sheetrit et al., 2024 ; Liu et al., [n. d.] ; Seedat and van der Schaar, 2024 ; Liu et al., 2024b ; Xu et al., 2024 ; Parciak et al., 2024 ; Huang et al., 2024 ) . Since LLMs can incorporate a wide range of supporting information, including schema metadata and natural language descriptions, they are especially suited to generating mappings. In this paper we describe three challenges with using LLMs for generating schema mappings. • Inconsistent Outputs : LLMs are highly sensitive to input phrasing and structure, leading to unpredictable and diverse results. We propose techniques for sampling and combining multiple outputs, increasing our mapping coverage and providing effective ways to filter out unlikely mappings. We provide preliminary results that illustrate the effectiveness of our methods. • GLaV with Limited Contexts : Existing LLM-based methods focus on limited mapping types, which are often insufficient for many real-world integration scenarios. Towards supporting more integration systems, we consider the challenges associated with generating more expressive mappings (GLaV). Supporting such mappings would increase complexity, requiring more sophisticated representations and careful design to avoid overwhelming the LLM’s context. • Challenge: Efficient Prompting : LLM-based schema mapping is computationally expensive due to repeated model calls, especially with large datasets. This, in large part, is thanks to its large input, which only becomes more difficult to manage as we consider more expressive mappings. 2. Schema Mapping Assistant The figure shows multiple sources with different column names for the same drug-related information. It highlights the need to align local drug attributes with external ones to create a unified view. Lines between tables indicate corresponding attributes, and arrows show foreign key references between schemas. Figure 1. Example integration scenario with a target (left) and two sources (right). Green dashed lines represent semantic correspondences between attributes (schema alignment). Dotted represent inter-schema references (foreign keys). The figure shows multiple sources with different column names for the same drug-related information. It highlights the need to align local drug attributes with external ones to create a unified view. Lines between tables indicate corresponding attributes, and arrows show foreign key references between schemas. Our discussion is inspired by tools ( Bonifati et al., 2008 ; Popa et al., 2002 ; Do and Rahm, 2002 ) , meant to assist the user in the schema mapping process. Generally speaking, these systems take the full set of possible mappings and filter them down to a candidate set. The candidate set is then shown to the user so they may verify them, selecting which mappings to implement. This work focuses on mappings between relational databases, but we assert that the challenges highlighted here apply to schema mapping broadly, regardless of the logical models used. It is expected that users will need to verify the output mappings as the underlying model used to generate them will not know the user’s latent intent. In essence, there is nearly always expectations (e.g., business rules not represented within the schema) for which the underlying model is not privy to. 2.1. Preliminaries Data Integration System Following previous works ( Lenzerini, 2002 ) , we describe a data integration system \mathcal{I} as a triple \langle\mathcal{G},\mathcal{S},\mathcal{M}\rangle , where • \mathcal{G} is the target schema , which describes a unified view of sources. • \mathcal{S} is the source schema , which specifies the structure of the sources to integrate. For the sake of definitional simplicity, we do not distinguish between different sources; instead, we consider \mathcal{S} to simply be the union of all source schemas. • \mathcal{M} is the mapping between \mathcal{G} and \mathcal{S} , constituted by a set of rules , each describing how a subset of \mathcal{G} semantically corresponds to a subset of \mathcal{S} . Both \mathcal{S} and \mathcal{G} contain relations S_{1},S_{2},...S_{n} and G_{1},G_{2},...G_{m} respectively. In turn, each relation contains a