Text Data Integration

Md Ataur Rahman \orcidID 0000-0002-9092-8771, Dimitris Sacharidis \orcidID 0000-0001-5022-1483, Oscar Romero \orcidID 0000-0001-6350-8328 and Sergi Nadal \orcidID 0000-0002-8565-952X · 2026

Read Text Data Integration by Md Ataur Rahman \orcidID 0000-0002-9092-8771, Dimitris Sacharidis \orcidID 0000-0001-5022-1483, Oscar Romero \orcidID 0000-0001-6350-8328 and Sergi Nadal \orcidID 0000-0002-8565-952X (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27055.txt.

Introduction

Rahman and co-authors argue that text deserves a full place inside data integration systems. Integration pipelines usually merge structured sources that follow precise schemas. Free text, though, holds large amounts of untapped knowledge. This book chapter first makes the case for integrating textual data. It then surveys the challenges that text brings, from heterogeneity to meaning. Current techniques and open problems close the chapter. The authors frame text integration as a core data engineering task, not an add-on.

Catalog record

CREATORMd Ataur Rahman \orcidID 0000-0002-9092-8771, Dimitris Sacharidis \orcidID 0000-0001-5022-1483, Oscar Romero \orcidID 0000-0001-6350-8328 and Sergi Nadal \orcidID 0000-0002-8565-952X
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50682
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.27055

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Text Data Integration Md Ataur Rahman \orcidID 0000-0002-9092-8771, Dimitris Sacharidis \orcidID 0000-0001-5022-1483, Oscar Romero \orcidID 0000-0001-6350-8328 and Sergi Nadal \orcidID 0000-0002-8565-952X Abstract Data comes in many forms. From a shallow perspective, they can be viewed as being either in structured (e.g., as a relation, as key-value pairs) or unstructured (e.g., text, image) formats. So far, machines have been fairly good at processing and reasoning over structured data that follows a precise schema. However, the heterogeneity of data poses a significant challenge on how well diverse categories of data can be meaningfully stored and processed. Data Integration , a crucial part of the data engineering pipeline, addresses this by combining disparate data sources and providing unified data access to end-users. Until now, most data integration systems have leaned on only combining structured data sources. Nevertheless, unstructured data (a.k.a. free text) also contains a plethora of knowledge waiting to be utilized. Thus, in this chapter, we firstly make the case for the integration of textual data, to later present its challenges, state of the art and open problems. 0.1 Introduction In this chapter, we will motivate why there is a need to integrate textual data with structured sources. First, we discuss why integrating text remains challenging despite being the most widely available type of data. Next, we highlight the critical role that textual data can play in integration scenarios. In particular, we describe how textual data can mitigate data sparsity, enable data discovery, and enhance integration through data augmentation. Each section is accompanied by clear, motivating examples to concretely demonstrate the impact of integrating textual data. 0.1.1 Text Everywhere, Yet Hard to Integrate Humans generate roughly 2.5 quintillion bytes of digitized data every day LVB18 . Apart from being in “structured” sources; these data can be found in numerous other “unstructured” formats such as web pages, weather forecasts, file servers, product reviews, scientific articles, commute maps, patient records, disease surveys, etc. Answering questions from a single source of data is relatively easy and suitable for small databases. However, a complex query we want to answer, could be requiring access over several heterogeneous data sources. Data integration plays a vital role in combining these distinct sources and providing the user with a unified view and query interface in such scenarios. The task of data integration mainly falls into the domain of data management and engineering. But, when it comes to integrating data that are in unstructured formats such as texts, it is essential to incorporate ideas from several other domains such as the Semantic Web (SW), Machine Learning (ML), Natural Language Processing (NLP), and Knowledge Representation (KR) techniques. Again, each of the domains mentioned above solves a particular task in a different way. Hence, there is a need to develop a common framework for data integration techniques to benefit from all the aforementioned domains and yield solutions for heterogeneous data sources. On top of this, rather than following any schema, most state-of-the-art integration platforms that include textual sources store text data as plain instances ABC+22 . This leads to the same chicken-and-egg problem where some extra manual efforts are needed to extract structured information from those text instances before they can be utilized and integrated with other structured sources. To aid this, a common way of representing disparate data sources is needed. As humans, we are good at inferring in such scenarios mainly because we perceive and represent information in our brains through conceptualization. Conceptualization can be thought of as an abstract perspective of representing the knowledge we retain regarding the world around us Guizzardi06 . Every concept is expressed and linked in terms of articulated relations with some other concepts in this representation. Each concept, in turn, could be associated with its own real-world examples (e.g., attributes, causes and effects), and might also form hierarchical relations. Knowledge Graphs (KGs) are well known for their ability to store contextual information with data in a way that resembles the above scenarios. They can represent complex relationships between entities while maintaining semantic clarity through well-defined structures. This semantic richness, combined with their inherent capability to integrate heterogeneous data sources through common vocabularies, makes them particularly suitable for large-scale data integration tasks. Therefore, by creating a concrete and explicit manifestation of conceptualization for machines, KGs could lead to a better unification model for diversified sources of data. 0.1.2 The Critical Role of Text in Data Integration Unstructured data preserved in the form of natural language text is undoubtedly an invaluable source of knowledge. The integration of structured and unstructured data has become a critical area of research in recent years IC19 . Adaptation by the leading technological industries like Google, Microsoft, and Facebook emphasizes the significance of harvesting textual information with other structured sources in an enterprise. For example, Google integrates textual data from websites with structured databases (i.e., KGs) to enhance search results and provide richer answers in response to user queries. Similarly, Microsoft leverages textual data from emails and documents to improve their Office products and services, while Facebook combines textual content from posts with structured data to improve targeted advertisements and user recommendations. Integrating structured and unstructured data is important because structured data alone often captures only limited aspects of a topic, missing the contextual details that textual data naturally provides. Textual data can enrich structured datasets with domain knowledge, and implicit relationships that are typically absent in structured sources. Hence, integrating multi-modal data creates a more comprehensive view, enabling better understanding, accurate analysis, and sophisticated data-driven decision-making through improved inference over texts. Manually converting all the heterogeneous data types into a single homogeneous structure involves numerous manual efforts and is often impossible, so we need to address the limitations of human intervention, ensuring adaptability to large-scale, real-world scenarios. Thus, the challenge is developing a scalable and automated data integration framework that can efficiently handle textual information alongside other structured sources. In the following, we justify the need of such a framework. Indeed, text could offer three key benefits when integrated with structured data: (i) mitigating data sparsity , (ii) data discovery , and (iii) data augmentation . We will discuss these scopes in the following sections, providing motivating examples to clarify their significance and impact. Mitigating Data Sparsity The data integration process often results in a large number of missing values (i.e., NULL), as each source provides only a partial view of the data. This issue, commonly referred to as the data sparsity problem , arises when schemas across sources mismatch or the available structured data lacks sufficient context to fill in the missing values. Traditional value imputation techniques fail to address the heteroscedasticity (i.e., variance inconsistency) and the non-independent and identically distributed (Non-IID) nature of data integrated from different sources CYK22 . Moreover, these methods are limited to structured data sources and cannot effectively utilize unstructured textual data, which often contains valuable information for completing sparse datasets. This challenge can be mitigated by leveraging external textual sources to enrich integrated datasets through text conceptualization . Motivating Example-1: Consider the two structured datasets containing health-related information of Table 1 . The first dataset, D1 , provides information about diseases and their complications. The second dataset, D2 , records diseases and their anatomical

Read the complete text