Relational Database Data Lineage Ontology

Jakub Dutkiewicz, Pawel Misiorek, Robert Wrembel · 2026

Read Relational Database Data Lineage Ontology by Jakub Dutkiewicz, Pawel Misiorek, Robert Wrembel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16068.txt.

Introduction

Dutkiewicz, Misiorek, and Wrembel propose a richer ontology for tracing data lineage in relational databases. Links between database objects are often incomplete or missing. Their formal vocabulary captures structural, semantic, and change details of such data. In a knowledge-graph link test, the enriched model improved link recovery over the earlier baseline. The goal is to help analysts find where each field in a report came from and how it was changed on the way.

Catalog record

CREATORJakub Dutkiewicz, Pawel Misiorek, Robert Wrembel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31233
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16068

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Relational Database Data Lineage Ontology Jakub Dutkiewicz, Pawel Misiorek, Robert Wrembel Abstract Modeling data lineage in relational databases remains a challenging problem, particularly in scenarios involving incomplete or missing dependencies between database objects. In this paper, we propose a novel ontology for relational database data lineage, designed to provide a richer and more expressive semantic representation supporting discovering the lineage links by means of knowledge graphs (KGs). Building upon our previous work on KG-based lineage discovery, the proposed ontology extends the earlier model with additional concepts capturing structural, semantic, and transformation-level characteristics of relational data. These extensions enable more precise encoding of lineage evidence. To evaluate the impact of the proposed ontology, we conduct a comparative study using a KG-based inductive link prediction framework. Specifically, we assess the performance of a graph neural network model based on path embeddings under two settings: using the original baseline ontology and the newly proposed one. Experimental results demonstrate that the application of the enriched semantic model leads to improvements in lineage link prediction performance, as measured by AUC and Hits@10 metrics. 1 Introduction Data lineage refers to the set of techniques that document the life-cycle of data, from their origin, through transformations, to their final form in a target system [ 36 ] . In some business domains, like the financial sector, regulatory acts require a full documentation on how key data were processed and used, e.g., to assess credit risk or in reports to supervisory bodies. A particular instance of data lineage is object lineage , which captures dependencies between database (DB) objects such as tables, views, materialized views, and other specific objects. These dependencies are crucial for ensuring data consistency, supporting debugging and auditing processes, as well as sharing data and query results between various applications. However, in practice, many lineage links (relationships) remain incomplete or entirely missing due to complex transformations, temporary objects, or undocumented data processing pipelines. Such missing lineage links will further be called as broken lineage . A natural way to represent lineage relationships is through graph-based models, where nodes correspond to DB objects and edges encode dependencies between the objects. In recent years, Knowledge Graphs (KGs) have been widely used as a useful framework for representing structured and semi-structured data with rich semantics [ 14 ] . In parallel, significant advances have been made in inductive link prediction methods, particularly those based on Graph Neural Networks (GNNs), which enable the discovery of missing relationships in graphs [ 30 , 22 , 34 ] . Despite this progress, the role of semantic modeling, and in particular ontology design, remains underexplored in the context of data lineage discovery. In our previous work [ 9 ] , we introduced a novel framework for discovering missing data lineage links by transforming relational databases into KGs using an ontology-grounded semantic model. We proposed a benchmark dataset of lineage scenarios, a transformation procedure from relational schemas to KGs, and an inductive link prediction approach based on a path-based GNN model. Our experiments demonstrated that such a transformation enables effective discovery of broken lineage links, highlighting the potential of combining semantic technologies with machine learning for this task. In this paper, we extend this research by focusing on the ontology itself as a key component of a lineage discovery pipeline. We propose a new, extended ontology for discovering broken data lineage links in relational DBs, designed to capture structural and semantic characteristics of relational data and transformations. It has to be stressed that there is limited work on designing ontology models specifically tailored to enable machine learning-based lineage inference in relational databases. In particular, the impact of ontology design on the quality of algorithms addressing tasks such as link prediction remains largely unexplored. Our work addresses this gap by proposing an extended ontology that combines relational data modeling with provenance semantics. The main contributions of this work are as follows: (1) we introduce an enhanced ontology model for representing data lineage in relational DBs, extending our previous semantic framework [ 9 ] with additional concepts and relationships, (2) we provide a comparative evaluation of the impact of ontology design on lineage link prediction, by applying the the GNN-based model under both the original and the proposed ontology. 2 Related Work The contribution of this paper merges three research tracks, namely: (1) discovering data lineage, (2) link prediction in KGs, and (3) modeling ontologies. All these three tracks are briefly outlined in this section. 2.1 Data Lineage/Provenance A few types of solutions for storing/retrieving data provenance in DBs have been proposed, namely: annotation-based, inversion-based, and lineage graphs. In the annotation-based solutions input data are annotated with information about their provenance (for example a location in which they are stored) and the annotations are propagated throughout the whole data processing workflow, until the final destination. Historically, first annotation-based solutions include Polygen [ 35 ] and DBNotes [ 6 ] , whereas more recent works include [ 10 , 8 ] . A common approach to annotation based data provenance representation is the semiring model [ 11 , 12 ] . The inversion-based solutions invert queries trying to infer original data that produced a given result, e.g., [ 7 , 37 ] . Finally, in the lineage graph approach, provenance is registered during query processing and saved in the form of a lineage graph for further analysis [ 16 ] . Paper [ 28 ] summarizes several most relevant works on provenance techniques. Another path includes solutions for tracking provenance in scripting languages (e.g., Python and R), e.g., [ 29 , 24 , 4 ] . [ 25 ] proposes automatic Python processing without modifying existing scripts. Similar assumptions were made in [ 23 ] , dedicated for data science applications. A completely different approach was proposed by the authors of [ 18 ] , who advocate for allowing humans to express the desired provenance through a provenance schema. To the best of our knowledge, discovering missing provenance links in relational DBs has been explicitly addressed only in [ 3 ] . To this end, the authors apply a neural network (NN) based on encoders. The solution is based on a simplified assumption that column names between related objects are similar. 2.2 Inductive Link Prediction for Knowledge Graphs The surveys in [ 1 , 27 ] provide comprehensive overviews of link prediction methods for graphs and knowledge graphs (KGs), respectively. Traditional (transductive) approaches, such as TransE [ 2 ] and BERT-ConvE [ 17 ] , focus on inferring missing relations between entities observed during training. In contrast, inductive link prediction aims to generalize to previously unseen entities, enabling the prediction of new triples in a more practical scenario involving graphs with nodes unknown during the learning of the prediction model [ 22 , 30 ] . Most KG link prediction methods rely on embedding techniques, where entities and relations are mapped into vector spaces [ 2 , 17 ] . While effective, these approaches typically struggle to generalize beyond the training graph. To address this limitation, more recent methods incorporate structural information to better capture semantic patterns [ 13 ] , though challenges remain in handling emerging entities. Recent advances in inductive link prediction tackle this

Read the complete text