TransClean: Finding False Positives in Multi-Source Entity Matching under Real-World Conditions via Transitive Consistency ISBN: 978-3-98318-097-4

Fernando De Meer Pardo, Branka Hadji Misheva, Martin Braschler, Kurt Stockinger · 2025

Read TransClean: Finding False Positives in Multi-Source Entity Matching under Real-World Conditions via Transitive Consistency ISBN: 978-3-98318-097-4 by Fernando De Meer Pardo, Branka Hadji Misheva, Martin Braschler, Kurt Stockinger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04006.txt.

Introduction

Merging records about the same person from many databases breeds false matches, and in messy real-world data nobody has labels to catch them. Fernando de Meer Pardo and co-authors present TransClean in this 2025 paper, a method that audits a matching by its own logic. If A matches B and B matches C, the system should also match A with C; breaks in that transitive web betray false positives.

TransClean walks the web, cutting the matches that break consistency while sparing true ones, and estimates match quality with no hand labeling at all. Paired with simple and state-of-the-art matchers alike, it lifted F1 scores by about twenty-four points on average across datasets.

Catalog record

CREATORFernando De Meer Pardo, Branka Hadji Misheva, Martin Braschler, Kurt Stockinger
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-04006

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TransClean: Finding False Positives in Multi-Source Entity Matching under Real-World Conditions via Transitive Consistency ISBN: 978-3-98318-097-4 Fernando De Meer Pardo, Branka Hadji Misheva, Martin Braschler, Kurt Stockinger Abstract . We present TransClean, a method for detecting false positive predictions of entity matching algorithms under real-world conditions characterized by large-scale, noisy, and unlabeled multi-source datasets that undergo distributional shifts. TransClean is explicitly designed to operate with multiple data sources in an efficient, robust and fast manner while accounting for edge cases and requiring limited manual labeling. TransClean leverages the Transitive Consistency of a matching, a measure of the consistency of a pairwise matching model f θ f_{\theta} on the matching it produces G f θ G_{f_{\theta}} , based both on its predictions on directly evaluated record pairs and its predictions on implied record pairs . TransClean iteratively modifies a matching through gradually removing false positive matches while removing as few true positive matches as possible. In each of these steps, the estimation of the Transitive Consistency is exclusively done through model evaluations and produces quantities that can be used as proxies of the amounts of true and false positives in the matching while not requiring any manual labeling, producing an estimate of the quality of the matching and indicating which record groups are likely to contain false positives. In our experiments, we compare combining TransClean with a naively trained pairwise matching model (DistilBERT) and with a state-of-the-art end-to-end matching method (CLER) and illustrate the flexibility of TransClean in being able to detect most of the false positives of either setup across a variety of datasets. Our experiments show that TransClean induces an average +24.42 F1 score improvement for entity matching in a multi-source setting when compared to traditional pair-wise matching algorithms. 1. Introduction Entity Matching (EM) describes the process in which data records originating from different sources are compared to find those that refer to the same real-world entities . EM is a vital part of any Extract-Transform-Load (ETL)/data integration process, as it enables the joint use of all available data items relating to each real-world entity when such items originate from different sources. Successful EM systems allow for the merging of different data sources into unified repositories and prevent inaccuracies caused by duplicate records. EM, itself ironically referred to via multiple names such as Record Linkage (RL), Entity Resolution (ER) and Data Integration/Deduplication , has been studied since the 1940s ( Dunn 1946 ; Fellegi and Sunter 1969 ) and has been classically tackled via rule-based algorithms and heuristics ( Hassanzadeh et al. 2009 ; Konda et al. 2016 ; Papadakis et al. 2020 ; Christophides et al. 2020 ) . In recent years, however, most state-of-the-art EM methods rely on machine learning (ML), most notably Transformer models ( Li et al. 2021 ; Li et al. 2023 ; Brunner and Stockinger 2020 ; Wu et al. 2024 ) . ML-based methods frame EM as a binary classification problem by classifying pairs of records as either Match or NoMatch and are usually compared to each other based exclusively on their performance on this task. However, based on individual pairwise predictions, entity matching models also implicitly define groupings of records through transitive (implicit) links. These transitive relationships play a crucial role in multi-source settings and we will discuss them in detail in Section 4 . Figure 1. Example of a matching involving three records from three different data sources. The matches ( r_{\#1} , r_{\#2} ) and ( r_{\#2} , r_{\#3} ) imply also the transitive match ( r_{\#1} , r_{\#3} ) even if r_{\#1} and r_{\#3} have not been directly paired. Consider, for instance, the matching of records r_{\#1} , r_{\#2} and r_{\#3} from three different data sources as shown in Figure 1 . If an EM method predicts pairs ( r_{\#1} , r_{\#2} ) and ( r_{\#2} , r_{\#3} ) as matches, then it is implying the match ( r_{\#1} , r_{\#3} ) as well (see dotting line in Figure 1 ). Such matches have been referred to as transitive matches ( de Meer Pardo et al. 2025 ) and can be present in any matching setting - even in the standard setting of matching records from only two different sources. Transitive matches are, however, most problematic in the multi-source matching case, due to the greater numbers of candidate pairs being considered and the propagating effect of false positive predictions in terms of wrongly linking different record groups, which leads to large numbers of false positive transitive matches ( de Meer Pardo et al. 2025 ) . In the real-world, EM tasks involve numerous large unlabeled datasets which make evaluating the performance of different EM methods and comparisons among them unfeasible in practice, as verifying the faithfulness of a given set of pairwise matches requires manually labeling them one by one, which is extremely time consuming when dealing with millions of record pairs. Effectively, the evaluation of a given matching across unlabeled data sources is in itself as challenging as producing the matching itself, if not even more so. Comparisons between different matchings can be attempted via analyzing, for example, statistics of the produced record groups such as the size distribution, the number of pairwise predictions per group, etc. Such comparisons, however, are not conclusive and cannot alone pinpoint the strengths and weaknesses of each EM method unless extensive manual labeling is also involved. This difficulty has created a significant gap between EM research and real-world projects. On one hand, EM research is focused on improving state-of-the-art black box pairwise prediction models where ground truth matches are available. On the other hand, in real-world projects, EM tasks are usually tackled through heuristics on a case-by-case basis ( Barlaug 2020 ; Wrembel 2022 ) , where ground truth matches are typically not available or very expensive to get. The narrowing of this gap can only be achieved through developing EM methods that account for several criteria such as: • Manual labeling: Only a reduced number of candidate record pairs can be expected to be manually labeled by human annotators. As a task, manual labeling is inherently labor-intensive and monotonous, often leading to annotator fatigue, which negatively impacts labeling accuracy over time ( Pandey et al. 2022 ) . • Run time: EM methods need to produce matchings in a reasonable time, the complexity of every step of an EM pipeline needs to be carefully accounted for. • Correctness assurance: Black box EM methods should provide some form of additional evidence on the correctness of the matching produced beyond the predictions themselves, so that extensive manual labeling can be avoided. Our aim is to add to this line of research by presenting the concept of Transitive Consistency , a measure of the consistency of a pairwise matching model f_{\theta} based on its predictions on the transitive matches of its produced matching G_{f_{\theta}} . We also introduce TransClean , a technique that leverages the Transitive Consistency to identify and remove false positive predictions through a series of iterative steps and accounts for all the criteria listed previously. Our main contributions are as follows: (1) We introduce the concept of Transitive Consistency and TransClean, a method that can be combined with any pairwise

Read the complete text