ESNERA: Empirical and semantic named entity alignment for named entity dataset merging

Xiaobo Zhang, Congqing He, Ying He, Jian Peng, Dajie Fu, Tien-Ping Tan · 2025

Read ESNERA: Empirical and semantic named entity alignment for named entity dataset merging by Xiaobo Zhang, Congqing He, Ying He, Jian Peng, Dajie Fu, Tien-Ping Tan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06877.txt.

Introduction

Xiaobo Zhang and co-authors merged named entity datasets automatically in two thousand twenty-five. Entity recognition finds names of people, places, and firms in text. Training it needs large hand-labeled datasets. Building those datasets is slow and expensive. Merging existing ones is cheaper but labels clash. Different datasets name the same entity types differently.

Their method, ESNERA, aligns labels by similarity. It blends usage evidence with semantic closeness. A greedy pairing strategy unifies the label spaces. Experiments merged three datasets in stages. Gains from merging were measured at each stage. The approach avoids hand-built label graphs. It also stays interpretable for dataset curators. Larger merged corpora could lift recognition quality broadly.

Catalog record

CREATORXiaobo Zhang, Congqing He, Ying He, Jian Peng, Dajie Fu, Tien-Ping Tan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-06877

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ESNERA: Empirical and semantic named entity alignment for named entity dataset merging Xiaobo Zhang, Congqing He, Ying He, Jian Peng, Dajie Fu, Tien-Ping Tan Abstract Named Entity Recognition (NER) is a fundamental task in natural language processing. It remains a research hotspot due to its wide applicability across domains. Although recent advances in deep learning have significantly improved NER performance, they rely heavily on large, high-quality annotated datasets. However, building these datasets is expensive and time-consuming, posing a major bottleneck for further research. Current dataset merging approaches mainly focus on strategies like manual label mapping or constructing label graphs, which lack interpretability and scalability. To address this, we propose an automatic label alignment method based on label similarity. The method combines empirical and semantic similarities, using a greedy pairwise merging strategy to unify label spaces across different datasets. Experiments are conducted in two stages: first, merging three existing NER datasets into a unified corpus with minimal impact on NER performance; second, integrating this corpus with a small-scale, self-built dataset in the financial domain. The results show that our method enables effective dataset merging and enhances NER performance in the low-resource financial domain. This study presents an efficient, interpretable, and scalable solution for integrating multi-source NER corpora. keywords Named Entity Recognition, Label Alignment, Label Relation, Dataset Merging 1 Introduction Named Entity Recognition (NER) is a process to extract and classify named entities in text. NER plays a pivotal role in downstream applications such as information extraction, knowledge graph construction, question-answering systems, and etc Aliod et al. 2006 ; Guo et al. 2009 ; Lample et al. 2016 ; Qu et al. 2023 . With the advancement of transfer learning techniques, the utilization of pre-trained language models in training NER models has made significant progress in NER Hu et al. 2024 ; Abadeer 2020 ; Chang et al. 2021 ; Mehta et al. 2021 ; Su et al. 2022 ; Kaur et al. 2024 . The availability of high-quality NER corpora is crucial for training high-performance NER models. However, many NER datasets have the following limitation. Firstly, most NER datasets are of medium or small scale and cover limited domains. Thus, it may fail to satisfy the practical application demands of diverse tasks and industries. For example, OntoNotes 5.0 Weischedel and et al. 2013 primarily focuses on news texts, while CLUENER2020 Xu et al. 2020 spans multiple domains but lacks sufficient scale. Secondly, there may be variations in the definition of the name entity, annotation granularity, and annotation norms across different datasets. For instance, the definition of label GPE in OntoNotes 5.0 differs from the label address in CLUENER2020, leading to inconsistencies in label schemas. The issue of label inconsistency makes it arduous for existing models to directly utilize data from diverse sources for joint training or transfer learning. Such disparities can lead to conflicts during model training, thereby reducing the performance of NER models. Previous studies address the label inconsistency through building a domain knowledge-based label graph Zhao et al. 2021 and pseudo-labeling Arazo et al. 2019 ; however, these methods typically suffer from poor interpretability and limited expandability in fusing label systems. This study aims to address these limitations through the following objectives: (1) To develop a method for aligning named entity labels in different datasets by analyzing their similarity. (2) To construct a unified large-scale NER corpus through progressive dataset merging based on the label alignment. (3) To evaluate the effectiveness of the proposed label merging method on NER performance in general domains. (4) To further verify its cross-domain transferability and robustness in low-resource scenarios using a small-scale financial dataset (FinReportNER). To achieve this, we argue that it is essential to explore set-theoretic relationships between named entities, such as equivalence, subset/superset, partial overlap, and disjointness, and to develop a named entity alignment strategy that unifies consistent label pairs across datasets by identifying them both semantically and empirically. This approach facilitates scalable and reliable cross-domain datasets merging. We introduce two complementary similarity measures: Empirical similarity measures the proportion of entity overlap between different datasets, which can reveal commonalities in annotation standards and label granularity. Semantic similarity, computed from contextual embeddings, measures the semantic proximity between label representations. These two types of similarity metrics possess complementary advantages. We comprehensively consider them through a linear interpolation fusion approach, formulating a label merging strategy that is highly interpretable and practical. We perform our study in Chinese NER. Our experiment was conducted on three mainstream Chinese NER datasets: OntoNotes5.0, CLUENER2020, and BosonNER Min et al. 2015 . Hereafter, we refer to them as OntoNotes, CLUENER, and BosonNER , respectively. The main contributions of this paper are summarized as follows: (1) We propose an automatic named entity alignment method based on empirical and semantic similarity. (2) We develop a scalable merging framework using a greedy pairwise alignment strategy and grid search to maximize named entity merging while minimizing performance degradation. (3) We prove the effectiveness of the proposed approach by merging three NER datasets for training a NER. (4) We validate the approach on a small financial NER dataset (FinReportNER), demonstrating its effectiveness and cross-domain adaptability. 2 Related Works 2.1 NER With the development of deep learning technology, NER methods have evolved from rule-based and statistical models to deep neural architectures. Rule-based methods rely on rules constructed by experts and regular expressions. Although these methods do not require labeled data and have good interpretability, they are subject to domain limitations due to the high maintenance costs associated with rule reconstruction Rau 1991 . Statistical machine learning-based methods such as Hidden Markov Models Zhou and Su 2002 and Conditional Random Fields Lafferty et al. 2001 solve the above problems by using probabilistic frameworks to learn dependencies between tokens and labels from annotated corpora. These models usually rely on carefully designed features, such as tf-idf Ingle and Deshmukh 2017 , syntactic, lexical, or morphological features, which may not be optimal. Although statistical models have good robustness and probabilistic interpretability, their reliance on manual features and difficulty in modeling long-distance dependencies limit their performance in complex language scenarios. Deep learning-based methods such as Convolutional Neural Network (CNN) Ma and Hovy 2016 ; Gui et al. 2019 and Recurrent Neural Network (RNN) Cho et al. 2014 ; Wu et al. 2017 alleviate the reliance on manual features in traditional approaches by automatically learning representations from raw text. These models can capture complex nonlinear relationships and long-range dependencies, demonstrating significant performance improvements in multiple NER tasks. Their end-to-end training mechanism enhances the scalability and cross-domain adaptability of the methods. The current mainstream NER model architectures are: 1) Encoder-type models: such as BERT-CRF, which utilize the pre-trained BERT encoder to extract contextual features and combine CRF for sequence labeling Kaur et al. 2024 ; Chandra et al. 2024 , demonstrating high efficiency in multi-domain NER; 2) Encoder-Decoder-type models: such as T5 Raffel et al. 2020 and BART Lewis et al. 2020 , which treat NER as a sequence generation task, with the encoder extracting features and the decoder generating entity labels Ni et al. 2022 , suitable for complex annotation scenarios; 3) Decoder-only models: such as ChatGPT Laskar et al. 2023 , which generate entity labels through prompt learning Shen et

Read the complete text