DELICATE: Diachronic Entity LInking using Classes And Temporal Evidence

Cristian Santini, Sebastian Barzaghi, Paolo Sernani, Emanuele Frontoni, Mehwish Alam · 2025

Read DELICATE: Diachronic Entity LInking using Classes And Temporal Evidence by Cristian Santini, Sebastian Barzaghi, Paolo Sernani, Emanuele Frontoni, Mehwish Alam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-10404.txt.

Introduction

Cristian Santini and four co-authors work on entity linking for historical Italian texts, matching names in documents to entries in a knowledge base. Humanities material is hard for this task: old document styles, few training sets, and many obscure people and places. Their system, DELICATE, mixes a neural encoder with structured knowledge from Wikidata.

DELICATE checks candidate matches for temporal plausibility, meaning the person lived at the right time, and for consistency of entity type. The team also built ENEIDE, a corpus drawn from annotated editions of literary and political texts from the nineteenth and twentieth centuries. DELICATE beat other models on this material, even much larger ones, and its confidence scores make its choices easier to inspect.

Catalog record

CREATORCristian Santini, Sebastian Barzaghi, Paolo Sernani, Emanuele Frontoni, Mehwish Alam
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-10404

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DELICATE: Diachronic Entity LInking using Classes And Temporal Evidence Cristian Santini, Sebastian Barzaghi, Paolo Sernani, Emanuele Frontoni, Mehwish Alam Abstract In spite of the remarkable advancements in the field of Natural Language Processing, the task of Entity Linking (EL) remains challenging in the field of humanities due to complex document typologies, lack of domain-specific datasets and models, and long-tail entities, i.e., entities under-represented in Knowledge Bases (KBs). The goal of this paper is to address these issues with two main contributions. The first contribution is DELICATE, a novel neuro-symbolic method for EL on historical Italian which combines a BERT-based encoder with contextual information from Wikidata to select appropriate KB entities using temporal plausibility and entity type consistency. The second contribution is ENEIDE, a multi-domain EL corpus in historical Italian semi-automatically extracted from two annotated editions spanning from the 19th to the 20th century and including literary and political texts. Results show how DELICATE outperforms other EL models in historical Italian even if compared with larger architectures with billions of parameters. Moreover, further analyses reveal how DELICATE confidence scores and features sensitivity provide results which are more explainable and interpretable than purely neural methods. keywords Entity Linking, Historical Italian, Text Corpus, Explainable NLP, Knowledge Bases 1 Introduction Entity Linking (EL) is the task of identifying and disambiguating entities mentioned in a text by linking them to their corresponding entries in structured Knowledge Bases (KBs) such as Wikipedia, Wikidata 1 1 1 https://www.wikidata.org ( 28 ) , etc. EL is a key component of many Knowledge Extraction (KE) applications in the Digital Humanities (DH), where it enables researchers to trace references to people, locations, organizations, and other named entities across historical sources. Despite the wide application of EL in various domains, general-purpose EL models often perform poorly on historical documents. These texts pose specific challenges, such as linguistic variations over time and the need for accurate chronological context, which are typically overlooked by State-of-The-Art (SoTA) models that rely solely on linguistic information ( 29 ; 5 ; 15 ) . Figure 1 shows a sentence from a text written by Aldo Moro (Italian politician) in 1978, containing a reference regarding a person mentioned with the surname “Amendola”. As the figure shows, there are multiple politicians in Wikipedia with that surname, therefore the information given only in the text is not enough to find a correct candidate. As this example proves, temporal information given in Wikidata about the entity’s birthdate can guide EL models to a correct decision. Figure 1: Representation of a sample sentence from the ENEIDE dataset containing a named entity and candidate entities from Wikipedia presented in a disambiguation page. The image shows how contextual information provided in external KBs allows to better determine the correct entity referenced in a historical text. To address this issue, several domain-specific methods have been proposed ( 14 ; 16 ; 9 ) which incorporate contextual features such as entity types and temporal information derived from KBs for improving disambiguation accuracy. However, a common limitation of these existing approaches is their reliance on manually crafted rules, which can be rigid and may lack generalizability. In contrast, this paper proposes a method that automatically learns the relevance of contextual information, such as class equivalence and temporal distance, by using them as features in a supervised tree-ensemble model called Gradient Boosted Trees (GBTs). This traditional Machine Learning (ML) approach, compared to more complex Deep Neural Networks (DNNs), has the advantage of efficiently capturing statistical patterns based on numerical features without requiring extensive pre-training, large datasets, and powerful computational resources. Moreover, a further advantage of GBTs is to have a higher level of explainability compared to DNNs since each tree creates explicit if-then rules with clear decision boundaries based on feature thresholds and the relevance of each feature can be measured based on permutation importance or gain-based importance ( 30 ) . Moreover, the lack of benchmark datasets for EL in the DH is a pivotal issue that must be addressed for advancing NLP techniques in this field ( 7 ) . To the best of our knowledge, currently there are no datasets in Italian which allow to train historical EL models. Due to the increasing amount of data produced in the DH domain including corpora ( 8 ) , digital editions ( 4 ) , and KBs ( 2 ) , it is crucial to understand how to combine these resources to advance the SoTA of EL for under-explored languages such as historical Italian. In this regard, Scholarly Digital Editions (SDEs) ( 20 ) are a primary source of annotations for people, places, organizations, bibliographic resources, and other entities, providing a large number of samples of entities referenced in historical texts and disambiguated using Wikidata. As a consequence, this study aims to address the following Research Questions (RQs): • RQ1 : How can we address the problem of EL in historical documents by combining approaches based on language models with tree-based methods using background knowledge, i.e. dates and classes, from Wikidata? • RQ2 : Can we leverage the information already present in SDEs to build a novel training and evaluation corpus for EL in Italian based on historical documents? • RQ3 : Can we analyse the features and scores of GBTs through statistical techniques to provide a clearer explanation of the behaviour of a supervised EL model in the historical domain? To answer these questions, this study introduces DELICATE, a novel supervised architecture for EL designed specifically for historical texts. DELICATE combines the strengths of neural language models and tree-ensemble methods by integrating a BERT-based ( 6 ) bi-encoder model ( 18 ) for candidate retrieval with a supervised GBTs classifier for candidate re-ranking. The novel aspect of DELICATE is its ability to incorporate class and temporal information from Wikidata as explicit features in the re-ranking process. In particular, DELICATE uses a GBTs classifier to re-rank the bi-encoder results by computing pairwise similarity scores based on features such as temporal distance, type compatibility, string similarity, and embedding distance. This allows the model to dynamically assess the contextual relevance of each candidate entity, which is important when dealing with diachronic variations in language and meaning. Our tests on historical Italian show how DELICATE achieves better performances on multiple benchmarks if compared with auto-regressive multilingual models ( 5 ) and even when bi-encoders are paired with open-source Large Language Models (LLMs), such as LLaMa3.1 ( 11 ) . Given that there are currently no datasets in Italian with chronological information, we also introduce ENEIDE ( Extracted Named Entities from Italian Digital Editions ), a publicly available EL corpus which provides annotated texts in historical Italian spanning multiple domains and years. ENEIDE is semi-automatically constructed using annotations from two SDEs: Digital Zibaldone 2 2 2 https://digitalzibaldone.net/ ( 26 ) and Aldo Moro Digitale 3 3 3 https://aldomorodigitale.unibo.it/ ( 1 ) , which comprise both literary and political domains from the 19th to the 20th century. By leveraging existing entity annotations in SDEs and linking them to Wikidata, ENEIDE provides a robust benchmark for training and evaluating EL systems in Italian. Both the source code of DELICATE 4 4 4 source code: https://github.com/sntcristian/DELICATE , the dataset ENEIDE 5 5 5

Read the complete text