It’s All About the Confidence: An Unsupervised Approach for Multilingual Historical Entity Linking using Large Language Models
Cristian Santini, Marieke van Erp, Mehwish Alam · 2026
Read It’s All About the Confidence: An Unsupervised Approach for Multilingual Historical Entity Linking using Large Language Models by Cristian Santini, Marieke van Erp, Mehwish Alam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08500.txt.
Introduction
Cristian Santini, Marieke van Erp, and Mehwish Alam wrote a 2026 arXiv paper on linking names in old texts to who they mean. The task is called entity linking. It stays hard for old texts, in spite of gains from large language models. Old texts vary in tongue, hold noisy input, and use words in ways that shift over time. Past tools need much training data, or field-bound rules that cap their scale. The authors set out a way with no training phase, based on trust in each link.
Catalog record
| CREATOR | Cristian Santini, Marieke van Erp, Mehwish Alam |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08500
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
It’s All About the Confidence: An Unsupervised Approach for Multilingual Historical Entity Linking using Large Language Models Cristian Santini, Marieke van Erp, Mehwish Alam Abstract Despite the recent advancements in NLP with the advent of Large Language Models (LLMs), Entity Linking (EL) for historical texts remains challenging due to linguistic variation, noisy inputs, and evolving semantic conventions. Existing solutions either require substantial training data or rely on domain-specific rules that limit scalability. In this paper, we present MHEL-LLaMo ( Multilingual Historical Entity Linking with Large Language MOdels 1 1 1 This acronym was chosen because its pronunciation resembles the Spanish phrase “Me llamo” , which means “My name is” , a common way to declare someone’s identity. ), an unsupervised ensemble approach combining a Small Language Model (SLM) and an LLM. MHEL-LLaMo leverages a multilingual bi-encoder (BELA) for candidate retrieval and an instruction-tuned LLM for NIL prediction and candidate selection via prompt chaining. Our system uses SLM’s confidence scores to discriminate between easy and hard samples, applying an LLM only for hard cases. This strategy reduces computational costs while preventing hallucinations on straightforward cases. We evaluate MHEL-LLaMo on four established benchmarks in six European languages (English, Finnish, French, German, Italian and Swedish) from the 19th and 20th centuries. Results demonstrate that MHEL-LLaMo outperforms state-of-the-art models without requiring fine-tuning, offering a scalable solution for low-resource historical EL. The implementation of MHEL-LLaMo is available on Github . 1 Introduction Entity Linking (EL) is a crucial Information Extraction (IE) task, allowing researchers to automatically trace and link references to named entities to external Knowledge Bases (KBs) for semantic enrichment, document indexing, and linking to external sources. EL has been used in a variety of use cases, such as social network analysis ( 17 ; 28 ) , media monitoring ( 6 ) , and artwork and motif recognition ( 30 ; 32 ) . Despite the remarkable performance of EL systems on contemporary benchmarks ( 8 ; 25 ; 22 ) , this task remains challenging with historical texts due to complex document varieties, noisy inputs, multilinguality, and evolving syntactic and semantic conventions. 2 2 2 For more details and examples, a comprehensive survey of IE tasks in historical texts has been presented in ( 10 ) . Some approaches have been proposed to adapt EL systems to deal with historical documents, relying either on supervised architectures ( 23 ) that need training data and careful parameter tuning or rule-based constraints which do not scale well across different domains ( 21 ) . More recently, Large Language Models (LLMs) have been used to perform EL on historical texts with zero-shot prompting ( 4 ; 16 ) ; however, the results obtained are still inferior to those of supervised domain-specific approaches ( 21 ; 3 ; 23 ) . The goal of this paper is to perform Multilingual Historical Entity Linking (MHEL) in an unsupervised way by using LLMs in combination with a Small Language Model (SLM). Specifically, we use BELA ( 25 ) , a multilingual XLM-R-based bi-encoder ( 7 ) for retrieving a set of candidates from Wikidata similar to a given mention. Then, we leverage prompt chaining to guide an LLM in either selecting the most plausible candidate from the set of Wikidata entities or predicting a NIL entity when no candidate corresponds to the entity referenced in the text. Based on the findings of 24 , we investigate how confidence scores returned by the SLM may improve the performance of LLMs by allowing them to discriminate between easy and hard samples. The main hypothesis of this work is that using LLMs only for hard samples to refine the bi-encoder’s results provides a threefold advantage: 1. The background knowledge of LLMs is leveraged to deal with complex named entity mentions; 2. By keeping the bi-encoder’s results for easy samples, LLMs are prevented from hallucinating on simple cases; 3. By using LLMs only for hard samples, energy costs for model inference are minimized. Therefore, the main contribution of this work is to propose an unsupervised ensemble architecture for MHEL called MHEL-LLAMO ( Multilingual Historical Entity Linking with Large Language MOdels ), where an LLM performs sequential NIL prediction and candidate selection over a block of entities returned by a bi-encoder only for hard samples, i.e., when confidence scores of the bi-encoder do not reach a minimum threshold. To prove the effectiveness of our approach, we test both a vanilla combination of BELA with LLMs and our ensemble solution MHEL-LLAMO on several datasets with texts spanning from the 19th to the 20th century written in six languages (English, Finnish, French, German, Italian and Swedish). Our empirical findings show that MHEL-LLAMO outperforms most of the specialized models for MHEL and suggest that adaptively using LLMs via prompt chaining to refine the bi-encoder’s results leads to robust performance on multilingual historical texts belonging to different genres and represents a novel solution to democratize access to advanced IE techniques for low-resource historical languages. To the best of our knowledge, this is the first successful attempt to use LLMs to adapt general-purpose EL systems to historical texts. Datasets, source code and pre-trained models are publicly available to enhance reproducibility. 3 3 3 https://github.com/sntcristian/MHEL-LLAMO . 2 Related Work In this section, we discuss related work on historical IE and EL. Figure 1: Overview of the MHEL-LLaMo architecture. The system combines BELA’s bi-encoder for candidate retrieval, a KB consisting of a Faiss Index, and a lookup table for returning similar candidates from Wikidata with metadata, an adaptive threshold to filter easy samples and an instruction-tuned LLM for NIL prediction and candidate selection for hard samples. 2.1 Neural Approaches for MHEL Historical texts present important challenges for EL systems due to the complexity of historical texts, the presence of OCR errors, and the high frequency of NIL entities, i.e., entities that do not appear in a KB. To solve these problems, several specialized MHEL systems have been proposed in recent years. SBB ( 21 ) is a multilingual framework supporting English, German, and French languages, structured around three core modules: (1) candidate retrieval using word embeddings and k -NN search on Wikipedia titles, with temporal filtering based on document publication dates and Wikidata information; (2) candidate evaluation via BERT-based similarity scoring between mention contexts and Wikipedia entity sentences; and (3) candidate re-ranking using Random Forest classification on combined similarity scores. Despite the originality of this work, the proposed approach has potential disadvantages due to the use of Wikidata information for filtering candidates before retrieval, which may lead to a higher false negative rate. The L3i system ( 3 ) also presents a neural approach for MHEL on English, French, and German. This method builds upon the end-to-end EL framework of 20 by adding three key enhancements: an OCR error correction module, a cross-lingual vector index derived from multilingual Wikipedia entity representations, and post-processing heuristics that rerank candidates and identify NIL entities using DBpedia information. Building on this foundation, 23 introduced MELHISSA, an enhanced version of the L3i system also applied to Swedish and Finnish. MELHISSA extends L3i by incorporating 18 specialized post-processing filters for candidate reranking and NIL entity prediction, utilizing string distance metrics such as Levenshtein distance alongside information