Evaluation of LLMs on Long-tail Entity Linking in Historical Documents
Marta Boscariol, Luana Bulla, Lia Draetta, Beatrice Fiumanò, Emanuele Lenzi, Leonardo Piano · 2025
Read Evaluation of LLMs on Long-tail Entity Linking in Historical Documents by Marta Boscariol, Luana Bulla, Lia Draetta, Beatrice Fiumanò, Emanuele Lenzi, Leonardo Piano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03473.txt.
Description
Marta Boscariol and co-authors test how well large language models link names in old documents to the right entries in a knowledge base, in a 2025 study. The hard cases are rare names that appear seldom in training data.
Working with a hand-checked benchmark drawn from specialist historical texts, the team compared GPT and Llama3 against ReLiK, a leading tool built for the task. The language models did surprisingly well on the rare names. The results suggest they can help close the gap between common names, which tools handle well, and rare ones, which they often miss.
Catalog record
| CREATOR | Marta Boscariol, Luana Bulla, Lia Draetta, Beatrice Fiumanò, Emanuele Lenzi, Leonardo Piano |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-03473