Unsupervised Named Entity Disambiguation for Low Resource Domains
Debarghya Datta, Soumajit Pramanik · 2024
Read Unsupervised Named Entity Disambiguation for Low Resource Domains by Debarghya Datta, Soumajit Pramanik (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10054.txt.
Introduction
Debarghya Datta and Soumajit Pramanik wrote a paper from 2024 on linking names in text to the right entries in a knowledge base. A name such as Jordan may mean a person, a place, or a brand. Tools must pick the right one from context. In fields such as history, technical writing, and medicine, the texts are noisy and training data are scarce, so most past tools fail.
Their method needs no training. It looks at all names in a document at once and seeks a tree joining the best match for each at the least total cost. Matches that hang together in the knowledge base win. On test sets from several fields, it beat the best past training-free tools by a wide margin. The team offers it for fields with their own knowledge bases but little labeled text.
Catalog record
| CREATOR | Debarghya Datta, Soumajit Pramanik |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-10054
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unsupervised Named Entity Disambiguation for Low Resource Domains Debarghya Datta, Soumajit Pramanik Abstract In the ever-evolving landscape of natural language processing and information retrieval, the need for robust and domain-specific entity linking algorithms has become increasingly apparent. It is crucial in a considerable number of fields such as humanities, technical writing and biomedical sciences to enrich texts with semantics and discover more knowledge. The use of Named Entity Disambiguation (NED) in such domains requires handling noisy texts, low resource settings and domain-specific KBs. Existing approaches are mostly inappropriate for such scenarios, as they either depend on training data or are not flexible enough to work with domain-specific KBs. Thus in this work, we present an unsupervised approach leveraging the concept of Group Steiner Trees (GST), which can identify the most relevant candidates for entity disambiguation using the contextual similarities across candidate entities for all the mentions present in a document. We outperform the state-of-the-art unsupervised methods by more than 40% (in avg.) in terms of Precision@1 across various domain-specific datasets. 1 Introduction Named Entity Disambiguation (NED) is the task of resolving the ambiguity associated with entity mentions in a document by linking them to the appropriate entries in a Knowledge Base (KB). Recently, NED has been applied in various fields, including digital humanities, art, architecture, literature, and biomedical science, for tasks such as searching Meij et al. 2014 , question answering Yih et al. 2015 and information extraction Nooralahzadeh and Øvrelid 2018 . The key challenges in such domain specific NED tasks are twofold - (a) they provide little or no training data with ground truth annotations and (b) the associated knowledge graphs (KG) are typically small and with no or very limited entity descriptions Shi et al. 2023 . In order to deal with such challenges, in this work we consider the setting where entity disambiguation is needed to be performed with absolute absence of annotated data . In such constrained scenarios, leveraging the state-of-the-art neural entity linkers become infeasible as they are primarily dependent on a large corpus of annotated data and long enough entity descriptions from KG Cadavid-Sánchez et al. 2023 ; Arora et al. 2021 . Similarly this setting also disqualifies unsupervised NED approaches such as Pan et al. 2015 which rely on labeled data to generate candidate entities such as domain-adaptive transformer-based models Aydin et al. 2022 , BLINK Ledell Wu 2020 , Zeshel Logeswaran et al. 2019 , and auto-regressive models like GENRE De Cao et al. 2021 . In the literature, only a few approaches fit our constrained setting such as graph-based using mention distances Hoffart et al. 2011 , PageRank/random walk based Guo and Barbosa 2018 , and graph ranking based Alhelbawy and Gaizauskas 2014 . A recent approach by Arora et al. 2021 also explores singular value decomposition, showing gold entities in a low-rank subspace. However, these methods often struggle in achieving the required efficacy while disambiguating entities. In this work, we present a novel unsupervised NED approach for domain specific low-resource scenarios, which leverages the concept of Group Steiner Trees (GSTs) Garg et al. 2000 . In this approach, we map the candidate entities for each mention in the document, to nodes in the associated knowledge graph, obtain the subgraph connecting these nodes and then extract minimum cost GSTs from this sub-graph. Such GSTs facilitate collective entity disambiguation exploiting the fact that the entities that are truly mentioned in a document (the ‘gold entities’) tend to form a dense subgraph among the set of all candidate entities in the document. Figure 1: Proposed GST-NED approach: The sample document at the top contains three mentions; the subgraph extracted from the KB is shown at the left and the minimum cost GST is shown using the box at the right. In the induced subgraph, the candidates for ‘adenoma’ are marked in red, ‘hamartomas’ are marked in yellow and ‘liver rupture’ are marked in blue. In summary, our main contributions are the following - (a) We propose an unsupervised G roup S teiner T ree based N amed E ntity D isambiguation ( GST-NED ) method which is capable to perform NED for low resource domains at the absence of any annotated data; (b) We compare our proposed approach with several state-of-the-art baselines across multiple domain specific datasets and demonstrate its superior performance with significant improvements in the metrics (more than 40\% in avg. in Precision@1 scores) 1 1 1 Code is available at https://github.com/deba-iitbh/GST-NED . 2 Problem Statement Similar to most previous works in the NED literature (with a few exceptions Kolitsas et al. 2018 ; Sil and Yates 2013 ), we assume that document-wise mention spans (usually obtained by a named entity recognizer) are already provided. Let d be a single document from a collection D of documents. Also, let M_{d}=\{m_{1},m_{2},\ldots,m_{M}\} be the set of M mentions contained in d , and let \mathcal{E} be the collection of all the entities contained in the reference domain specific Knowledge Graph KG . The task here is to find, for each mention m_{i} the correct entity e\in\mathcal{E} it refers to. Typically, given the set of mentions, an NED approach performs the disambiguation in two steps - (a) Candidate generation, where candidate entities from the KG are retrieved for each of the mentions, and (b) Candidate Ranking, where the candidate entities are ranked based on their propensities to be mapped with the corresponding mentions. Our primary focus in this study is the candidate ranking/disambiguation step. In the following, we describe our proposed candidate ranking method and mention the approaches adhered for the other step. 3 Methodology Candidate Generation We index the domain specific KG and use fuzzy text search Bachmann 2021 to retrieve candidates based on the surface form of the annotated mention. This is found to be the standard practice in most of the recent unsupervised NED approaches Yang et al. 2023 ; Simos and Makris 2022 Fuzzy text search returns a confidence value with each potential match; we keep only the candidates which are returned with more than 0.75 confidence value (chosen empirically) 2 2 2 In case of exact match with a KG node, we consider it to be the correct match for the mention and skip the candidate ranking step. . Candidate Ranking We use the knowledge graph ( KG ) to create a subgraph connecting all pairs of candidate entities obtained from the candidate generation step for a particular document d . To keep the graph size manageable, we limit path lengths to be a maximum of three hops between entity candidates. We further enhance the graph by adding node weights based on the Jaro-Winkler distance Wang et al. 2017 (reflecting similarities of candidates with mentions), and edge weights based on cosine similarities of Node2Vec Grover and Leskovec 2016 structural embeddings of the endpoints. In Figure 1 , we depict a document with three mentions and the corresponding induced subgraph of candidate entities (left side). Finding GST: Our approach to identify the correct candidates relies on the intuition that a gold entity candidate from a document d should be more tightly connected with other gold candidates in the induced subgraph compared to other non-gold candidates. In other words, we