DISCIE - Discriminative Closed Information Extraction
Cedric Möller, Ricardo Usbeck · 2025
Read DISCIE - Discriminative Closed Information Extraction by Cedric Möller, Ricardo Usbeck (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-16348.txt.
Introduction
Cedric Möller and Ricardo Usbeck extract structured facts from text with a lean, old-fashioned strategy that beats giant generative models, in this 2025 paper. Closed information extraction reads a sentence and returns triples, subject, relation, object, drawn strictly from a known catalog of entities and relations. At full scale the catalog holds millions of entities and hundreds of relations, so guessing freely is hopeless.
Their system, DISCIE, takes the discriminative route: it classifies and links, using the types of the entities involved as a strong hint about which relations are plausible. That type information lifts accuracy most on rare, long-tail relations, the usual failure zone. Running smaller models, DISCIE matched or beat far larger generative systems while costing less to operate. The lesson for builders of knowledge bases is unfashionable and useful: constraints, well used, outperform size.
Catalog record
| CREATOR | Cedric Möller, Ricardo Usbeck |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-16348
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DISCIE - Discriminative Closed Information Extraction Cedric Möller, Ricardo Usbeck Abstract This paper introduces a novel method for closed information extraction. The method employs a discriminative approach that incorporates type and entity-specific information to improve relation extraction accuracy, particularly benefiting long-tail relations. Notably, this method demonstrates superior performance compared to state-of-the-art end-to-end generative models. This is especially evident for the problem of large-scale closed information extraction where we are confronted with millions of entities and hundreds of relations. Furthermore, we emphasize the efficiency aspect by leveraging smaller models. In particular, the integration of type-information proves instrumental in achieving performance levels on par with or surpassing those of a larger generative model. This advancement holds promise for more accurate and efficient information extraction techniques. Preprint Notice: This is a preprint of the following paper: Cedric Möller and Ricardo Usbeck, "DISCIE – Discriminative Closed Information Extraction" in "Lecture Notes in Computer Science", vol. 15232, pp. 23–40 (ESWC 2024 Satellite Events). First online: November 27, 2024. The final authenticated version is available at: https://link.springer.com/chapter/10.1007/978-3-031-77850-6_2 1 Introduction Today, our ability to generate data far surpasses our ability to understand it, particularly when that data is in textual form. As a potential solution, knowledge graphs (KGs), structured representations of data as interconnected nodes and links, offer the promise of making complex information machine-readable and easily interpretable [ 11 ] . However, the process of automatically transforming unstructured text into a meaningful KG is a significant unsolved problem. It encompasses numerous complex subproblems such as entity recognition, relation extraction and semantic understanding, where each represents a substantial field of study. In general, this means that a text is translated to a set of triples. Each triple consists of a subject, a predicate and an object. Each subject and object is an entity while the predicate corresponds to a relation between the two entities. In this work, we focus on Closed Information Extraction (CIE) [ 12 ] . Here, triples are extracted which are grounded in an underlying KG. This means that each of the extracted entities and relations have unique identifiers assigned. An example 1 1 1 Using QIDs and PIDs from www.wikidata.org . QIDs are the identifiers of entities and PIDs are the identifiers of relations. is: "Barack Obama was born in Hawaii" \rightarrow [Q76, P19, Q782] Recent methods like the State-of-the-Art model GenIE interpreted the task as an end-to-end machine translation task where the input is the text and the output are the triples. Generative models are employed to translate text directly to triples. While generative models proved to be very powerful, it is harder to incorporate external information (e.g., the underlying KG) into the generation process [ 12 ] . Hence, the generative model is forced to learn the entire KG during training. As the size of such a KG can be huge, this can inhibit performance. Also, this means such generative methods are not able to use an evolving version of the KG. Furthermore, the sequential nature of the decoding process often to leads lower efficiency, which is critical given the large amount of textual data available today. Lastly, the authors reported a lower performance on long-tail relations. 2 2 2 Relations rarely occurring. Instead of using generative models, this work employs discriminative models. This means, we first identify salient segments of the input text. Subsequently, external information is introduced to distinguish these segments within a predefined set of classes. The discriminative process encompasses tasks such as recognizing mentions, disambiguating entities, and extracting relations. Also, in many subtasks relevant to the task of end-to-end entity linking are non-generative models still state-of-the-art [ 30 , 18 ] . This allows us to tackle three shortcomings of the generative State-of-the-Art model: efficiency, inclusion of external information and performance on long-tail relations. We employ lightweight models in each step of our method which gives us a large efficiency boost. While such methods often perform worse than their larger counterparts, we investigate whether the utilization of fine-grained entity type information as external information into relation extraction step can alleviate the performance gap. Lastly, we explore whether this information has a positive impact on the performance on long-tail relations as well. The primary emphasis of this paper is centered around enhancements made to the relation extraction component. In terms of mention recognition and entity linking, our approach trains and uses models that have demonstrated high performance. The contributions of this paper are as follows: • Show that the inclusion of coarse-grained type information is not sufficient; • Show that the inclusion of fine-grained type information has a large impact on relation extraction and hence CIE in general (in particular long-tail relations); • Show that efficient lightweight discriminative models can outperform large-scale generative models when using fine-grained type information. In the following, we will develop such a discriminative method and especially focus on the incorporation of type information into the relation extraction step. 3 3 3 The code can be found in: https://github.com/semantic-systems/discie 2 Method 2.1 Problem definition - Closed Information Extraction We define the problem as follows: Given are a text t and a KG \mathcal{G}=(V,R,E) where V are all entities in the graph, R all relations in the graph and E\subseteq(V\times R\times V) all edges each of which connects two entities via a relation. Each text t contains triples of form <v,r,w> with v,w\in V and r\in R . The goal is to extract these triples from text. 2.2 Model Figure 1: DISCIE - Architecture. The intensity of the colors indicate the scores. Higher intensity resolves to a higher score. The likely outcome would be the triples: [(Q7186:Marie Curie, P166:award received, Q38104:Nobel Prize in Physics), (Q7186:Marie Curie, P26:spouse, Q37463:Pierre Curie)] Mention Recognizer The mention recognizer is an encoder-only model that accepts the tokenized input text t_{1},\dots,t_{i},\dots,t_{n} . It encodes the whole sequence to get an embedded representation for each token k_{1},\dots,k_{i},\dots,k_{n} , where k_{i}\in\mathbb{R}^{d} . Then, each pair of subsequent tokens is combined by concatenation and fed into a linear layer s_{i,j}=l(k_{i}\oplus k_{j})\in\mathbb{R} , classifying whether the pair denotes the first and last token of a mention or not. Overall it outputs \frac{n(n+1)}{2} scores for a sequence of length n . All scores surpassing an initial threshold are taken as mention candidates and forwarded to the entity candidate generation module. 4 4 4 Usually, mention recognition is solved by applying BIO sequence tagging. We trained and evaluated such a method but achieved a lower performance in comparison to the token-pair-based approach described above. The model is trained with the binary cross entropy loss function. Entity Candidate Generator The entity candidate generator is based on the bi-encoder architecture, more specifically a Siamese network [ 7 ] . The Siamese network is an encoder-only model. It encodes the textual mention representation and the textual entity representation into dense representations. The textual mention representation is of form [CLS] {mention} [CTX_L] {context_left} [CTX_R] {context_right} [SEP] where context_left and context_right is the text of a certain window size left and right of the identified mention. [CTX_L] and [CTX_R] are special tokens denoting the context. The textual entity representation is of form [CLS] {label} [DESC] {desc} [SEP] where {label} is the English label of the entity and {desc} is the short description