Towards a More Generalized Approach in Open Relation Extraction

Qing Wang, Yuepei Li, Qiao Qiao, Kang Zhou, Qi Li · 2025

Read Towards a More Generalized Approach in Open Relation Extraction by Qing Wang, Yuepei Li, Qiao Qiao, Kang Zhou, Qi Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22801.txt.

Introduction

Qing Wang and four co-authors tackle relation extraction when new fact types hide among known ones, in a paper from twenty twenty-five. The task pulls relational facts between named things from raw text with no fixed list of relation types. Older methods assume data is either all new or neatly split in advance, which real text never is.

Their framework, MixORE, works in two phases that teach classification and clustering together. It learns the known relations while grouping the rest into fresh clusters. On three benchmark sets it beat rival methods at both sorting known relations and clustering new ones. The authors aim the approach at messy real-world text mining.

Catalog record

CREATORQing Wang, Yuepei Li, Qiao Qiao, Kang Zhou, Qi Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-22801

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards a More Generalized Approach in Open Relation Extraction Qing Wang, Yuepei Li, Qiao Qiao, Kang Zhou, Qi Li Abstract Open Relation Extraction (OpenRE) seeks to identify and extract novel relational facts between named entities from unlabeled data without pre-defined relation schemas. Traditional OpenRE methods typically assume that the unlabeled data consists solely of novel relations or is pre-divided into known and novel instances. However, in real-world scenarios, novel relations are arbitrarily distributed. In this paper, we propose a generalized OpenRE setting that considers unlabeled data as a mixture of both known and novel instances. To address this, we propose MixORE, a two-phase framework that integrates relation classification and clustering to jointly learn known and novel relations. Experiments on three benchmark datasets demonstrate that MixORE consistently outperforms competitive baselines in known relation classification and novel relation clustering. Our findings contribute to the advancement of generalized OpenRE research and real-world applications. Source code is available 1 1 1 https://github.com/qingwang-isu/MixORE . 1 Introduction Open Relation Extraction (OpenRE) is a fundamental task in Information Extraction (IE) that aims to identify and extract relational facts between named entities from unlabeled data. Unlike traditional Relation Extraction (RE), which relies on a predefined set of relations and requires end-users to specify their information needs and provide costly annotations, OpenRE operates in a more flexible “open-world” setting. It proactively discovers novel relations, generalizes them into meaningful categories, and identifies additional instances, making it a more adaptable approach for large-scale IE. In recent years, OpenRE has attracted increasing attention from researchers. Wang et al. (2022) and Li et al. (2022) introduce prompt-based learning methods and advanced clustering techniques, achieving impressive results on unlabeled data. However, existing OpenRE methods typically assume either that the unlabeled data consists entirely of novel relations or that there is prior information indicating whether an instance belongs to a known or novel relation. These assumptions do not accurately reflect the complexities of real-world scenarios. Hogan et al. (2023) further dispose of the simplifying assumptions and make new assumptions that the unlabeled data includes known and novel instances and that novel relations are typically rare, belong to the long-tail distribution, and tend to be explicitly expressed. Their model, KNoRD, is built around these assumptions. However, the “long-tail” assumption may not always hold, particularly in scenarios where novel relations emerge as newly-recognized concepts in the real world that have not yet been labeled. Additionally, novel relations may arise when human annotators label only some relations within a large dataset, leaving many potential relations unidentified. For novel relations that do not follow the long-tail distribution, KNoRD tends to introduce additional noise and its performance degrades. Furthermore, we observe that a noticeable performance gap still exists between known and novel instances ( Hogan et al., 2023 ) , highlighting the potential for further OpenRE research. In this paper, we relax the “long-tail” assumption and instead assume the unlabeled data contains both known and novel instances, with no restrictions on the nature of these relations. We propose MixORE model to effectively classify known instances and identify novel relations within unlabeled data. MixORE has two phases: novel relation detection and open-world semi-supervised joint learning (OW-SS joint learning). In the first phase, our goal is to identify potential novel relations within unlabeled data. We represent each known relation with a one-hot vector in latent space and train a Semantic Autoencoder (SAE) ( Kodirov et al., 2017 ) on labeled data. The trained SAE then maps both labeled and unlabeled instances into the shared latent space, where known instances will cluster around their respective one-hot vectors. In contrast, novel instances, which are less likely to align with any known relations, tend to appear as outliers in this mapping process. Furthermore, instances in the same novel relation often exhibit a clustering pattern. Therefore, we leverage each unlabeled instance’s similarity to the known relation one-hot vectors as a criterion for outlier detection. Subsequently, we apply the Gaussian Mixture Model (GMM) ( Pedregosa et al., 2011 ) to cluster these outliers into novel relation groups and extract instances closest to each cluster centroid as high-quality weak labels for further training. In the second phase, OW-SS joint learning, we utilize weak labels and adopt a continual learning strategy to align our approach with the evolving nature of OpenRE in real-world applications. MixORE is designed based on the insight that classifying known relations requires learning compact and well-separated feature representations, whereas detecting novel relations benefits from capturing diverse and transferable features. To achieve this, we incorporate contrastive learning by leveraging both labeled instances and data distribution to form positive pairs and propose the OW-SS loss function, which jointly optimizes relation classification and clustering. In summary, our main contributions are: • We comprehensively review the assumptions made in previous OpenRE studies and introduce a generalized OpenRE setting. • We propose a two-phase framework MixORE that learns discriminative features for known relations while continuously incorporating novel information from unlabeled data, making it more adaptable to OpenRE in real-world scenarios. • Experimental results demonstrate that our approach achieves remarkable performance on both known and novel relations across the FewRel, TACRED, and Re-TACRED datasets. 2 Related Work Relation Extraction (RE) is an essential Natural Language Processing (NLP) task and has been extensively studied with approaches relying on supervised learning techniques trained on manually annotated datasets ( Miller et al., 1998 ; Zelenko et al., 2002 ; Peng et al., 2017 ; Zhong and Chen, 2021 ; Wadhwa et al., 2023 ) . While RE models achieve high performance, their dependency on large-scale labeled data presents a major limitation ( Zhou et al., 2023 ) . Moreover, they operate under a “closed-world” assumption, where relations are pre-defined, limiting their ability to handle emerging or novel relations. To address these challenges, OpenRE is proposed to proactively identify novel relations from unlabeled data in an “open-world” setting, making it more suitable for real-world, large-scale information extraction. Existing OpenRE methods mostly operate under two settings. The first setting is unsupervised relation extraction (URE), where models identify relations between named entities from unlabeled data without relying on manual annotations. Liu et al. (2022) propose a hierarchical exemplar contrastive learning framework that refines relation representations by leveraging both instance-level and exemplar-level signals for optimization. Wang et al. (2023) strengthen the discriminative power of contrastive learning with both within-sentence pairs augmentation and augmentation through cross-sentence pairs extraction to increase the diversity of positive pairs. The second setting of existing methods, semi-supervised OpenRE, involves training models on labeled data with known relations, while the unlabeled data consists entirely of novel relations or is pre-divided into known and novel sets. Wang et al. (2022) develop a novel prompt-based framework that enables the model to generate efficient representations for instances in the open domain and learn clustering novel relational instances. Li et al. (2022) design a co-training framework that combines the advantage of type abstraction and the conventional token-based representation. Figure 1: Overview of MixORE Framework. There are some recent studies trying to address the open-world semi-supervised learning (Open-world SSL) setting, where unlabeled data contains a mixture of both known and novel classes. Cao et al. (2022) propose ORCA for computer vision tasks. This method introduces uncertainty adaptive margin loss objective

Read the complete text