Document-Level Zero-Shot Relation Extraction with Entity Side Information

Mohan Raj Chanthran, Lay-Ki Soon, Ong Huey Fang, Bhawani Selvaretnam · 2026

Read Document-Level Zero-Shot Relation Extraction with Entity Side Information by Mohan Raj Chanthran, Lay-Ki Soon, Ong Huey Fang, Bhawani Selvaretnam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-07271.txt.

Introduction

Research by Mohan Raj Chanthran and co-authors was posted on arXiv in 2026. It deals with Document-Level Zero-Shot relation extraction with entity side information. The preprint joined the arXiv PAPERS collection in 2026. Document-Level Zero-Shot Relation Extraction (DocZSRE) aims to predict unseen relation labels in text documents without prior training on specific relations.

Existing approaches rely on Large Language Models (LLMs) to generate synthetic data for unseen labels, which poses challenges for low-resource languages like Malaysian English. For specialists, the preprint offers a compact account of the problem and the authors' approach.

Catalog record

CREATORMohan Raj Chanthran, Lay-Ki Soon, Ong Huey Fang, Bhawani Selvaretnam
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-07271

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Document-Level Zero-Shot Relation Extraction with Entity Side Information Mohan Raj Chanthran, Lay-Ki Soon, Ong Huey Fang, Bhawani Selvaretnam Abstract Document-Level Zero-Shot Relation Extraction (DocZSRE) aims to predict unseen relation labels in text documents without prior training on specific relations. Existing approaches rely on Large Language Models (LLMs) to generate synthetic data for unseen labels, which poses challenges for low-resource languages like Malaysian English. These challenges include the incorporation of local linguistic nuances and the risk of factual inaccuracies in LLM-generated data. This paper introduces Document-Level Zero-Shot Relation Extraction with Entity Side Information (DocZSRE-SI) to address limitations in the existing DocZSRE approach. The DocZSRE-SI framework leverages Entity Side Information, such as Entity Mention Descriptions and Entity Mention Hypernyms, to perform ZSRE without depending on LLM-generated synthetic data. The proposed low-complexity model achieves an average improvement of 11.6% in the macro F1-Score compared to baseline models and existing benchmarks. By utilizing Entity Side Information, DocZSRE-SI offers a robust and efficient alternative to error-prone, LLM-based methods, demonstrating significant advancements in handling low-resource languages and linguistic diversity in relation extraction tasks. This research provides a scalable and reliable solution for ZSRE, particularly in contexts like Malaysian English news articles, where traditional LLM-based approaches fall short. 1 Introduction Relation Extraction (RE) is a crucial NLP task that identifies the relation between entities in text. Document-Level Relation Extraction (DocRE) takes this further by capturing relations across sentences. Most RE models rely on supervised learning, which requires large amounts of labelled data and is limited to predicting predefined relations. Labelling data is expensive and time-consuming, especially for news articles where new relations constantly emerge. Open Relation Extraction (ORE) tries to address this by identifying relation phrases without predefined labels, but it often produces redundant or overly specific results, making standardization and interpretation difficult. Zero-Shot Relation Extraction (ZSRE) has emerged as a solution to overcome the limitations of supervised and ORE approaches. While significant progress has been made in sentence-level ZSRE, document-level ZSRE remains largely unexplored. Currently, only one notable approach exists for document-level ZSRE ( 14 ) , which generates synthetic data for unseen relations and fine-tunes a language model on seen relations. However, this method is complex, resource-intensive, and relies heavily on LLMs like ChatGPT, which struggle with low-resource languages such as Malaysian English ( 1 ) . These limitations highlight the need for more robust and scalable solutions. To address these gaps, we propose Document-Level Zero-Shot Relation Extraction with Entity Side Information (DocZSRE-SI). This framework tackles the challenges of document-level ZSRE by focusing on Entity Side Information, including Entity Mention Descriptions, Entity Mention Hypernyms, and Entity Types. Instead of processing entire documents, DocZSRE-SI concentrates on the Entity Mention Descriptions relevant to the entity pairs being evaluated. This approach provides a concise and meaningful representation of entities, improving efficiency and accuracy by focusing on essential context and reducing noise from long documents. Our evaluation shows that DocZSRE-SI performs well not only in Malaysian English but also in Standard English. The key contributions of this paper are as follows: 1. Introduction of DocZSRE-SI: We propose Document-Level Zero-Shot Relation Extraction framework that leverages Entity Side Information to enhance the prediction of unseen relations within a document. The code of this framework is published in https://github.com/mohanraj-nlp/DocZSRE-SI . 2. Efficient Context Utilization: Instead of processing entire documents, DocZSRE-SI focuses on relevant Entity Mention Descriptions, reducing noise and improving efficiency while maintaining high accuracy in predicting unseen relations. 3. Incorporation of Entity Side Information: Our approach integrates Entity Mention Hypernym, and Entity Type to provide a richer semantic representation, improving the model’s ability to infer relations in a zero-shot setting. This paper is structured as follows: Section 2 reviews existing approaches for sentence-level and document-level ZSRE. Section 3 presents the DocZSRE-SI framework, which consists of two modules: Building Entity Side Information and Zero-Shot Relation Extraction. In Sections 4 and 5 , we describe the experimental setup and discuss the results. Finally, Section 6 concludes the paper and outlines directions for future work. 2 Related Work ZSRE extracts relations between entities without task-specific labelled data, using pre-trained language models (PLMs), knowledge graphs, or prompt-based methods to generalize to unseen relations. While most ZSRE approaches focus on Sentence-Level (intra-sentential) Relation Extraction (Section 2.1 ), only one notable work addresses Document-Level (inter-sentential) Relation Extraction (Section 2.2 ). This section reviews key ZSRE contributions and is grouped by techniques. 2.1 Sentence-Level ZSRE Sentence-Level Zero-Shot Relation Extraction (ZSRE) has been explored through various methodologies, including reformulating it as Reading Comprehension and Textual Entailment tasks, leveraging Prompt-based Learning with external knowledge, and advancing Representation Learning with matching techniques. Early works framed ZSRE as reading comprehension ( 10 ) or textual entailment tasks ( 11 ) , with later improvements like entailment templates ( 13 ) . Prompt-based methods, such as RelationPrompt ( 4 ) and ZS-SKA ( 7 ) , combined prompts with external knowledge, achieving strong results on datasets like FewRel ( 8 ) , and Wiki-ZSL ( 3 ) but struggling with generalization to unseen relations. Representation learning approaches, including ZSLRC ( 6 ) , ZS-BERT ( 3 ) , and RE-Matching ( 18 ) , focused on fine-grained matching and improved zero-shot classification. Additionally, Weak Supervision and Template Infilling have emerged as innovative strategies to reduce reliance on annotated data. 2.2 Document-Level ZSRE The literature review highlights limited work on Document-Level Zero-Shot Relation Extraction (ZSRE). One notable contribution is by ( 14 ) , which proposes generating synthetic data using ChatGPT to handle unseen relation labels. The approach introduces a Chain-of-Retrieval (CoR) prompt to guide the generation of sentences corresponding to relation triplets and incorporate a Consistency-Guided Knowledge Denoising Strategy to enhance the quality of synthetic data. Experiments show the approach achieves 41.3 ± 8.9 and 41.5 ± 8.7 on Re-DocRED and DocRED test sets, outperforming baselines and demonstrating its effectiveness in generating high-quality relational data without extensive human annotation. Despite this advancement, document-level ZSRE remains underexplored, calling for further research. 3 Methodology Figure 1: High-Level architecture of DocZSRE-SI Framework Figure 1 provides an overview of DocZSRE-SI, which consists of two key components. First, the Building Entity Side Information Module processes input document to extract additional details of Entity Mention like Entity Types, Entity Mention Descriptions, and Entity Mention Hypernyms (details Section 3.1 ). Second, the Zero-Shot Relation Extraction Module analyzes each entity pair to identify the best unseen relation label. This is done by leveraging Entity Side Information and calculating a Dynamic Weighted Score for each label. The label with the highest score is selected as the correct relation (details in Section 3.2 ). 3.1 Building Entity Side Information Building Entity Side Information module is a key element of the DocZSRE-SI framework. This component is designed to enrich information about entities based on input documents. The collected side information includes Entity Mention Type, Entity Mention Description (Section 3.1.1 ), and Entity Mention Hypernym (Section 3.1.2 ). 3.1.1 Entity Mention Description Generator Entity Mention Description extends traditional NER by providing rich, contextual details about an entity. Instead of simply labelling it as a PERSON , ORGANIZATION , or LOCATION , it generates a detailed textual description that captures the surrounding text, semantic context, and implied attributes while also pulling information from multiple sentences or

Read the complete text