Cross-Document Contextual Coreference Resolution in Knowledge Graphs
Zhang Dong Mingbang Wang Songhang deng Le Dai Jiyuan Li, Xingzu Liu Ruilin Nong · 2025
Read Cross-Document Contextual Coreference Resolution in Knowledge Graphs by Zhang Dong Mingbang Wang Songhang deng Le Dai Jiyuan Li, Xingzu Liu Ruilin Nong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05767.txt.
Introduction
Zhang Dong and co-authors present a method to resolve references across documents inside knowledge graphs. Their 2025 paper tackles coreference: the same entity can appear under many mentions in many texts, and matching them is key to clean extraction. Knowledge graphs add structure that plain text methods cannot use.
Their approach links graph entities to text mentions through a dynamic mechanism that updates as context builds. Contextual embeddings carry the sense of each mention, while graph-based inference traces how entities relate. Tests on several benchmark data sets showed gains in both precision and recall over standard methods. The authors argue that graph context sharpens our grasp of tangled links across documents.
Catalog record
| CREATOR | Zhang Dong Mingbang Wang Songhang deng Le Dai Jiyuan Li, Xingzu Liu Ruilin Nong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05767
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cross-Document Contextual Coreference Resolution in Knowledge Graphs Zhang Dong Mingbang Wang Songhang deng Le Dai Jiyuan Li, Xingzu Liu Ruilin Nong Abstract Coreference resolution across multiple documents poses a significant challenge in natural language processing, particularly within the domain of knowledge graphs. This study introduces an innovative method aimed at identifying and resolving references to the same entities that appear across differing texts, thus enhancing the coherence and collaboration of information. Our method employs a dynamic linking mechanism that associates entities in the knowledge graph with their corresponding textual mentions. By utilizing contextual embeddings along with graph-based inference strategies, we effectively capture the relationships and interactions among entities, thereby improving the accuracy of coreference resolution. Rigorous evaluations on various benchmark datasets highlight notable advancements in our approach over traditional methodologies. The results showcase how the contextual information derived from knowledge graphs enhances the understanding of complex relationships across documents, leading to better entity linking and information extraction capabilities in applications driven by knowledge. Our technique demonstrates substantial improvements in both precision and recall, underscoring its effectiveness in the area of cross-document coreference resolution. 1 Introduction Advanced language models are increasingly utilized in tasks requiring coreference resolution, particularly in long and complex contexts. Techniques like Long Question Coreference Adaptation (LQCA) focus on resolving references effectively amid extensive information, helping models better partition and navigate intricate narratives Liu et al. 2024a . Moreover, addressing cross-document event coreference resolution (CDECR) can enhance understanding across multiple documents by leveraging collaborative approaches that utilize both general and specific language models, leading to superior performance in various scenarios Min et al. 2024 . Named entity recognition and dependency parsing techniques are also crucial in extracting relationships and key entities from natural language, streamlining the process and reducing errors compared to traditional methods Qayyum et al. 2023 . Furthermore, advancements like the Maverick coreference resolution pipeline present efficient solutions that maintain high performance even with fewer parameters, making them suitable for academic and resource-constrained environments Martinelli et al. 2024 . These developments contribute to the evolution of models capable of managing contextual coreference within knowledge graphs effectively. However, addressing the relationships between events and their contextual cores is crucial for accurate information retrieval and processing. The integration of an event relation graph has shown promise in conspiracy theory identification, utilizing coreference and other types of relations to enhance accuracy Lei and Huang 2023 . This suggests that a similar approach could be beneficial for resolving contextual coreferences across documents by leveraging different types of relationships. Exploring existing methodologies that emphasize linkages between entities and events can provide insights into refining knowledge graph systems. However, enhancing the precision of contextual coreference resolution in these complex frameworks remains a significant challenge. This work focuses on the challenge of coreference resolution across multiple documents within the context of knowledge graphs. We introduce a novel method that identifies and resolves references to the same entities spread across different texts by leveraging structured knowledge representations. Our approach utilizes a dynamic linking mechanism that connects entities within the knowledge graph to relevant textual mentions. By employing contextual embeddings and graph-based inference techniques, we capture relationships and interactions between entities, which enhances the accuracy of coreference resolution. We systematically evaluate our method on several benchmark datasets, demonstrating significant improvements in resolving coreferences compared to traditional techniques. Our findings reveal that leveraging context from knowledge graphs can significantly aid in understanding complex inter-document relationships, resulting in improved entity linking and information extraction in knowledge-driven applications. The enhancements in both precision and recall metrics strongly reflect the effectiveness of our proposed technique in the realm of cross-document coreference resolution. Our Contributions. Our contributions can be outlined as follows. • We propose a novel coreference resolution method that operates across multiple documents within knowledge graphs, effectively connecting references to the same entities. Our dynamic linking mechanism enhances the accuracy of coreference identification by relating textual mentions to structured knowledge representations. • Through the use of contextual embeddings and graph-based inference techniques, we capture intricate relationships and interactions between entities. This multifaceted approach provides a robust framework for understanding the context surrounding references, leading to improved resolution outcomes. • Extensive evaluations on benchmark datasets highlight the significant advancements achieved with our technique over traditional methods, emphasizing the vital role of knowledge graphs in enhancing both precision and recall in cross-document coreference resolution tasks. 2 Related Work 2.1 Contextual Reasoning in Knowledge Graphs The extraction and creation of knowledge graphs from structured data can enhance contextual understanding, particularly in applications involving product specifications and legacy data Sahadevan et al. 2024 . The integration of numerical attributes within knowledge graphs can mitigate semantic ambiguities, thus enabling better reasoning capabilities Yin et al. 2024 . Approaches like LARK harness both contextual search and logical reasoning to enable sophisticated reasoning over knowledge graphs using large language models Choudhary and Reddy 2023 . Additionally, the Logical Entity Representation model demonstrates the ability to improve knowledge graph completion through effective rule learning Han et al. 2023 . The introduction of context graphs presents a paradigm shift in knowledge representation and reasoning, leveraging large language models for effective entity and context retrieval Xu et al. 2024 . Lastly, robotic skill awareness can be elevated through knowledge graph-based frameworks that support high-level spatial reasoning Qi et al. 2024 , while efficient modularization strategies in graph-based retrieval-augmented generation promote effective design space exploration Cao et al. 2024 . 2.2 Coreference Resolution Techniques The introduction of the ThaiCoref dataset addresses specific challenges in Thai language coreference resolution by adapting the OntoNotes benchmark, making it a significant resource for researchers working in this area Trakuekul et al. 2024 . In the realm of event and entity coreference across documents, a contrastive representation learning method has demonstrated state-of-the-art performance on the ECB+ corpus, highlighting the effectiveness of this approach Hsu and Horwood 2022 . The Maverick pipeline emerges as an efficient and accurate solution for coreference resolution, proving to be capable of outperforming larger models while maintaining budgetary constraints Martinelli et al. 2024 . Moreover, addressing long contextual understanding, the Long Question Coreference Adaptation (LQCA) method enhances the ability of models to manage references more effectively, contributing to improved comprehension in complex scenarios Liu et al. 2024a . Across multilingual contexts, a novel neural coreference resolution system leveraging the CorefUD dataset proposes strategies that enhance performance, thus facilitating better resolution capabilities across diverse languages Pražák and Konopík 2024 . Finally, recent advancements in differential privacy have introduced frameworks that aim to decrease memory demands on language models while ensuring user data protection Liu et al. 2024b . 2.3 Cross-Document Information Integration The integration of information from multiple documents can be enhanced through various novel approaches and techniques. One method involves the development of a multi-document model that utilizes a pre-training objective specifically tailored for cross-document question answering, enabling improved recovery of informational relations between texts Caciularu et al. 2023 . Additionally, a kNN-based approach that re-ranks documents by their relevance feedback can effectively enhance document retrieval processes Baumgärtner et al. 2022 . The utilization of dual encoders with cross-attention provides a mechanism for integrating contextual information from different sources, catering to stance detection tasks Beck et al. 2022 . Initiatives