Beyond Pairwise: Global Zero-shot Temporal Graph Generation
Alon Eirew, Kfir Bar, Ido Dagan · 2025
Read Beyond Pairwise: Global Zero-shot Temporal Graph Generation by Alon Eirew, Kfir Bar, Ido Dagan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11114.txt.
Introduction
Alon Eirew, Kfir Bar, and Ido Dagan extract a document whole timeline of events in one pass. Their 2025 paper tackles temporal relation extraction, which orders events in text. Pairwise tools judge each event pair alone, wasting compute and breaking global consistency.
Their zero-shot method draws the full temporal graph at once with a language model. A constraint step then polishes the graph and enforces consistent ordering across relations. A new dataset, OmniTemp, annotates every pair among target events, filling a gap in test resources. Experiments beat prior zero-shot methods and rival supervised models. The authors frame whole-graph generation as the natural shape of the task, since time in a document is one web, not a bag of pairs.
Catalog record
| CREATOR | Alon Eirew, Kfir Bar, Ido Dagan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11114
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Pairwise: Global Zero-shot Temporal Graph Generation Alon Eirew, Kfir Bar, Ido Dagan Abstract Temporal relation extraction (TRE) is a fundamental task in natural language processing (NLP) that involves identifying the temporal relationships between events in a document. Despite the advances in large language models (LLMs), their application to TRE remains limited. Most existing approaches rely on pairwise classification, where event pairs are classified in isolation, leading to computational inefficiency and a lack of global consistency in the resulting temporal graph. In this work, we propose a novel zero-shot method for TRE that generates a document’s complete temporal graph in a single step, followed by temporal constraint optimization to refine predictions and enforce temporal consistency across relations. Additionally, we introduce OmniTemp , a new dataset with complete annotations for all pairs of targeted events within a document. Through experiments and analyses, we demonstrate that our method outperforms existing zero-shot approaches and offers a competitive alternative to supervised TRE models. 1 Introduction Temporal relation extraction (TRE) is a foundational task in natural language processing (NLP) that supports applications such as event forecasting Ma et al. (2023) , misinformation detection Lei and Huang (2023) , and medical treatment timeline construction Yao et al. (2024) . The TRE task is formulated as follows: given a pair of event mentions, identify the temporal relation between them (e.g., before, after, equal, include, is included, vague). The task has seen significant progress in recent years with the development of supervised models Tan et al. (2023) ; Niu et al. (2024) . However, these models require large amounts of training data, which is scarce in most domains and languages, and difficult to obtain due to the complexity of manually annotating such relations Pustejovsky and Stubbs (2011) . Recent advances in large language models (LLMs) have shown strong capabilities in capturing linguistic patterns Brown et al. (2020) , performing multi-step reasoning Wei et al. (2022) , and applying temporal commonsense knowledge Jain et al. (2023) , positioning them as promising tools to address data scarcity through zero-shot learning Kojima et al. (2022) . However, existing zero-shot LLM-based TRE work has focused on pairwise classification Yuan et al. (2023) ; Chan et al. (2024) . Pairwise methods face significant computational challenges, particularly in real-world scenarios where the goal is to construct a complete timeline of events from a document. In such cases, all event pairs must be classified, resulting in O(n^{2}) inference calls for n events. This quadratic complexity becomes impractical when using LLMs due to their high computational cost per query. Moreover, because pairwise approaches consider each event pair in isolation, they fail to capture the global temporal structure of the document, often leading to inconsistent or contradictory temporal graphs Wang et al. (2020) . As a result of these challenges, zero-shot applications of LLMs to TRE have largely been regarded as ineffective Wei et al. (2024) ; Niu et al. (2024) ; Chan et al. (2024) ; Ning et al. (2024) . In contrast, global TRE involves predicting the complete set of temporal relations between all event pairs in a document, resulting in a temporal graph that captures the holistic temporal structure. This approach enables models to enforce global consistency and jointly reason about relations, essential for accurate temporal understanding. In doing so, it also provides a more scalable alternative to the computational inefficiencies of pairwise modeling. Figure 1: Illustration of the pipeline approach (§ 4 ): [1] We send the same prompt to the model to generate separate instances of the document’s complete temporal graph. [2] We extract the relation distribution as one-hot vectors over the temporal classes for each relation in each generation. [3] We sum and normalize the predictions into a single vector representing the joint prediction over the document’s temporal graph. [4] We apply an ILP optimization algorithm to this vector. [5] The final temporal graph is obtained. A critical obstacle for global TRE research is the lack of datasets with complete temporal relation annotations for all event pairs. Manual annotation of full temporal graphs is notoriously challenging and traditionally considered infeasible Naik et al. (2019) . Most TRE datasets therefore provide labels only for a subset of event pairs, often limited to events in consecutive sentences Chambers et al. (2014) ; Ning et al. (2018b) . This partial coverage constrains models to pairwise strategies and complicates evaluation of long-range temporal reasoning. Alternative automated labeling approaches Naik et al. (2019) ; Alsayyahi and Batista-Navarro (2023) mitigate annotation costs but risk introducing biases inherent to the automated annotation methods themselves. To address the scarcity of fully annotated datasets, and the inefficiency and global inconsistency of pairwise classification in zero-shot settings, we make the following contributions: 1 1 1 OmniTemp and all experimental code are publicly available at https://github.com/AlonEirew/GlobalZeroShotTRE . • We propose a novel zero-shot LLM method that generates the entire temporal graph in a single inference step. Our method prompts the model to produce a free-form summary of the event timeline to guide reasoning or “thinking”, followed by classification of all event pairs, aggregated via a global temporal constraints optimization algorithm to ensure consistency (Figure 1 , and § 4 ). This approach significantly reduces computational cost compared to pairwise methods while achieving performance competitive with supervised models (§ 6 ). • To support global temporal graph extraction, we introduce OmniTemp , a new dataset with exhaustive temporal relation annotations for all event pairs (§ 3 ). • We discuss how annotation scope and guideline inconsistencies affect zero-shot model assessment. We show that limiting annotations to short-distance event pairs, as well as discrepancies between widely used datasets such as MATRES and TB-Dense, can hinder fair and reliable evaluation of TRE models in zero-shot settings. 2 Background This section provides relevant background on datasets and zero-shot methods for the temporal relation extraction task. 2.1 Temporal Relation Extraction Datasets The temporal relation extraction task aims to determine the temporal order between pre-extracted events in a text Pustejovsky et al. (2003) . For fair and unbiased model evaluation, datasets should provide gold labels for all event pairs or, at a minimum, be randomly sampled from the full set. However, most existing datasets for temporal relation extraction provide only partial annotation due to the complexity and cost of the process Pustejovsky and Stubbs (2011) ; Naik et al. (2019) . As a result, the two most widely used datasets, MATRES Ning et al. (2018b) and TimeBank-Dense (TB-Dense) Chambers et al. (2014) , annotate only relations between events in consecutive sentences. Recently, the NarrativeTime project Rogers et al. (2024) , a large effort of expert annotation, released a comprehensive, re-annotation of the TB-Dense corpus, covering all possible event pairs. The dataset includes seven relation types: before , after , includes , is-included , equal , overlap , and vague . Temporal relations are established based on event start times, end times, and durations. Notably, the vague relation indicates that the temporal relation cannot be determined from the provided context or where annotators disagree, and it is crucial for complete annotation, as it confirms that the pair was considered during annotation and deemed inconclusive, rather than ignored. While NarrativeTime provides an exhaustively annotated dataset, it follows complex annotation guidelines