Looking for the Bottleneck in Fine-grained Temporal Relation Classification Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809581 ISBN: 979-8-4007-2599-9/2026/07 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Neural networks CCS: Information systems Information extraction
Hugo Sousa, Ricardo Campos, Alípio Jorge · 2026
Read Looking for the Bottleneck in Fine-grained Temporal Relation Classification Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809581 ISBN: 979-8-4007-2599-9/2026/07 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Neural networks CCS: Information systems Information extraction by Hugo Sousa, Ricardo Campos, Alípio Jorge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24620.txt.
Introduction
Sousa, Campos and Jorge revisit temporal relation classification. The task is to decide how pairs of time entities in text relate to each other. Recent datasets made the task simpler, using only event pairs and a subset of relations. Their Interval from Point approach first classifies relations between interval endpoints. It then decodes those point relations into a full interval relation. On the TempEval-3 benchmark it reaches 70.1 percent on temporal awareness, a new best result.
Catalog record
| CREATOR | Hugo Sousa, Ricardo Campos, Alípio Jorge |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41969 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24620
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Looking for the Bottleneck in Fine-grained Temporal Relation Classification Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809581 ISBN: 979-8-4007-2599-9/2026/07 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Neural networks CCS: Information systems Information extraction Hugo Sousa, Ricardo Campos, Alípio Jorge Abstract . Temporal relation classification is the task of determining the temporal relation between pairs of temporal entities in a text. Despite recent advancements in natural language processing, temporal relation classification remains a considerable challenge. Early attempts framed this task using a comprehensive set of temporal relations between events and temporal expressions. However, due to the task complexity, datasets have been progressively simplified, leading recent approaches to focus on the relations between event pairs and to use only a subset of relations. In this work, we revisit the broader goal of classifying interval relations between temporal entities by considering the full set of relations that can hold between two time intervals. The proposed approach, Interval from Point, involves first classifying the point relations between the endpoints of the temporal entities and then decoding these point relations into an interval relation. Evaluation on the TempEval-3 dataset shows that this approach can yield effective results, achieving a temporal awareness score of 70.1 70.1 percent, a new state-of-the-art on this benchmark. † † cc-license: by 1. Introduction Understanding temporal information in text is essential for comprehending its underlying narrative ( 18 ) . Many real-world applications, such as summarization ( 49 ) , question answering ( 7 ) , and timeline generation ( 4 ) , rely on the ability to determine when events occur and how they relate in time. Consequently, extracting and structuring temporal information is an important task in natural language processing. A common approach to structuring temporal information is by encoding the relative temporal positioning of temporal entities – entities that can be anchored in time – occurring in the text. This approach has been extensively studied, particularly within the framework of the TimeML annotation scheme ( 36 ) and the TempEval shared tasks ( 43 ; 45 ; 41 ) . In this framework, temporal information is structured as triples of the form (source entity, relation, target entity), where the relation belongs to a set of 14 labels inspired by the 13 interval relations defined by 3 . For instance, in the sentence “John arrived in Boston after 10 p.m. ” , the temporal entities “arrived” and “10 p.m.” are linked by the after relation, forming the triplet ( “arrived” , after , “10 p.m.” ). While temporal relations are intuitive for humans, they are often conveyed implicitly, relying on reasoning and commonsense knowledge ( 11 ; 52 ) to be inferred – abilities that computational models still struggle to replicate ( 12 ) . A key obstacle for further development of effective temporal relation classification systems lies in the complexity of creating datasets annotated with the full set of temporal relations. The process is not only labor-intensive but also hindered by low inter-annotator agreement and data sparsity. As a result, existing datasets remain limited, typically containing only a few thousand annotated relations ( 34 ; 41 ; 38 ) . Moreover, these annotations end up being highly skewed toward the most frequent relations, leaving the others significantly underrepresented. To address these challenges, prior research has sought to simplify the task in various ways, including reducing the number of relation types ( 6 ) , focusing exclusively on relations between events ( 28 ) , restricting annotations to specific event subsets ( 4 ) , or considering only relations between event start points ( 33 ) . While these approaches have advanced our understanding of temporal structures, systems trained on such datasets do not generalize beyond the specific relations and event types encountered during training. This limitation restricts their applicability in real-world applications. For instance, models that do not classify relations between events and temporal expressions cannot effectively anchor events in time. Furthermore, since the introduction of these benchmarks, most research efforts have been dedicated to producing systems for them ( 23 ; 54 ; 21 ; 47 ) , leaving the classification of the full set of interval relations largely unexplored. In this work, we revisit the challenge of classifying fine-grained temporal relations at the interval level, using both events and temporal expressions as entities. The proposed system, Interval from Point (IfP), decomposes the problem by first classifying the pointwise relations between the endpoints of temporal entities and then decoding these point relations into an interval relation. The main motivation behind this strategy is that at the point-level, classification involves only three labels – before, after, and equals – which simplifies the learning task. Furthermore, since each relation in the interval relation dataset can be translated to four point relations, this approach significantly increases the number of training examples. This enables us to fine-tune a language model for point relation classification, yielding effective results at this level. The predicted point relations are then aggregated to infer the corresponding interval relation through a decoding strategy. Evaluation on the TempEval-3 dataset shows that this approach can yield effective results and a clear path for future research. In summary, the contributions of this research are the following: (i) We propose a new method for temporal relation classification, IfP, which breaks down the task of interval relation classification into classifying point relations between the endpoints of temporal entities. (ii) We systematically evaluate the impact of data augmentation and model size on the effectiveness of point relation classification model. (iii) Our experiments demonstrate that fine-tuning a pre-trained language model on an augmented interval dataset can surpass the effectiveness of the best baseline systems from previous studies. (iv) Finally, our experimental setup allows us to identify the current limitations of the proposed system and provide a clear path for future research. 2. Temporal Relation Classification The goal of the temporal relation classification task is to find a system S that, given a document d and a pair of temporal entities x and y within it, determines their temporal relation r : (1) S(d,x,y)\to r Regarding the temporal entities x and y , these are pre-annotated in the text and can be thought of as any entity that can be anchored in time. In TimeML framework ( 36 ) , the most established annotation scheme, temporal entities are defined as being composed of events and temporal expressions. Events describe situations that occur, unfold, or persist over time, including actions ( “announced” ), states ( “remained closed” ), and conditions ( “ongoing” ). They can appear as verbs, nominalizations, adjectives, or prepositional phrases. Temporal expressions, on the other hand, denote points or intervals in time and provide explicit temporal anchors within a text. These can be dates ( “January 1” ), times ( “midnight” ), durations ( “two years” ), or sets ( “every Thursday” ). A temporal expression of particular importance is the document creation time. Although it is not explicitly mentioned in the