SMARTe: Slot-based Method for Accountable Relational Triple extraction
Xue Wen Tan Stanley Kok · 2025
Read SMARTe: Slot-based Method for Accountable Relational Triple extraction by Xue Wen Tan Stanley Kok (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12816.txt.
Introduction
Xue Wen Tan and Stanley Kok present SMARTe, an interpretable system for extracting relational triples from text, in a two thousand twenty-five paper. A relational triple states a fact as subject, relation, and object. Extraction is a basic step in building knowledge graphs from documents.
Most earlier systems chase accuracy while staying opaque inside. SMARTe instead uses slot attention, which funnels evidence into distinct slots. Every prediction can be traced back to a slot and the tokens that fed it. The task is framed as set prediction rather than sequence generation. On the NYT and WebNLG datasets, accuracy matched leading models. Attention heatmaps let users inspect the reasoning behind each extracted triple.
Catalog record
| CREATOR | Xue Wen Tan Stanley Kok |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-12816
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SMARTe: Slot-based Method for Accountable Relational Triple extraction Xue Wen Tan Stanley Kok Abstract Relational Triple Extraction (RTE) is a fundamental task in Natural Language Processing (NLP). However, prior research has primarily focused on optimizing model performance, with limited efforts to understand the internal mechanisms driving these models. Many existing methods rely on complex preprocessing to induce specific interactions, often resulting in opaque systems that may not fully align with their theoretical foundations. To address these limitations, we propose SMARTe: a Slot-based Method for Accountable Relational Triple extraction. SMARTe introduces intrinsic interpretability through a slot attention mechanism and frames the task as a set prediction problem. Slot attention consolidates relevant information into distinct slots, ensuring all predictions can be explicitly traced to learned slot representations and the tokens contributing to each predicted relational triple. While emphasizing interpretability, SMARTe achieves performance comparable to state-of-the-art models. Evaluations on the NYT and WebNLG datasets demonstrate that adding interpretability does not compromise performance. Furthermore, we conducted qualitative assessments to showcase the explanations provided by SMARTe, using attention heatmaps that map to their respective tokens. We conclude with a discussion of our findings and propose directions for future research. 1 Introduction Relational Triple Extraction (RTE) is a well-established and widely studied task in Natural Language Processing (NLP). Its primary objective is to automatically extract structured information such as names, dates, and relationships from unstructured text, thereby enhancing data organization and accessibility Nayak et al. (2021) . These extracted relationships are represented as relational triples consisting of (Subject, Relation, Object) .Such structured representations underpin a range of downstream applications, including knowledge graph construction, question answering, and information retrieval. RTE is often confused with Joint Entity and Relation Extraction (JERE) Zhang et al. (2017) ; Gupta et al. (2016) ; Miwa and Sasaki (2014) , or the terms are used interchangeably by some scholars Sui et al. (2023) ; Li et al. (2021) . However, there is a key distinction: JERE addresses both entity identification and relation extraction (i.e., ACE04, ACE05 and CoNLL04 datasets) Roth and Yih (2004) , which require annotation of all entities in a text, regardless whether they participate in a relationship. In contrast, RTE focuses exclusively on entities that are part of a relationship, specifically a set of annotated relational triples , hence the two tasks are fundamentally different. In this paper, we focus solely on RTE . Figure 1: Most Approaches vs Our Approach. Figure 2: Architecture Diagram of our SMARTe model. The Slot Attention module iteratively refines the slots over T iterations to obtain a final representation, from which relational triples are extracted. To motivate our work, lets take a look at an example seen in Figure 1 . Most approaches rely on fine-tuned BERT embeddings to form pair representations by permuting all token pairs and classifying their relationships. However, this methodology makes it difficult to trace which specific contextual information each pair has absorbed, for instance, whether "Barack" or "America" has incorporated the "president" context. Despite achieving superior F1 performance, these pair-based approaches lack interpretability, obscuring how models arrive at their predictions. In contrast, our approach uses triplet-based representation , which absorbs all relevant tokens to directly form relational triplets. This enables a more direct and interpretable encoding of relationships. We observed that most existing methods have excellent performance but with limited interpretability, which highlights a significant gap in current research. In this study, we introduce SMARTe 1 1 1 We will release our implementation after acceptance. : a S lot-based M ethod for A ccountable R elational T riple Extraction, a transparent architecture designed to address interpretability in RTE. SMARTe incorporates intrinsic interpretability through the use of a slot attention mechanism. This approach ensures that every prediction from SMARTe can be explicitly traced back to its learned slot representations and the specific tokens contributing to each predicted relational triple as shown in Appendix A . This results in informed and transparent outputs, embodying the A ccountability, which directly equates to explainability , in our model. Since the learned slots do not follow any inherent order, the RTE task is framed as a set prediction problem. Although we illustrate our approach in the context of RTE, it is broadly applicable to other NLP tasks characterized by set-based target structures . Interpretability becomes especially valuable in high-stakes scenarios where transparency and trust are paramount Danilevsky et al. (2020) . As stakeholders increasingly demand clear and interpretable explanations for AI-driven decisions, our approach effectively addresses these critical requirements. We introduce SMARTe , a S lot-based M ethod for A ccountable R elational T riple e xtraction. Our contributions are as follows: • To the best of our knowledge, the proposed SMARTe framework is the first to introduce interpretability to relational triple extraction tasks by adapting the slot attention mechanism, originally developed for unsupervised learning in computer vision. • We conduct extensive experiments on two widely used datasets and demonstrate that our model achieves performance comparable to current state-of-the-art systems, all while offering interpretability. • We provide a qualitative assessment and demonstrate how slot attention facilitates explanations which allow users to understand the model’s reasoning behind its predictions. • We report zero-shot performance on RTE tasks using recent LLMs for future benchmarks. 2 Related Work Recent advancements in relation triplet extraction (RTE) have investigated various architectures to better capture interactions between entities and relations. We group these approaches into three main categories: sequence-to-sequence (seq2seq) Methods, Tagging-Based Methods, and Pairwise-Based Methods. Seq2seq methods treat triples as token sequences, leveraging an encoder-decoder framework akin to machine translation. CopyRE Zeng et al. (2018) uses a copy mechanism to generate relations and entities but struggles with multi-token entities. CopyMTL Zeng et al. (2020) addresses this by employing a multi-task learning framework. CGT Ye et al. (2021) introduces a generative transformer with contrastive learning to enhance long-term dependency and faithfulness. R-BPtrNet Chen et al. (2021) uses a binary pointer network to extract explicit and implicit triples, while SPN Sui et al. (2023) reframes relational triple extraction as a set prediction problem, utilizing a non-autoregressive decoder with iterative refinement for improved contextual representation. Tagging-Based Methods , also known as sequence labeling methods, utilize binary tagging sequences to identify the start and end positions of entities and, in some cases, to determine relations. Early approaches, such as NovelTagging Zheng et al. (2017) , introduced a tagging-based framework that reformulates joint extraction as a tagging problem, enabling direct extraction of entities and their relations. CasRel Wei et al. (2019) improves on this by first identifying all potential head entities and then applying relation-specific sequence taggers to detect corresponding tail entities. Recent methods, however, are not entirely sequence-based. For instance, BiRTE employs tagging only for entities. It employs a pipeline strategy in which entities are tagged as either subjects or objects, after which all possible subject-object pairs are generated and classified using a biaffine scorer. Similarly, PRGC Zheng et al. (2021) includes a component to predict potential relations, constraining subsequent entity recognition to the predicted relation subset. PRGC’s strong performance stems from its use of a global correspondence table, which effectively captures interactions between token pairs. Pairwise-Based Methods focus on enhancing token-pair interaction representations to improve relation classification. These methods eliminate the