Enhancing Frame Detection with Retrieval Augmented Generation
Papa Abdou Karim Karou Diallo, Amal Zouaq · 2025
Read Enhancing Frame Detection with Retrieval Augmented Generation by Papa Abdou Karim Karou Diallo, Amal Zouaq (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12210.txt.
Introduction
Papa Abdou Karim Karou Diallo and Amal Zouaq brought retrieval into a classic language task in 2025: finding the semantic frames a sentence evokes. Frame semantics describes events through structured scenes, like buying or arresting, each with its own roles. Detecting which frames a text triggers is a first step toward machine understanding. Previous systems usually needed the target word marked in advance.
Their approach, RCIF, is the first retrieval-augmented method for frame detection and works without any marked target span. It embeds frames from several representations, retrieves candidate frames for an input text, then identifies the best fits. Experiments covered zero-shot, few-shot, and fine-tuned settings. The retrieval component significantly improved results, suggesting frames are easier to recognize by comparison than by pure generation. The method points semantic parsing toward the retrieve-then-decide pattern succeeding elsewhere.
Catalog record
| CREATOR | Papa Abdou Karim Karou Diallo, Amal Zouaq |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-12210
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing Frame Detection with Retrieval Augmented Generation Papa Abdou Karim Karou Diallo, Amal Zouaq Abstract Recent advancements in Natural Language Processing have significantly improved the extraction of structured semantic representations from unstructured text, especially through Frame Semantic Role Labeling (FSRL). Despite this progress, the potential of Retrieval-Augmented Generation (RAG) models for frame detection remains under-explored. In this paper, we present the first RAG-based approach for frame detection called RCIF ( R etrieve C andidates and I dentify F rames). RCIF is also the first approach to operate without the need for explicit target span and comprises three main stages: (1) generation of frame embeddings from various representations ; (2) retrieval of candidate frames given an input text; and (3) identification of the most suitable frames. We conducted extensive experiments across multiple configurations, including zero-shot, few-shot, and fine-tuning settings. Our results show that our retrieval component significantly reduces the complexity of the task by narrowing the search space thus allowing the frame identifier to refine and complete the set of candidates. Our approach achieves state-of-the-art performance on FrameNet 1.5 and 1.7, demonstrating its robustness in scenarios where only raw text is provided. Furthermore, we leverage the structured representation obtained through this method as a proxy to enhance generalization across lexical variations in the task of translating natural language questions into SPARQL queries. Figure 1: Overview of our proposed method called RCIF ( R etrieve C andidates and I dentify F rames). (1) Frame embeddings are generated using an embedding model based on various frame representations. These embeddings are stored in a vector database. (2-3) Given an input text, the system retrieves candidate frames based on similarity scores of input text and frames embeddings. (4-5) An LLM is then fine-tuned with dynamic prompts to select the best matching frames from the retrieved candidates, completing identification process. 1 Introduction Large language models (LLMs) have significantly contributed to better semantic representations of natural language sequences, as witnessed by their state-of-the art performance in several natural language understanding tasks. However, LLMs are prone to a degradation of performance depending on their natural language input or prompt, which leads to limitations in terms of robustness and generalization ( Leidinger et al., 2023 ; Meng et al., ; Zheng et al., 2023 ) . Our high-level objective in this work is to explore if structured representations of natural language input, and more precisely frame semantics, can contribute to more robust models. Another objective is to explore a RAG-based approach for frame detection. Frames, as defined in Frame Semantics ( Baker et al., 1998 ) , are conceptual structures that capture the semantic and syntactic relationships underlying language. They are helpful in providing a structured semantic context for understanding relationships between entities, enabling tasks like Machine Reading Comprehension ( Guo et al., 2020 ; Flanigan et al., 2022 ; Bonn et al., 2024 ) and Information Extraction ( Su et al., 2021 ; Li et al., 2024b ; Chanin, 2023 ; Su et al., 2023 ) to be more accurate and contextually aware. Each frame represents a specific type of situation, event, or object along with the roles (or frame elements) associated with it. Frame identification involves selecting the most suitable semantic frame for a target word in a sentence context. Generally, state-of-the-art approaches require to indicate, in a free-form text, the explicit target for which a frame should be found. Consequently, they struggle to generalize to text without explicit targets, limiting their utility in broader downstream tasks, where these targets are not necessarily known. To solve these aforementioned limitations, our proposed method called RCIF ( R etrieve C andidates and I dentify F rames) for frame detection, as depicted in Figure 1 , leverages a RAG framework combined with a generative large language model (LLM) functioning mostly as a classifier. The approach operates in three main stages. First, we generate embeddings for candidate frames based on a variety of representations, including frame labels, descriptions, lexical units (LUs), and frame elements (FEs), and store these embeddings in a vector database. Next, for a given text input, we retrieve frames with the highest similarity scores as candidate frames. Finally, a generative LLM selects the best-matching frames from these candidates, effectively acting as a classifier. Given the hypothesis that structured representations have the potential to bridge the gap between different lexical variations of the same text, we utilize frames as an intermediate structured representation to translate natural language questions into SPARQL queries. The contributions of this paper are as follows: 1. We present the first approach that leverages a RAG model for frame detection. 2. We also introduce the first method to perform target-free frame detection directly from text. This makes our framework more useful for any text that does not have a predefined target. 3. Finally, we demonstrate that the structured representations obtained through this approach has the potential of improving the generalization of SPARQL query generation for different lexical variations of a question. Overall, our approach not only enhances frame detection accuracy but also addresses the challenge of target-free input by dynamically narrowing the search space to relevant frames, improving both recall and precision in frame identification. 2 Related Works 2.1 Frame semantic parsing The literature on frame parsing can be broadly divided into two main approaches: methods that frame the task as a sequence-to-sequence (Seq2Seq) generation problem and methods based on representation learning. Seq2Seq approaches ( Sutskever, 2014 ; Raffel et al., 2020 ; Kalyanpur et al., 2020 ; Chanin, 2023 ) define frame parsing as a generative task, decomposing it into subtasks such as trigger identification, frame classification, and argument extraction. These methods leverage pre-trained language models and task-specific optimizations to balance the subtask distributions and mitigate data scarcity ( Kalyanpur et al., 2020 ; Chanin, 2023 ) . As illustration, models like T5 ( Raffel et al., 2020 ) are pre-trained on PropBank ( Kingsbury and Palmer, 2002 ; Kingsbury and Palmer, 2003 ) and FrameNet exemplars, with text augmentation techniques applied to improve robustness and FrameNet lexical units incorporated to enhance frame classification accuracy. Then, they are fine-tuned on each of the aforementioned sub-tasks. For exemple, ( Kalyanpur et al., 2020 ) adopt a shared encoder with specialized decoders for each sub-task, enabling the model to leverage a common representation while handling each task independently within the same architecture. The Seq2Seq methods share a focus on utilizing the flexibility of generative models to capture the sequential nature of frame parsing tasks. Representation learning approaches, in contrast, focus on constructing enriched embeddings that align sentence-level context (or just the target span) with candidate frames ( Hartmann et al., 2017 ; Jiang and Riloff, 2021 ) . They often employ graph-based techniques, such as Graph Neural Networks (GNNs) ( Wu et al., 2020 ) , or contrastive learning ( Ju et al., 2024 ) to incorporate external knowledge and enhance the robustness of frame representations. These methods also emphasize semantic alignment through embedding techniques that integrate knowledge from FrameNet’s structure. Graph-based methods, for instance, exploit relationships between frames and frame elements ( Su et al., 2021 ; Zheng et al., 2022 ; Tamburini, 2022 ) , while contrastive learning approaches align contextual representations of target span