Retrieval-Enhanced Few-Shot Prompting for Speech Event Extraction
Máté Gedeon · 2025
Read Retrieval-Enhanced Few-Shot Prompting for Speech Event Extraction by Máté Gedeon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21372.txt.
Introduction
Máté Gedeon pulls structured events out of spoken language with a staged system, in work from 2025. Speech event extraction joins speech reading with language tools, and it is hard to do well. The system first reads speech to text, then sorts spans that may hold events with a mix of rules and two model types.
A large language model then picks event triggers and fills their parts, guided by like cases pulled by meaning search. The top model scored best on trigger sorting, well past prior marks, with weaker but still leading scores on parts. The author notes the staged design stays clear and easy to swap.
Catalog record
| CREATOR | Máté Gedeon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-21372
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Retrieval-Enhanced Few-Shot Prompting for Speech Event Extraction Máté Gedeon Abstract Speech Event Extraction (SpeechEE) is a challenging task that lies at the intersection of Automatic Speech Recognition (ASR) and Natural Language Processing (NLP), requiring the identification of structured event information from spoken language. In this work, we present a modular, pipeline-based SpeechEE framework that integrates high-performance ASR with semantic search-enhanced prompting of Large Language Models (LLMs). Our system first classifies speech segments likely to contain events using a hybrid filtering mechanism including rule-based, BERT-based, and LLM-based models. It then employs few-shot LLM prompting, dynamically enriched via semantic similarity retrieval, to identify event triggers and extract corresponding arguments. We evaluate the pipeline using multiple LLMs—Llama3-8B, GPT-4o-mini, and o1-mini—highlighting significant performance gains with o1-mini, which achieves 63.3% F1 on trigger classification and 27.8% F1 on argument classification, outperforming prior benchmarks. Our results demonstrate that pipeline approaches, when empowered by retrieval-augmented LLMs, can rival or exceed end-to-end systems while maintaining interpretability and modularity. This work provides practical insights into LLM-driven event extraction and opens pathways for future hybrid models combining textual and acoustic features. 1 Introduction Information extraction aims at automatically identifying structured information, such as entities and their relations, from unstructured data Bikel et al. 1997 ; Fei et al. 2023 . A task in this domain is Event Extraction (EE) Chen et al. 2015 searching for answers to questions like what happened , who was involved , and where did it take place . The source data can be text Yang and Mitchell 2016 , but even images Li et al. 2020 or videos Chen et al. 2021 . Speech Event Extraction (SpeechEE) Kang et al. 2024 extends textual EE, with the purpose of identifying structured event information directly from the input of the spoken language. This task occupies a unique intersection between Automatic Speech Recognition (ASR) and Natural Language Processing (NLP), requiring not only accurate transcription but also the detection of event types, triggers, and arguments from possibly noisy spoken content. Existing SpeechEE approaches can be broadly categorized into the methodologies pipeline-based and end-to-end . Pipeline-based architectures typically employ an ASR module to transcribe speech, followed by text-based event extraction using NLP techniques Cao et al. 2022 . These systems offer modularity and transparency, allowing separate optimization and analysis of ASR and extraction components. However, they are susceptible to cascading errors, where transcription inaccuracies can significantly impair downstream event extraction performance. Conversely, end-to-end approaches aim to bypass intermediate text by learning to map raw audio directly to structured outputs Wang et al. 2024 . While promising in reducing error propagation and potentially more efficient, these models often demand large-scale annotated audio-event datasets and are less interpretable, acting as opaque "black boxes" in many cases. Recent progress in Large Language Models (LLMs) such as GPT-4 OpenAI 2024a has opened new possibilities in pipeline-based architectures by enabling powerful few-shot and zero-shot learning capabilities. LLMs exhibit remarkable proficiency in extracting structured knowledge from unstructured text with minimal task-specific supervision Zhang et al. 2022 . When combined with state-of-the-art ASR systems, these models can form the backbone of robust SpeechEE systems that generalize well across domains and require minimal adaptation. In this work, we present a pipeline-based SpeechEE framework that leverages semantic search-enhanced few-shot prompting with LLMs. Our system dynamically retrieves relevant examples from a support set and incorporates them into prompts to guide event extraction. Additionally, we introduce a classification mechanism to identify utterances likely to contain events, reducing false positives and improving extraction precision. Our main contributions are as follows: • We propose a multi-stage SpeechEE pipeline combining high-performance ASR with semantic search-enhanced prompting for event extraction using LLMs. • We introduce a generalizable few-shot learning strategy based on semantic similarity, applicable to various text-related information extraction tasks. • We develop a speech segment classification module that selectively filters utterances likely to contain events. • We provide a detailed comparison of several configurations, offering practical insights for SpeechEE deployment. The remainder of the paper is organized as follows. Section 2 reviews related work on SpeechEE and language models. Section 3 introduces the dataset. Section 4 describes the model architecture and pipeline components. Section 5 presents the experimental results and analysis. Section 6 outlines the results of the ablation study. Section 7 discusses key findings and limitations. Finally, Section 8 concludes the paper and suggests directions for future research. 2 Related Work 2.1 Event Extraction from Text EE from textual data has been a long-standing task in information extraction, focusing on identifying event triggers and their semantic arguments. Early approaches were largely feature-based, relying on hand-engineered lexical, syntactic, and semantic features fed into statistical models such as maximum entropy classifiers, conditional random fields, or nearest-neighbor methods Ahn 2006 Liao and Grishman 2010 . With the advent of deep learning, neural-based models became dominant. Convolutional Neural Networks (CNNs) enabled automatic feature learning from word embeddings, replacing manual feature engineering Nguyen and Grishman 2015 . With the ability to handle long-range dependencies, recurrent architectures achieved state-of-the-art results on the ACE2005 dataset Nguyen et al. 2016 . Graph Convolutional Networks (GCNs) have also shown promise in the field by modeling syntactic structures directly from dependency trees. Unlike sequential models, GCNs exploit the syntactic proximity between triggers and arguments in a graph form, improving performance on long sentences with distant dependencies Nguyen and Grishman 2018 Liu et al. 2018 . More recently, Transformer-based solutions Vaswani et al. 2017 also emerged, with Paolini et al. 2021 introducing a framework, achieving new state-of-the-art results on joint entity and relation extraction using a generative transformer. A recent survey categorizes modern approaches into sequence-based, graph neural, knowledge-enhanced, and prompt-based methods, highlighting the dominance of pretrained language models in capturing contextual event semantics Xie et al. 2025 . 2.2 Speech Processing and ASR Automatic Speech Recognition (ASR) has witnessed remarkable progress in recent years, particularly with the introduction of transformer-based models. Whisper Radford et al. 2022 represents a significant advancement in ASR, trained on a large and diverse dataset of 680,000 hours of multilingual and multitask supervised data. This approach has demonstrated robust performance across various domains and languages, making it suitable for real-world applications. Similarly, Canary Puvvada et al. 2024 offers an alternative approach to ASR that achieves competitive performance without relying on web-scale data. These models provide high-quality transcriptions that can serve as the foundation for downstream NLP tasks, including event extraction. 2.3 Speech Event Extraction Speech Event Extraction (SpeechEE) is a relatively new research direction that aims to bridge ASR and event extraction. Wang et al. 2024 introduced a novel benchmark for SpeechEE and proposed an end-to-end model for extracting events directly from audio. Their work highlights the challenges of extracting structured information from speech without relying on intermediate textual representations. Their end-to-end system demonstrated consistently superior performance compared to the employed pipeline-based baseline. They report that previous approaches to speech-based information extraction have largely relied on pipeline methods, where ASR is followed by text-based extraction. While these methods benefit from advances in both ASR and text-based event extraction, they often suffer from error propagation, where mistakes in transcription lead to extraction failures. 2.4 Large Language Models and Few-Shot Learning Large Language Models (LLMs) have emerged as transformative tools