SPACER : A Parallel Dataset of S peech P roduction A nd C omprehension of E rror R epairs

Shiva Upadhye* Jiaxuan Li* Richard Futrell · 2025

Read SPACER : A Parallel Dataset of S peech P roduction A nd C omprehension of E rror R epairs by Shiva Upadhye* Jiaxuan Li* Richard Futrell (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16745.txt.

Introduction

Shiva Upadhye, Jiaxuan Li, and Richard Futrell build a dataset that catches people in the act of fixing their own speech mistakes, and others fixing them too, in a 2025 paper. Speech errors are constant, yet conversations rarely collapse, because speakers and listeners both monitor and repair. Research usually studied the two repair systems separately for lack of matched data. SPACER pairs them: the same errors, the speaker's self-correction, and listeners' corrections.

The errors are single-word substitutions mined from a large telephone conversation corpus. Listeners' repairs came from an editing experiment. Early analysis found an asymmetry: speakers repair errors that stray far in sound or meaning, while listeners fix errors that sound close to a better-fitting word or clash with context. The dataset opens the door to one science of error repair instead of two.

Catalog record

CREATORShiva Upadhye* Jiaxuan Li* Richard Futrell
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-16745

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SPACER : A Parallel Dataset of S peech P roduction A nd C omprehension of E rror R epairs Shiva Upadhye* Jiaxuan Li* Richard Futrell Abstract Speech errors are a natural part of communication, yet they rarely lead to complete communicative failure because both speakers and comprehenders can detect and correct errors. Although prior research has examined error monitoring and correction in production and comprehension separately, integrated investigation of both systems has been impeded by the scarcity of parallel data. In this study, we present SPACER , a parallel dataset that captures how naturalistic speech errors are corrected by both speakers and comprehenders. We focus on single-word substitution errors extracted from the Switchboard corpus, accompanied by speaker’s self-repairs and comprehenders’ responses from an offline text-editing experiment. Our exploratory analysis suggests asymmetries in error correction strategies: speakers are more likely to repair errors that introduce greater semantic and phonemic deviations, whereas comprehenders tend to correct errors that are phonemically similar to more plausible alternatives or do not fit into prior contexts. Our dataset 1 1 1 The dataset and code are available at: https://github.com/goldengua/SPACER-CMCL enables future research on integrated approaches toward studying language production and comprehension. 1 Introduction Production errors are common in naturalistic speech; however, they rarely lead to a complete breakdown in communication, as interlocutors are able to monitor, detect, and repair errors in real-time. For this reason, characterizing the process of error correction has remained a shared goal of both language comprehension and production research. Comprehenders process errors by integrating perceived linguistic input with prior context and expectations, and might arrive at an interpretation different from the literal meaning of the linguistic input ( Ferreira et al. 2002 ; Ferreira and Stacey 2000 ; Dempsey et al. 2023 ; Bader and Meng 2018 ; Levy et al. 2009 ; Gibson et al. 2013 ) . One possible mechanism is that they perform rational inference over the perceived errors ( Levy et al. 2009 ; Levy 2008 ; Gibson et al. 2013 ; Futrell et al. 2020 ; Ryskin et al. 2018 ; Poppels and Levy 2016 ; Zhang et al. 2023 ) . When the perceived form is incongruent with prior context or similar to a more plausible alternative, comprehenders might override the literal input and reconstruct an alternative interpretation. In language production research, speech errors have played a crucial role in shaping our understanding of the cognitive machinery of production, including the role of online control ( Fromkin and Fromkin 1973 ; Levelt 1983 ; Dell 1986 ) . Numerous studies analyzing the temporal and distributional properties of speech errors have found evidence of a two-stage monitoring and correction process, which operates first on internal representations and then on the articulated linguistic signal ( Levelt 1983 ; Blackmer and Mitton 1991 ; Hartsuiker and Kolk 2001 ; Nooteboom and Quené 2017 ) . Although the mechanism of monitoring has remained a point of contention in the literature ( Levelt 1999 ; Nozari et al. 2011 ; Hickok et al. 2011 ; Roelofs 2020 ; Gauvin and Hartsuiker 2020 ) , accounts of repair processing have posited sustained competition between activated representations and selection control as potential mechanisms of correction ( Hartsuiker and Kolk 2001 ; Nozari et al. 2016 ; Nooteboom and Quené 2019 ; Gauvin and Hartsuiker 2020 ) . Much of our understanding of speakers and comprehenders’ error correction strategies comes from research traditions that have made limited contact with each other. In particular, existing datasets or experimental paradigms focus solely on corrective behavior in the absence of an interlocutor. However, in a communicative context, speaker choices may exhibit a balance between ease of production and communicative efficiency ( Ferreira and Dell 2000 ; Jaeger and Levy 2006 ; Jaeger 2010 ; Koranda et al. 2018 ; Goldberg and Ferreira 2022 ; Futrell 2023 ) . For example, speakers may preemptively hyperarticulate words to improve comprehensibility ( Aylett and Turk 2004 ; Arnold et al. 2012 ; Meinhardt et al. 2020 ) or modulate the acoustic characteristics of their speech in response to listener feedback ( Pate and Goldwater 2015 ; Buz et al. 2016 ) . Comprehension can be talker-specific as well: comprehenders can tailor their expectations to the speaker ( Ryskin et al. 2020 ) and adapt their error correction strategies accordingly Futrell and Gibson 2017 ; Brehm et al. 2019 . In this study, we present a parallel dataset of Speech Production and Comprehension Error Repairs ( SPACER ) that captures how naturalistic speech errors are corrected by speakers and comprehenders. First, we compiled a corpus of naturalistic utterances with single-word substitution errors and repairs, as well as utterances that are not corrected by speakers. These utterances were then presented to comprehenders in a web-based text editing experiment, where each case is annotated by four to six comprehenders. Our dataset contains 1056 instances of naturalistic speaker’s utterances as well 5808 comprehenders’ responses to speaker’s initial utterances. We also provide an exploratory analysis on how well comprehender’s error correction behavior can be predicted by lexical properties of speaker’s error and repairs, and vice versa. Our results suggest that asymmetries between error correction behaviors by comprehenders and speakers might be related to interaction between the two modes. The dataset offers resources to build experimental and computational work that bridges comprehension and production and informs how interaction affects strategic cue weighting in error monitoring. Figure 1: An illustration of the dataset design. Suppose a speaker produces an initial utterance. Both the speaker and the comprehender may engage in error monitoring and correction processes, resulting in speaker final production and comprehender final response being either the same as the initial utterance (represented in gray bubbles) or different from it (represented in green bubbles). Each utterance is annotated by four to six comprehenders. 2 Dataset We focus on how comprehenders engage with utterances that may or may not have been corrected by a speaker in their original context. Figure 1 illustrates the design of the dataset. We assume that both the speaker and the comprehender can perform error correction, and we remain agnostic to the mechanism that accomplishes this process. Suppose a speaker produces an initial utterance ( … people don’t want the heat of the northeast ), which may contain an error, or non-optimal choice of words. The speaker can monitor the initial utterance and may correct heat into cold . After receiving the initial utterance, comprehenders engage in an interpretation process, where the final response might not be the same as the literal meaning of the initial utterance. The development of this dataset involved a two-step process. First, we identified and extracted utterances with and without word substitutions and overt repairs from the Switchboard corpus ( Godfrey et al. 1992 ) of spontaneous speech. Subsequently, these utterances were presented as stimuli to participants in a web-based correction experiment. Hence, for each utterance, this dataset provides a speaker’s final production along with a group of comprehenders’ annotations. The two stages of this process are detailed below. 2.1 Corpus of Naturally-Occurring Utterances We identify and extract stimuli for the correction experiment from Switchboard NXT annotations ( Calhoun et al. 2010 ) , a subset of the Switchboard

Read the complete text