The time scale of redundancy between prosody and linguistic context
Tamar I. Regev, Chiebuka Ohams, Shaylee Xie, Lukas Wolf, Evelina Fedorenko, Alex Warstadt, Ethan G. Wilcox, Tiago Pimentel · 2025
Read The time scale of redundancy between prosody and linguistic context by Tamar I. Regev, Chiebuka Ohams, Shaylee Xie, Lukas Wolf, Evelina Fedorenko, Alex Warstadt, Ethan G. Wilcox, Tiago Pimentel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11630.txt.
Introduction
Tamar Regev and co-authors present a 2025 study of speech melody and word context. When people talk, meaning travels through words and through prosody, the rise and fall of the voice. Past work showed the two channels carry much of the same news. The team asked how far back and ahead that overlap reaches.
A word's prosody needed three to eight words of past context before it could be predicted well. Because long-range context fades in memory, prosody may add news that is fresh at the local level. Its overlap with future words was short, only one or two words ahead. That fits the idea that speakers plan just a little ahead. Prosody may thus help listeners guess what comes next.
Catalog record
| CREATOR | Tamar I. Regev, Chiebuka Ohams, Shaylee Xie, Lukas Wolf, Evelina Fedorenko, Alex Warstadt, Ethan G. Wilcox, Tiago Pimentel |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11630
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The time scale of redundancy between prosody and linguistic context Tamar I. Regev, Chiebuka Ohams, Shaylee Xie, Lukas Wolf, Evelina Fedorenko, Alex Warstadt, Ethan G. Wilcox, Tiago Pimentel Abstract In spoken communication, information is transmitted not only via words, but also through a rich array of non-verbal signals, including prosody—the non-segmental auditory features of speech. Do these different communication channels carry distinct information? Prior work has shown that the information carried by prosodic features is substantially redundant with that carried by the surrounding words. Here, we systematically examine the time scale of this relationship, studying how it varies with the length of past and future contexts. We find that a word’s prosodic features require an extended past context (3-8 words across different features) to be reliably predicted. Given that long-scale contextual information decays in memory, prosody may facilitate communication by adding information that is locally unique. We also find that a word’s prosodic features show some redundancy with future words, but only with a short scale of 1-2 words, consistent with reports of incremental short-term planning in language production. Thus, prosody may facilitate communication by helping listeners predict upcoming material. In tandem, our results highlight potentially distinct roles that prosody plays in facilitating integration of words into past contexts and in helping predict upcoming words. https://github.com/Chief-Buka/contextual-redundancy 1 Introduction Auditory features of speech such as pitch, loudness, and tempo—collectively termed prosody—play a crucial role in conveying meaning. Prosody influences sentence-level interpretation, encoding both linguistic and para-linguistic cues relevant to the communicative context Cole 2015 ; Wagner and Watson 2010 ; Breen et al. 2010 . For example, prosody can signal phrase boundaries, emphasize key elements, transform statements into questions, and express sarcasm, excitement, or doubt. However, much of the information conveyed by prosody is redundant with the information encoded in the words themselves Wolf et al. 2023 —that is, it is possible to predict a word’s prosodic features from its linguistic context , i.e., its surrounding words. 1 1 1 In both Wolf et al. 2023 and our study, text is used as a proxy to measure information present in the words themselves, which we refer to as ”linguistic information”(also termed “segmental information” in the phonology literature). Figure 1: Redundancy ( \mathrm{MI} ) between prosody ( \mathrm{P}_{t} ) and linguistic context ( \boldsymbol{{{\color[rgb]{0.2734,0.6289,0.2852}\boldsymbol{{{\color[rgb]{0.2734,0.6289,0.2852}\mathrm{W}}}}}}_{\overset{n,m}{\leftrightarrow}}} ) as a function of the number of words contained in the past ( n ) and/or future ( m ) context. The values are averaged across 6 prosodic features (see fig. 3 for each of these features separately). The first column is used to evaluate 1 ; the first row, 2 (see section section 1 ). Time scales are defined as the time after which the \mathrm{MI} does not increase. Past work, however, only quantified the redundancy between prosody and the entire linguistic context. The question of the dynamics of this redundancy is thus left open. Here, we investigate the time scale of redundancy between prosodic features of a given word and its linguistic context by systematically varying the length of past or future context from 0 to 9 words in each direction (0 includes only the word whose prosody is being tested). A priori , what might one expect regarding the time scale of redundancy between prosodic features and past linguistic context ? During language comprehension, context is often critical to interpreting the current word and integrating it into the linguistic representations built thus far ( Hale 2001 ; Levy 2008 ) . However, human memory is limited: contextual information decays over time, and connecting an incoming word to one far back is costly Gibson 1998 ; Lewis et al. 2006 ; Futrell et al. 2020 . Given these memory limitations, prosody may be critically helpful in conveying information that is redundant with past context but is locally unique , such that if a listener’s representation of the past context is imperfect, they would benefit from the prosodic information contained by the word itself. We therefore hypothesize that prosody carries information that is recoverable from long-term past context , but not from the short-term past (see 1 below). With respect to future linguistic context , lexical and syntactic planning in language production is known to be relatively restricted Brown-Schmidt and Konopka 2008 ; Bock et al. 1994 : we may have a general idea of what we want to say next, but the particular words and constructions are selected incrementally, often with revisions. As a result, how we pronounce a current word and what prosodic features we associate with it should not be affected by long-term future linguistic context. We therefore hypothesize that prosody carries information that is not recoverable from long-term future context (see 2 below). The above logic is laid out in terms of “short” vs. “long” contexts, but what constitutes a short or long time scale during language processing? Following recent work in neuroscience Jain and Huth 2018 ; Regev, Casto, et al. 2024 ; Shain, Kean, et al. 2024 as well as work investigating intonational units in prosody itself ( Inbar et al. 2020 ) , we set the cutoff between “short” and “long” at roughly 1-2 words, although see section Section 6.1 for more discussion. We thus formulate two main hypotheses: Hypothesis 1 . Long-scale past redundancy . The redundancy between prosody and past linguistic context unfolds across a long time scale (longer than 1-2 words). Hypothesis 2 . Short-scale future redundancy . The redundancy between prosody and future linguistic context unfolds across a short time scale (of 1-2 words). To test these hypotheses, we quantify the redundancy between prosody and linguistic context as their mutual information, which we estimate using pre-trained language models, following Wolf et al. 2023 . Notably, we extend their approach to investigate the time scale of this redundancy by jointly varying context lengths parametrically, from 0 to 9 words for both past and future contexts. 2 2 2 In addition to examining the effects of the length of the past and future contexts separately, we also considered different combinations of past and future context lengths in order to identify the most predictive combination. We then analyze how redundancy changes across time for several commonly discussed prosodic features: pitch, loudness, duration, pause, and prominence. Our main results, averaged across all prosodic features considered are shown in fig. 1 (see fig. 3 for feature-specific results). In line with our hypotheses, these results demonstrate that prosody is redundant with relatively long-term past linguistic context (up to 8 words), but is only redundant with short-term future context (up to 2 words). This finding advances our understanding of the dynamics of the redundancy between linguistic context and prosody, with potential implications for the role of prosody in natural spoken communication. 2 Prosodic Features Prosodic information is conveyed through multiple acoustic features of speech. Here, we examine the redundancy between linguistic context and: pitch, loudness, duration, pause and two versions of prominence (as detailed in section section 4.1 ). We chose these prosodic features as they have been commonly investigated in prior prosody research ( Breen et al. 2010 ; Gibson 1998 ; Cole 2015 , e.g., ) . Pitch Pitch is the perceptual dimension over which listeners order sounds on a