In Silico Modeling of the RAMPHO Buffer: Dissociating Informational and Energetic Masking via Phonetic Entropy in Deep Neural Networks

Stefan Bleeck · 2026

Read In Silico Modeling of the RAMPHO Buffer: Dissociating Informational and Energetic Masking via Phonetic Entropy in Deep Neural Networks by Stefan Bleeck (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22465.txt.

Introduction

Bleeck mimics the RAMPHO episodic buffer in silico to study listening with many talkers. Current enhancement tools tune for sound alone, ignoring masking costs. Across a signal-to-noise sweep, a meaning-keeping distractor is set against the Concentration Shield, whose phase pattern is scrambled. The test splits the cognitive cost of distraction from energetic decay. Destroying its meaning frees listeners from informational masking at high signal-to-noise ratios, but harms temporal glimpsing cues at low ratios.

Catalog record

CREATORStefan Bleeck
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE13875
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22465

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

In Silico Modeling of the RAMPHO Buffer: Dissociating Informational and Energetic Masking via Phonetic Entropy in Deep Neural Networks Stefan Bleeck Abstract The fundamental challenge of listening in multi-talker environments is a cognitive bottleneck, defined by the Ease of Language Understanding (ELU) model as a failure within the RAMPHO episodic buffer. Current deep neural networks for speech enhancement optimize purely for physical acoustics, failing to account for the cognitive penalty of informational masking. Here, we present an in silico simulation of the RAMPHO buffer using the frame-by-frame phonetic entropy of a self-supervised acoustic model (wav2vec 2.0). By contrasting a semantically intact distractor with a phase-decorrelated distractor (the Concentration Shield) across a signal-to-noise ratio (SNR) sweep, we successfully dissociate the cognitive penalty of informational distraction from the physical penalty of energetic decay. The simulation reveals a cognitive-acoustic Pareto optimization problem: destroying a distractor’s semantic payload provides a release from informational masking at high SNRs, but fundamentally degrades temporal glimpsing cues at low SNRs. 1 Introduction and Theoretical Background The Cognitive Bottleneck in Speech Perception The fundamental challenge of listening in multi-talker environments—the cocktail party problem—is not merely an acoustic limitation; it is a cognitive bottleneck. Traditional audiometry and signal processing often treat the auditory system as a broken microphone, focusing exclusively on restoring peripheral audibility. However, human hearing is an integrated information processor. According to the Ease of Language Understanding (ELU) model ( Rönnberg et al. 2013 ) , speech perception under optimal conditions relies on rapid, implicit processing within the RAMPHO (Rapid Automatic Multimodal Phonological) episodic buffer. This buffer seamlessly maps incoming acoustic features to sub-lexical representations with minimal cognitive overhead. When signal degradation or semantic competition prevents this automatic binding, the implicit system fails. The listener is then forced to explicitly recruit finite, top-down working memory resources to repair the stream, resulting in measurable listening effort and rapid cognitive exhaustion ( Rönnberg et al. 2013 ; Pichora-Fuller et al. 2016 ) . Energetic vs. Informational Masking This RAMPHO failure is driven by two distinct mechanisms. Energetic Masking (EM) occurs at the auditory periphery when the physical energy of a distractor physically obliterates the target signal ( Moore 2007 ) . In contrast, Informational Masking (IM) is a central, cognitive interference. When a background noise is highly intelligible—such as a competing talker—it carries a clear linguistic payload that involuntarily hijacks the listener’s semantic processing networks ( Kidd & Conroy 2023 ) . The cognitive cost of IM often exceeds that of EM because the brain must expend explicit executive control to suppress the recognizable semantic track. Furthermore, human listeners naturally combat masking by exploiting temporal fluctuations in the background noise. Through a process of “acoustic glimpsing,” the auditory system stitches together momentary target cues that survive in the temporal dips of a fluctuating masker ( Cooke 2006 ) . If a masker is steady-state, these temporal windows slam shut, drastically increasing the energetic penalty. The Methodological Gap in Machine Hearing Despite decades of psychophysical characterization, modern engineering approaches remain deeply decoupled from these biological realities. Current objective speech metrics, such as the Speech Intelligibility Index (SII) or Perceptual Evaluation of Speech Quality (PESQ), function as idealized peripheries; they evaluate acoustic fidelity but are entirely blind to the cognitive penalty of semantic distraction. Similarly, state-of-the-art Deep Neural Networks (DNNs) utilized in modern hearing technologies achieve unprecedented Signal-to-Noise Ratio (SNR) enhancements by optimizing strictly for physical acoustics. However, these architectures process audio with near-infinite context and perfect working memory, lacking the biological constraints of the human mind. Consequently, an aggressive noise-reduction algorithm might mathematically improve the SNR of a background talker, inadvertently clarifying its linguistic payload. This effectively unmasks the competing talker, replacing a manageable energetic load with a devastating informational load. To engineer hearing technologies that genuinely protect cognitive resources rather than merely amplifying sound, we must transition from measuring missing acoustics to mapping the exact computational tipping points of the human brain. We require an in silico model of the RAMPHO buffer capable of dissociating the cognitive penalty of informational distraction from the physical penalty of energetic decay. 2 Research Question and Hypothesis Research Question Can the frame-by-frame phonetic entropy of a self-supervised acoustic model (wav2vec 2.0) function as an in silico proxy for the RAMPHO buffer to objectively quantify and dissociate the cognitive penalties of Informational Masking (IM) versus Energetic Masking (EM)? Hypothesis Phonetic entropy ( H ) will accurately track the RAMPHO implicit processing tipping point. • At high SNRs, an intelligible distractor will elicit significantly higher entropy (the IM penalty) than a phase-decorrelated distractor, reflecting semantic competition. • At low SNRs, the decorrelated distractor will elicit the highest entropy (the EM penalty) by physically smearing the temporal fine structure, preventing the acoustic glimpsing necessary for target resolution. 3 Methods 3.1 Stimuli Generation and Masker Conditions To decouple energetic and informational load, an English target narrative was mixed with three distinct maskers across a Signal-to-Noise Ratio (SNR) sweep (0, 5, 10, 15, and 20 dB, plus a 100 dB pristine baseline). Active speech levels were calibrated using ITU-T P.56 Active RMS normalization ( ITU-T 1993 ) . The three masker conditions were defined as follows: • Native Intelligible Masker (ENG): A competing male English speaker. This condition introduces both fluctuating Energetic Masking and high Informational Masking via semantic competition. • Concentration Shield (Decorrelated Masker - CS): The same English speaker, subjected to a targeted Digital Signal Processing (DSP) intervention. The speech-critical band (1–4 kHz) was isolated via Fast Fourier Transform (FFT), and the phase information was fully randomized. To prevent adversarial temporal smearing artifacts caused by hard spectral discontinuities, Hann window tapers were applied at the 1 kHz and 4 kHz crossover boundaries. This spectral surgery destroys the linguistic payload or Speech Transmission Index ( Steeneken & Houtgast 1980 ) while preserving the global RMS energy and low-frequency ( <1 kHz) spatial anchoring cues. This condition introduces zero IM but high continuous EM. • Speech-Shaped Noise (SSN): A steady-state noise matched to the long-term average speech spectrum, serving as the standard control for pure Energetic Masking without temporal amplitude modulations. 3.2 The In Silico RAMPHO Proxy To simulate the rapid, implicit phonological processing of the RAMPHO buffer, the audio mixtures were processed through a pre-trained self-supervised acoustic model ( facebook/wav2vec2-base-960h ) ( Baevski et al. 2020 ) . To access sub-lexical representations, the Connectionist Temporal Classification (CTC) linear projection head was utilized. While wav2vec 2.0 employs a bidirectional transformer that utilizes non-causal future context—fundamentally exceeding human real-time processing constraints—it serves here as an idealized upper-bound proxy for implicit feature extraction before strict chronological constraints are engineered into future architectures. Audio was resampled to 16 kHz and normalized. For every 20 ms frame, the network executed a forward pass to extract the raw logits, followed by a Softmax activation to generate a probability distribution across the English vocabulary. 3.3 Metric Computation: Phonetic Entropy Implicit cognitive load was mathematically defined as the ambiguity of the phonetic categorization at any given frame. This was quantified by calculating the Shannon Entropy ( H ) of the Softmax probability distributions. To ensure that a low entropy state genuinely reflects phonological binding rather than acoustic silence, the CTC “blank” token was explicitly excluded. The

Read the complete text