Analysis of the Maximum Prediction Gain of Short-Term Prediction on Sustained Speech
Reemt Hinrichs, Muhamad Fadli Damara, Stephan Preihs, Jörn Ostermann · 2026
Read Analysis of the Maximum Prediction Gain of Short-Term Prediction on Sustained Speech by Reemt Hinrichs, Muhamad Fadli Damara, Stephan Preihs, Jörn Ostermann (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-09461.txt.
Introduction
Reemt Hinrichs and three co-authors measure the ceiling on short-term prediction of sustained speech. Their 2026 arXiv paper centers on prediction gain, a classic score in signal coding. Predictive coding stores or sends speech by guessing the next sample and keeping only the error.
A better guess means a lower bit rate for the same quality. Prediction gain links the mean-squared prediction error to the signal-to-quantization-noise ratio of a coder. The authors analyze how much gain is even possible on sustained speech sounds. Knowing the ceiling tells codec designers when better predictors stop paying off.
Catalog record
| CREATOR | Reemt Hinrichs, Muhamad Fadli Damara, Stephan Preihs, Jörn Ostermann |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-09461
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Analysis of the Maximum Prediction Gain of Short-Term Prediction on Sustained Speech Reemt Hinrichs, Muhamad Fadli Damara, Stephan Preihs, Jörn Ostermann Abstract Signal prediction is widely used in, e.g., economic forecasting, echo cancellation and in data compression, particularly in predictive coding of speech and music. Predictive coding algorithms reduce the bit-rate required for data transmission or storage by signal prediction. The prediction gain is a classic measure in applied signal coding of the quality of a predictor, as it links the mean-squared prediction error to the signal-to-quantization-noise of predictive coders. To evaluate predictor models, knowledge about the maximum achievable prediction gain independent of a predictor model is desirable. In this manuscript, Nadaraya-Watson kernel-regression (NWKR) and an information theoretic upper bound are applied to analyze the upper bound of the prediction gain on a newly recorded dataset of sustained speech/phonemes. It was found that for unvoiced speech a linear predictor always achieves the maximum prediction gain within at most 0.3 dB. On voiced speech, the optimum one-tap predictor was found to be linear but starting with two taps, the maximum achievable prediction gain was found to be about 2 dB to 6 dB above the prediction gain of the linear predictor. Significant differences between speakers/subjects were observed. The created dataset as well as the code can be obtained for research purpose upon request. keywords prediction gain, mutual information, conditional expectation, speech coding, kernel regression, speech prediction 1 Introduction Signal prediction is widely used in, e.g., economic forecasting, echo cancellation, and data compression, particularly in predictive coding of speech and music Elliott and Timmermann 2008 ; Ivry et al. 2021 ; Bäckström 2017 . Predictive coding algorithms reduce the bit-rate required for data transmission or storage by signal prediction. In predictive coding, a source signal is compressed by prediction and subsequent quantization of the prediction residual. As coding performance is strongly affected by the prediction error respectively the prediction error variance Chu 2004 , extensive research in earlier decades focused on better predictor models aiming to improve simple linear predictors by considering non-linear models like volterra filters or neural networks Thyssen et al. 1994 ; Birgmeier 1996 ; Despotović et al. 2012 ; Zhao et al. 2018 . A thorough review on predictive coding can be found in Sheferaw et al. 2023 . 1.1 The Prediction Problem Prediction of a signal 1 1 1 Depending on context, y(n) is either the entire signal or the signal at time n . y(n) is the application of a function f , commonly referred to as a predictor, that uses past signal samples \mathbf{y}(n):=(y(n),y(n-1),\dots,y(n-(P-1))) to estimate future signal samples y(n+L) with \mathbb{N}\ni L\geq 1 . L denotes the number of time or sample steps to be predicted ahead, and P , the so called "tap size", is the number of considered previous samples. Prediction with L=1 is referred to as one-step prediction, sometimes called short-term prediction. The main goal in signal prediction is to find a predictor that minimizes some distance measure, most commonly the mean-squared (prediction) error E((y(n+L)-f(\mathbf{y}(n)))^{2}) , which is also the prediction error variance. The error minimizing predictor is also called the optimal predictor (with respect to the chosen distance measure). The prediction problem, in the case of the mean-squared error, can thus be formalized as \underset{f\in\mathcal{F}}{inf}E((y(n+L)-f(\mathbf{y}(n))^{2}) (1) with some function space \mathcal{F} . Generally, the optimal predictor f_{opt} with respect to the mean-squared error is the conditional expectation f_{opt}(\mathbf{y}(n))\equiv E[y(n+L)|\mathbf{y}(n)] Box et al. 2015 . However, in practice this function or its corresponding mean-squared error is difficult to obtain. Linear prediction is an approximate approach to the optimal prediction problem aiming to find the optimal predictor f within the class of linear functions (compared to the very general space of, e.g., continuous functions). The optimal solution can be found using the Wiener-Hopf equation Subba Rao and Yang 2023 . Nonlinear prediction usually attempts to improve on linear prediction by considering a broader search space of functions, e.g., the space of polynomials of some maximum degree as in Volterra filters Despotović et al. 2012 . Knowledge of the minimum achievable prediction error variance for a given type of signal is generally desirable. If a predictor achieves such a minimum, no further improvement of the predictor is possible, and future developments could focus on other parts of, e.g., a coding algorithm, for example the quantization and entropy coding stage. 1.2 Background While current state-of-the-art audio codecs are mostly based on neural networks, which do not perform explicit predictions but usually learn a data representation to compress audio signals on a window-by-window basis at very low bit-rates Zeghidour et al. 2021 ; Défossez et al. 2023 , their algorithmic latency typically exceeds 10 ms. Predictive coders can achieve algorithmic latencies considerably lower than 10 ms – using backward adaptive prediction, an algorithmic latency of zero can be achieved Gayer et al. 2004 . Such low latencies can be desirable for hearing aid applications Hinrichs et al. 2019 ; Hinrichs et al. 2021 as well as certain live music applications Preihs et al. 2015 . Additionally, a branch of neural audio codecs merges traditional linear predictive coding (LPC) methods with neural networks Valin and Skoglund 2019 ; Subramani et al. 2022 , where LPC is used to compute predictions that are further processed by recurrent networks. Such approaches could potentially benefit from improved predictor models. As such, investigations on prediction algorithms can still be of interest. For linear prediction, a lower bound of the mean-squared (prediction) error (MSE) can be derived using the power spectral density of a signal Szegö and Grenander 1958 . By comparing the spectral flatness of a given signal with that of a white noise signal, the maximum achievable prediction gain can be calculated. The prediction gain is the logarithmic ratio of signal variance and prediction error variance to be defined in later parts of the manuscript. Using the finite past of a signal, nonlinear predictors can often achieve substantially lower MSE than linear predictors, and Kanter Kanter 1979 and Shepp et al. Shepp et al. 1980 derived a formula for the maximum possible improvement of a nonlinear predictor over a linear one for stationary moving average processes. To the best knowledge of the authors, specifically for speech signals, the only publications that are at least partially concerned with estimating the maximum achievable prediction gain (see Eq. 2 ) of speech are Birgmeier et al. 1997 ; Bernhard 1998 and Bernhard 1997 . Most importantly for this work, Bernhard Bernhard 1998 derived an upper bound for the prediction gain of a linear or non-linear predictor based be obtained through the automutual information function. In order to estimate this upper bound according to Bernhard 1998 , a signal has to be strict-sense stationary 2 2 2 A strict-sense stationary signal or process has time-invariant distributions, whereas a wide-sense stationary process only requires a time-invariant autocorrelation (or covariance) function (as well as constant mean and finite variance) Park 2018 . Although a speech signal is usually considered stationary across periods of around 30\,\text{ms} Paliwal et al. 2010 , the obtainable sample size during such a time frame is insufficient to apply the upper bound formula given in Bernhard 1998 because of the estimations