On the Gaussian Limit of the Output of IIR Filters

Yashaswini Murthy, Bassam Bamieh, R. Srikant · 2025

Read On the Gaussian Limit of the Output of IIR Filters by Yashaswini Murthy, Bassam Bamieh, R. Srikant (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12705.txt.

Introduction

Yashaswini Murthy, Bassam Bamieh, and R Srikant proved in two thousand twenty-five when the output of a filter looks Gaussian even if its input does not. Engineers have long used a rule of thumb that low-pass systems smooth random input toward a bell curve. Turning that hunch into proof needs care about how the input values depend on each other.

Using a distance measure for non-Gaussian shape and a classic proof method, they bound how far the scaled output sits from a normal curve. Near the edge of stability, the output does converge at a set rate under stated conditions. Counterexamples show where the claim fails, which sharpens the result.

Catalog record

CREATORYashaswini Murthy, Bassam Bamieh, R. Srikant
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-12705

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the Gaussian Limit of the Output of IIR Filters Yashaswini Murthy, Bassam Bamieh, R. Srikant Abstract We study the asymptotic distribution of the output of a stable Linear Time-Invariant (LTI) system driven by a non-Gaussian stochastic input. Motivated by longstanding heuristics in the stochastic describing function method, we rigorously characterize when the output process becomes approximately Gaussian, even when the input is not. Using the Wasserstein-1 distance as a quantitative measure of non-Gaussianity, we derive upper bounds on the distance between the appropriately scaled output and a standard normal distribution. These bounds are obtained via Stein’s method and depend explicitly on the system’s impulse response and the dependence structure of the input process. We show that when the dominant pole of the system approaches the edge of stability and the input satisfies one of the following conditions—(i) independence, (ii) positive correlation with a real and positive dominant pole, or (iii) sufficient correlation decay—the output converges to a standard normal distribution at rate O ⁡ ( 1 / t ) O(1/\sqrt{t}) . We also present counterexamples where convergence fails, thereby motivating thestated assumptions. Our results provide a rigorous foundation for the widespread observation that outputs of low-pass LTI systems tend to be approximately Gaussian. I INTRODUCTION A large class of nonlinear time-invariant systems can be modeled as shown in Figure 1 as a Linear Time-Invariant (LTI) system in feedback with a memoryless nonlinearity N(.) . The well-known describing function method [ 3 , 4 ] predicts periodic oscillation solutions based on the assumption that the LTI part has a “low-pass character”, and that higher harmonics in the output of N(.) can be neglected. Parameters of periodic (limit cycle) solutions can then be obtained from algebraic equations involving the frequency response of the LTI part together with the describing function of N(.) . A stochastic analog of this method concerns computing the 2nd-order statistics of the output process z given those of the input process d and the dynamics. The method as outlined in [ 4 , Chapter 7] can be roughly described as follows. If the LTI part ( H in Figure 1 ) has a “sufficiently low-pass character”, it has long been observed that the output processes z and v are “nearly Gaussian”. Assuming v to be Gaussian then enables computing the 2nd-order statistics of the output w of the nonlinearity N(.) . This can be done for example with Hermite polynomials when N(.) is itself a polynomial nonlinearity [ 4 , Appendix H] . In turn, given the 2nd-order statistics of d and w , e.g. the Power Spectral Densities (PSDs) (or the autocorrelation functions) of the outputs z and v can be computed from the frequency response (or impulse response) of H . This gives a set of algebraic equations for the 2nd-order statistics of w,v,z given those of d . The equations can then be solved by several techniques such as fixed-point iterations. Fig. 1: A large class of nonlinear time-invariant dynamic systems (from d to z ) can be modeled as a Linear Time-Invariant (LTI) system in feedback with a memoryless nonlinearity N(.) . The key to the stochastic version of the method is the informal observation that outputs of low-pass type LTI systems are nearly Gaussian even if the input processes are not. However, as stated in [ 4 , pg. 641] “Unfortunately, it does not seem possible to phrase this general statement in quantitative terms.” Despite the passage of time, this issue has not been quantitatively addressed in the literature to the author’s best knowledge. The question is of some importance since numerical experiments indicate that the success and convergence of the aforementioned fixed-point iterations appear to depend heavily on how close the output processes are to being Gaussian. In this paper, we address this question directly using the Wasserstein-1 distance as a quantitative measure of how far the output processes are from being Gaussian. Specifically, we consider a stable linear system of the form y_{t}=\sum_{i=1}^{t}G_{t-i}u_{i} , where the input \{u_{i}\} is a noise sequence and y_{t} is the output of the linear system. We show that, when appropriately scaled, y_{t} converges in distribution to a standard normal random variable Z with an asymptotic convergence rate of O(1/\sqrt{t}) , provided the dominant pole of the system response G approaches 1, under the following conditions: (i) The sequence \{u_{i}\} is independent; (ii) The u_{i} are positively correlated, and the system G has a dominant pole that is real and positive; (iii) The sequence \{u_{i}\} exhibits sufficient correlation decay; Conversely, we identify specific examples of input sequences \{u_{i}\} for which y_{t}/\sigma_{t}\not\!\xrightarrow{d}Z , thereby demonstrating that convergence to a standard normal distribution is not guaranteed for arbitrary inputs. The key idea is to use the standard upper bound on the Wasserstein-1 distance between the scaled output and the standard Gaussian random variable, derived via Stein’s method [ 7 , 6 , 8 ] . We then show that the upper bound can be explicitly characterized in terms of the dominant root of the system’s transfer function. Finally, by analyzing the asymptotic behavior of the resulting expression, we establish the desired convergence rate. The remainder of the paper is organized as follows. In Section II , we introduce the system model under consideration. Section III presents the main theorem statements. Selected proofs are provided in Section IV , while the remaining proofs are deferred to the Appendix. The final section concludes with a summary of results and potential directions for future work. II MODEL AND PRELIMINARIES Consider a linear time-invariant (LTI) system G with input signal \{u_{t}\}_{t\geq 1}\subset\mathbb{R} and scalar output signal \{y_{t}\}_{t\geq 1}\subset\mathbb{R} . The output y_{t} is given by the convolution of the system’s impulse response \{G_{t}\}_{t\geq 0} with the input: y_{t}=\sum_{i=1}^{t}G_{t-i}u_{i},\quad\forall t\geq 1. (1) For motivation behind such a formulation, refer to Section -A . Assume the input signal is zero-mean, i.e., \mathbb{E}[u_{i}]=0 for all i\geq 0 . Then, by linearity, \mathbb{E}[y_{t}]=0 for all t\geq 0 . Consequently, the variance of y_{t} is given by \sigma_{t}^{2}:=\text{Var}(y_{t})=\mathbb{E}\left[\left(\sum_{i=1}^{t}G_{t-i}u_{i}\right)^{2}\right]. (2) Objective: To determine conditions under which \frac{y_{t}}{\sigma_{t}}\xrightarrow{d}\mathcal{N}(0,1), (3) and, when convergence in distribution holds, to characterize the rate at which this convergence occurs. To quantify the rate of convergence to the normal distribution, we use the Wasserstein-1 distance. For random variables X and W , the Wasserstein-1 distance d_{\mathcal{W}}(X,W) is defined as d_{\mathcal{W}}(X,W):=\sup_{h\in\text{Lip}_{1}}\mathbb{E}[h(X)-h(W)], (4) where \text{Lip}_{1} denotes the set of all 1-Lipschitz functions. Notably, convergence in the Wasserstein-1 metric implies convergence in distribution. Stein [ 1 ] established that the Wasserstein-1 distance between a random variable X and the standard normal variable Z\sim\mathcal{N}(0,1) can be bounded as follows: d_{\mathcal{W}}(X,Z)\leq\sup_{f\in\mathcal{F}}\mathbb{E}[f^{\prime}(X)-Xf(X)], (5) where \mathcal{F} denotes a class of functions with uniformly bounded first and second derivatives. Let \{u_{i}\} be a sequence of random variables with a local dependence structure, meaning that each u_{i} is dependent on at most D other variables u_{j} . Such a dependence formulation arises naturally if ( 1 ) is generated by an ARMA process (see Section -A for more details.) The parameter D is referred to as the maximum dependency degree of the sequence \{u_{i}\} . Then the following proposition holds: Proposition 1 Consider the system defined in ( 1 ). Suppose the input

Read the complete text