On Minimax Estimation Problems for Periodically Correlated Stochastic Processes
2025
Read On Minimax Estimation Problems for Periodically Correlated Stochastic Processes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16906.txt.
Introduction
Iryna Dubovets'ka and Mykhailo Moklyachuk survey estimation for repeating random patterns in a 2025 paper. The patterns are periodically correlated processes, signals whose statistics repeat in cycles. The goal is estimating weighted sums of their unknown values. Observations mix the signal itself with added noise.
The survey covers two settings for the signal's spectrum. A spectrum describes how energy spreads across frequencies. Under spectral certainty, the spectrum is known exactly. Formulas then give the best linear estimate and its error. Under spectral uncertainty, only allowed sets of spectra are known. The authors present worst-case spectra and robust estimates for that case. Together the results organize a scattered literature on cyclic-signal estimation.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16906
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On Minimax Estimation Problems for Periodically Correlated Stochastic Processes Abstract Columbia International Publishing Contemporary Mathematics and Statistics (2015) Vol. 2 No. 1 pp. 1-24 doi:10.7726/cms.2014.1001 Iryna Dubovets’ka , Mykhailo Moklyachuk ∗ , Department of Probability Theory, Statistics and Actuarial Mathematics, Taras Shevchenko National University of Kyiv, Kyiv 01601, Ukraine ∗ Corresponding Author: [email protected] Abstract. The aim of this article is to overview the problem of mean square optimal estimation of linear functionals which depend on unknown values of periodically correlated stochastic process. Estimates are based on observations of this process and noise. These problems are investigated under conditions of spectral certainty and spectral uncertainty. Formulas for calculating the main characteristics (spectral characteristic, mean square error) of the optimal linear estimates of the functionals are proposed. The least favorable spectral densities and the minimax-robust spectral characteristics of optimal estimates of the functionals are presented for given sets of admissible spectral densities. Keywords: Keywords: Periodically Correlated Process; Spectral Characteristic; Mean Square Error; Minimax Estimate; Minimax-Robust Spectral Characteristic Mathematics Subject Classification: Primary: 60G10, 60G25, 60G35, Secondary: 62M20, 93E10, 93E11 1 Introduction Periodically correlated processes are those signals whose statistics vary almost periodically, and they are present in numerous physical and man-made processes. A comprehensive listing most of the existing references up to the year 2005 on periodically correlated processes and their applications was proposed by Serpedin et al. (2005). See also a review by Antoni (2009). For more details see survey paper by Gardner (1994) and book by Hurd and Miamee (2007). Note, that most of authors investigate properties of periodically correlated sequences while only few publications deal with investigation of periodically correlated processes. Note also, that in the literature periodically correlated processes are named in multiple different ways such as cyclostationary, periodically nonstationary or cyclic correlated processes. Periodically correlated processes can be defined as stochastic processes with a periodic structure. In papers by Gladyshev (1961, 1963) investigation of periodically correlated processes was started. Analysis of properties of correlation function and representations of periodically correlated processes were presented. Relations between periodically correlated processes and stationary processes were investigated by Makagon (1999a, 2001). Relations of periodically correlated sequences with simpler stochastic sequences are proposed by Makagon (1999b, 2011), Makagon and Miamee (2013), Hurd and Miamee (2007). Methods of solution of problems of estimation of unknown values of stationary stochastic processes (extrapolation, interpolation and filtering problems) were developed by Wiener (1966), Yaglom (1987), Kolmogorov (1992). Estimation problems for stationary vector sequences were investigated by Rozanov (1967). The proposed methods are based on the assumption that spectral densities of processes are exactly known. In practice, however, it is impossible to have complete information on the spectral density in most cases. To solve the problem one finds parametric or nonparametric estimates of the unknown spectral density or selects a density by other reasoning. Then the classical estimation method is applied provided that the estimated or selected density is the true one. This procedure can result in significant increasing of the value of error as Vastola and Poor (1983) have demonstrated with the help of some examples. This is a reason to search estimates which are optimal for all densities from a certain class of admissible spectral densities. These estimates are called minimax since they minimize the maximal value of the error. A survey of results in minimax (robust) methods of data processing can be found in the paper by Kassam and Poor (1985). The paper by Ulf Grenander (1957) should be marked as the first one where the minimax extrapolation problem for stationary processes was formulated and solved. Franke and Poor (1984), Franke (1984, 1985) investigated the minimax extrapolation and filtering problems for stationary sequences with the help of convex optimization methods. This approach makes it possible to find equations that determine the least favorable spectral densities for various classes of admissible densities. For more details see, for example, books by Moklyachuk (2008), Moklyachuk and Masyutka (2012). In papers by Moklyachuk (1994-2008) the minimax approach was applied to extrapolation, interpolation and filtering problems for functionals which depend on the unknown values of stationary processes and sequences. Methods of solution the minimax-robust estimation problems for vector-valued stationary sequences and processes were developed by Moklyachuk and Masyutka (2006-2011). Luz and Moklyachuk (2012-2013) investigated the minimax estimation problems for linear functionals which depends on unknown values of stochastic sequence with stationary th increments. Minimax estimation problems for linear functionals which depend on the unknown values of periodically correlated sequences and processes were studied in works by Dubovetska, Masyutka, Moklyachuk (2011 -2013). These problems are natural generalization of the extrapolation, interpolation and filtering problems for functionals which depend on the unknown values of stationary processes and sequences. In this article we consider the problem of optimal linear estimation of functionals A_{N}^{i}\zeta=\int_{0}^{(N+1)T}{a}(t)\zeta(t)dt,\quad{{A}^{e}}\zeta=\int_{0}^{\infty}{a(t)\zeta(t)\,dt},\quad A^{f}\zeta=\int_{0}^{\infty}{a}(t)\zeta(-t)dt which depend on the unknown values of a periodically correlated process \zeta(t) based on observations of the process \zeta(t)+\theta(t) at points of time t\in\mathbb{R}\backslash[0,(N+1)T] (for estimation A_{N}^{i}\zeta ), at points of time t<0 (for estimation {{A}^{e}}\zeta ), at points of time t\leq 0 (for estimation {{A}^{f}}\zeta ). Here \theta(t) is an uncorrelated with \zeta(t) periodically correlated stochastic process. We propose a transition procedure from continuous periodically correlated stochastic processes \{\zeta(t),\,t\in\mathbb{R}\} and \{\theta(t),\,t\in\mathbb{R}\} to the corresponding infinite dimensional vector-valued stationary sequences \{{{\zeta}_{j}},j\in\mathbb{Z}\} and \{{{\theta}_{j}},j\in\mathbb{Z}\} which allows us to reduce the estimation problems for continuous periodically correlated stochastic processes to the corresponding problems for stationary vector-valued sequences. . Formulas for calculating the mean square errors and spectral characteristics of the optimal linear estimates of the corresponding functionals are proposed in the case of spectral certainty where spectral densities of generated stationary sequences \{{{\zeta}_{j}},j\in\mathbb{Z}\} and \{{{\theta}_{j}},j\in\mathbb{Z}\} are exactly known. The least favorable spectral densities and the minimax-robust spectral characteristics of the optimal linear estimates are found in the case of spectral uncertainty where spectral densities are not exactly known, but concrete classes of admissible densities are given. It is shown, for example, that one-sided moving average sequence gives the greatest value of the mean square error of the optimal estimate of the functional {{A}^{e}}\zeta . 2 Periodically correlated continuous processes and generated vector-valued stationary sequences Definition 2.1 (Gladyshev, 1963) Mean square continuous stochastic process \zeta:\mathbb{R}\to H={{L}_{2}}(\Omega,F,P) , E\zeta(t)=0 , is called periodically correlated (PC) with period T , if its correlation function K(t,s)=E\zeta(t)\overline{\zeta(s)} for all t,s\in\mathbb{R} and some fixed T>0 is such that K(t,s)=K(t+T,s+T). Let \{\zeta(t),\,t\in\mathbb{R}\} and \{\theta(t),\,t\in\mathbb{R}\} be uncorrelated PC stochastic processes with period T . We construct the following sequences of stochastic functions \left\{{{\zeta}_{j}}(u)=\zeta(u+jT),\,u\in[0,T),\,j\in\mathbb{Z}\right\}, (1) \left\{{{\theta}_{j}}(u)=\theta(u+jT),\,u\in[0,T),\,j\in\mathbb{Z}\right\}. (2) Sequences (1) and (2) form {{L}_{2}}([0,T);H) -valued stationary sequences \{{{\zeta}_{j}},\,j\in\mathbb{Z}\} and \{{{\theta}_{j}},\,j\in\mathbb{Z}\} , respectively, with the correlation functions {{B}_{\zeta}}(l,j)={{\left\langle{{\zeta}_{l}},{{\zeta}_{j}}\right\rangle}_{H}}=\int_{o}^{T}{E\,\zeta(u+lT)}\overline{\zeta(u+jT)}\,du=\int_{o}^{T}{{{K}_{\zeta}}(u+(l-j)T,u)}\,du={{B}_{\zeta}}(l-j), {{B}_{\theta}}(l,j)={{\left\langle{{\theta}_{l}},{{\theta}_{j}}\right\rangle}_{H}}=\int_{o}^{T}{E\,\theta(u+lT)}\overline{\theta(u+jT)}\,du=\int_{o}^{T}{{{K}_{\theta}}(u+(l-j)T,u)}\,du={{B}_{\theta}}(l-j), where {{K}_{\zeta}}(t,s)=E\zeta(t)\overline{\zeta(s)}, {{K}_{\theta}}(t,s)=E\theta(t)\overline{\theta(s)} are correlation functions of PC processes \zeta(t) and \theta(t) . Consider in the space {{L}_{2}}([0,T);\mathbb{R}) the following orthonormal basis \{{{\tilde{e}}_{k}}=\frac{1}{\sqrt{T}}{{e}^{2\pi i\{{{(1)}^{-k}}\left[{}^{k}/{}_{2}\right]\}u/T}},\,k=1,2,...\},\left\langle{{{\tilde{e}}}_{k}},{{{\tilde{e}}}_{j}}\right\rangle={{\delta}_{jk}}, Making use properties of this basis, stationary sequences \{{{\zeta}_{j}},\,j\in\mathbb{Z}\} and \{{{\theta}_{j}},\,j\in\mathbb{Z}\} can be represented in the forms {{\zeta}_{j}}=\sum\nolimits_{k=1}^{\infty}{{{\zeta}_{kj}}{{{\tilde{e}}}_{k}}},\quad{{\zeta}_{kj}}=\left\langle{{\zeta}_{j}},{{{\tilde{e}}}_{k}}\right\rangle=\frac{1}{\sqrt{T}}\int_{0}^{T}{{{\zeta}_{j}}(v){{e}^{-2\pi i\{{{(1)}^{-k}}\left[{}^{k}/{}_{2}\right]\}u/T}}}\,dv, (3) {{\theta}_{j}}=\sum\nolimits_{k=1}^{\infty}{{{\theta}_{kj}}{{{\tilde{e}}}_{k}}},\quad{{\theta}_{kj}}=\left\langle{{\theta}_{j}},{{{\tilde{e}}}_{k}}\right\rangle=\frac{1}{\sqrt{T}}\int_{0}^{T}{{{\theta}_{j}}(v){{e}^{-2\pi i\{{{(1)}^{-k}}\left[{}^{k}/{}_{2}\right]\}u/T}}}\,dv. (4) We call these sequences \{{{\zeta}_{j}},\,j\in\mathbb{Z}\} , \{{{\theta}_{j}},\,j\in\mathbb{Z}\} and corresponding to them vector-valued sequences \{{{\vec{\zeta}}_{j}}={{({{\zeta}_{kj}},\,k=1,2,...)}^{\top}},j\in\mathbb{Z}\} , \{{{\vec{\theta}}_{j}}={{({{\theta}_{kj}},\,k=1,2,...)}^{\top}},j\in\mathbb{Z}\}, generated (by \{\zeta(t),\,t\in\mathbb{R}\} , \{\theta(t),\,t\in\mathbb{R}\} , respectively) vector-valued stationary sequences. Components \{{{\zeta}_{kj}},\,k=1,2,...\} and \{{{\theta}_{kj}},\,k=1,2,...\} of generated stationary sequences \{{{\zeta}_{j}},\,j\in\mathbb{Z}\} and \{{{\theta}_{j}},\,j\in\mathbb{Z}\} are such that (Kallianpur and Mandrekar, 1971; Moklyachuk, 1981) E{{\zeta}_{kj}}=0,\quad||{{\zeta}_{j}}||_{H}^{2}=\sum\nolimits_{k=1}^{\infty}{E|{{\zeta}_{kj}}{{|}^{2}}}={{P}_{\zeta}}<\infty,\quad E{{\zeta}_{kl}}\overline{{{\zeta}_{nj}}}=\left\langle{{R}_{\zeta}}(l-j){{e}_{k}},{{e}_{n}}\right\rangle, E{{\theta}_{kj}}=0,\quad||{{\theta}_{j}}||_{H}^{2}=\sum\nolimits_{k=1}^{\infty}{E|{{\theta}_{kj}}{{|}^{2}}}={{P}_{\theta}}<\infty,\quad E{{\theta}_{kl}}\overline{{{\theta}_{nj}}}=\left\langle{{R}_{\theta}}(l-j){{e}_{k}},{{e}_{n}}\right\rangle, where \{{{e}_{k}},\,\,k=1,2,...\} is a basis of