Analysis and conditional optimization of projection estimates for the distribution of random variable using Legendre polynomials
T. A. Averina, K. A. Rybakov · 2025
Read Analysis and conditional optimization of projection estimates for the distribution of random variable using Legendre polynomials by T. A. Averina, K. A. Rybakov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-14822.txt.
Introduction
Tatyana Averina and Konstantin Rybakov build better estimates of a random variable spread using Legendre polynomials. Their 2025 paper gives joint methods to estimate both the density curve and the cumulative curve of a distribution. Such estimates feed many applied statistics tasks.
For the new methods, the authors solve a tuned optimization problem. The tuning lifts accuracy while holding computing cost to a minimum. Tests use example densities with varied smoothness, from jagged to silky. The polynomial density estimate is also set against the histogram, the classic tool for such jobs. The comparison shows where the smooth estimate wins in practice. The paper offers the tuned method as an efficient option for distribution work.
Catalog record
| CREATOR | T. A. Averina, K. A. Rybakov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-14822
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Analysis and conditional optimization of projection estimates for the distribution of random variable using Legendre polynomials T. A. Averina, K. A. Rybakov Abstract Abstract. Algorithms for jointly obtaining projection estimates of the density and distribution function of a random variable using the Legendre polynomials are proposed. For these algorithms, a problem of the conditional optimization is solved. Such an optimization allows one increasing the approximation accuracy with a minimum computational costs. The proposed algorithms are tested on examples with different degree of smoothness of the density. Keywords: Monte Carlo method, projection estimate, density, distribution function, Legendre polynomials, conditional optimization MSC: 62E20, 65C05, 65D15 0 0 footnotetext: This research was carried out within the framework of the state assignment to the Institute of Computational Mathematics and Mathematical Geophysics, Siberian Branch, Russian Academy of Sciences (project FWNM-2025-0002). 0 0 footnotetext: Email: [email protected] 1. Introduction Statistical projection estimates in the Monte Carlo method was first proposed by N.N. Chentsov [ 1 ] . He developed a general technique for optimizing such estimates, which, however, requires a clarification in specific problems [ 2 ] . In the paper [ 3 ] , projection estimates based on the Legendre polynomials for marginal probability densities of the solution to a stochastic differential equation were proposed. The mean square error of estimates was investigated, and a comparison of both the obtained projection estimates and the histogram was carried out on examples. Analysis of the results showed that, on the same sample size, the projection estimate more accurately approximates the density. In addition, such an estimate is specified analytically, and it is a smooth function. So, it is preferable, e.g., in filtering problems and in the control of nonlinear systems [ 4 , 5 , 6 , 7 ] . This paper presents two statistical algorithms, based on algorithms using the Legendre polynomials from [ 3 ] , for jointly obtaining projection estimates of the density and distribution function of a random variable. Solving different problems by statistical estimation algorithms, it is important to make an optimal (consistent) choice of parameters for these algorithms when finding the mathematical expectation of a certain functional depending on a random variable. Therefore, this paper analyzes the mean square error of the projection estimate from the point of view of the optimal choice of parameters. Such parameters are the projection expansion length and sample size. We solve a conditional optimization problem considered by G.A. Mikhailov [ 8 ] . The objective of this problem is to minimize the algorithm complexity while achieving the required level of approximation accuracy. The possibility of minimizing the mean square error of projection estimates of the density and distribution function is explored by balancing its deterministic and stochastic components. The accuracy of projection estimates also depends on the degree of smoothness of the density; therefore, in this paper, we consider the dependence of error not only on the projection expansion length, but also on the degree of smoothness of the approximated function. The obtained theoretical results are confirmed on examples using a two-parameter family of densities that allow one both a choice of the degree of smoothness and a simple calculation of expansion coefficients with respect to the Legendre polynomials. The rest of this paper has the following structure. Section 2 contains the necessary information on Fourier–Legendre series and definition of projection estimates of the density and distribution function; in this section, relations for expansion coefficients of the density and distribution function with respect to Legendre polynomials are obtained. Section 3 presents algorithms for jointly obtaining randomized projection estimates of the density and distribution function. The analysis and conditional optimization of randomized projection estimates are carried out in Section 4 . Section 5 proposes a two-parameter family of densities with different degrees of smoothness and related distribution functions; it presents an algorithm for modeling the corresponding random variables, obtains expansion coefficients of the considered densities and distribution functions, and studies the convergence rate of their expansions. Numerical experiments and their analysis are discussed in Section 6 . Brief conclusions on the paper are given in Section 7 . 2. Using Legendre Polynomials for Randomized Projection Estimates 2.1. Fourier–Legendre series The standardized Legendre polynomials \{P_{i}\}_{i=0}^{\infty} are defined on the set \Omega=[-1,1] as follows [ 9 ] : P_{i}(x)=\frac{1}{2^{i}i!}\,\frac{d^{i}(x^{2}-1)^{i}}{dx^{i}},\ \ \ i=0,1,2,\dots They form a complete orthogonal system of functions in the space L_{2}(\Omega) and satisfy well-known recurrence relations: \displaystyle(i+1)P_{i+1}(x)=(2i+1)xP_{i}(x)-iP_{i-1}(x),\ \ \ i=1,2,\dots, (1) \displaystyle(2i+1)P_{i}(x)=P^{\prime}_{i+1}(x)-P^{\prime}_{i-1}(x),\ \ \ i=1,2,\dots, (2) where P_{0}(x)=1 and P_{1}(x)=x . These relations can be formally applied for i=0 when P_{-1}(x)=0 . Recall [ 10 ] that L_{2}(\Omega)=\biggl\{u\colon\int_{\Omega}|u(x)|^{2}dx<\infty\biggr\}. The explicit formula for the standardized Legendre polynomials is P_{i}(x)=\frac{1}{2^{i}}\sum\limits_{k=0}^{\lfloor i/2\rfloor}\frac{(-1)^{k}(2i-2k)!}{k!(i-k)!(i-2k)!}\,x^{i-2k},\ \ \ i=0,1,2,\dots, (3) where \lfloor\,\cdot\,\rfloor is the floor function. The explicit formulae can be specified separately for even indices ( i=2j ): P_{2j}(x)=\frac{1}{2^{2j}}\sum\limits_{k=0}^{j}\frac{(-1)^{k}(4j-2k)!}{k!(2j-k)!(2j-2k)!}\,x^{2j-2k}, (4) and for odd indices ( i=2j+1 ): P_{2j+1}(x)=\frac{1}{2^{2j+1}}\sum\limits_{k=0}^{j}\frac{(-1)^{k}(4j-2k+2)!}{k!(2j-k+1)!(2j-2k+1)!}\,x^{2j-2k+1}. (5) Using the normalization, we obtain the Legendre polynomials \{\hat{P}_{i}\}_{i=0}^{\infty} , which form a complete orthonormal system of functions in L_{2}(\Omega) : \hat{P}_{i}(x)=\sqrt{\frac{2i+1}{2}}\,P_{i}(x),\ \ \ i=0,1,2,\dots (6) The expansion of an arbitrary function u\in L_{2}(\Omega) into the Fourier–Legendre series has the form u(x)=\sum\limits_{i=0}^{\infty}U_{i}\hat{P}_{i}(x), (7) where coefficients U_{i} are defined as inner products: U_{i}=(u,\hat{P}_{i})_{L_{2}(\Omega)}=\int_{\Omega}u(x)\hat{P}_{i}(x)dx,\ \ \ i=0,1,2,\dots This expansion is a basis for the approximation of u : u(x)\approx u^{\langle n\rangle}(x)=\sum\limits_{i=0}^{n}U_{i}\hat{P}_{i}(x), (8) and the approximation accuracy is estimated depending on the chosen metric (or norm). For example, in L_{2}(\Omega) we have [ 11 ] \|u-u^{\langle n\rangle}\|_{L_{2}(\Omega)}\leqslant\frac{C}{n^{s}}, (9) where C>0 does not depend on n , with the condition that generalized derivatives of u up to order s belong to L_{2}(\Omega) . There is also a sharper estimate [ 12 , 13 ] : \|u-u^{\langle n\rangle}\|_{L_{2}(\Omega)}\leqslant\tilde{C}\,\biggl(\frac{(n-s+1)!}{(n+s+1)!}\biggr)^{1/2}, (10) for which it is assumed that \tilde{C}>0 does not depend on n , and generalized derivatives of u up to order s belong to L_{2}(\Omega) with weight \rho(x)=(1-x^{2})^{s} , s\leqslant n+1 . We also present an estimate corresponding to C(\Omega) , the space of all continuous functions on \Omega [ 9 ] . If a function u is continuously differentiable r times on \Omega , i.e., u\in C^{r}(\Omega) , and its derivative u^{(r)} satisfies the Lipschitz condition with parameter \alpha\in(0,1] , then |u(x)-u^{\langle n\rangle}(x)|\leqslant\frac{\hat{C}}{n^{r+\alpha-1/2}}\ \ \ \forall\,x\in\Omega, where \hat{C}>0 does not depend on n , r+\alpha>1/2 . Remark 1 . In the inequality ( 9 ), the parameter s can be a real non-negative number [ 14 ] . For this, we should use the condition that u belongs to the Sobolev space W_{2}^{s}(\Omega) for s\geqslant 0 instead of the condition that generalized derivatives of u up to order s belong to L_{2}(\Omega) . If s is a natural number, then W_{2}^{s}(\Omega) is defined in the usual way [ 10 ] : W_{2}^{s}(\Omega)=\bigl\{u\colon u^{(k)}\in L_{2}(\Omega),~k=0,1,\dots,s\bigr\}. If s is not a natural number, then W_{2}^{s}(\Omega) (Sobolev–Slobodetskij space) is possible defined by the complex interpolation between W_{2}^{\lfloor s\rfloor}(\Omega) and W_{2}^{\lceil s\rceil}(\Omega) [ 10 , 15 ] , where \lceil s\rceil=\lfloor s\rfloor+1 , W_{2}^{0}(\Omega)=L_{2}(\Omega) . Another definition for W_{2}^{s}(\Omega) [ 15 , 16 , 17 ] : W_{2}^{s}(\Omega)=\biggl\{u\in L_{2}(\Omega)\colon\int_{\Omega^{2}}\frac{|u(x)-u(y)|^{2}}{|x-y|^{1+2s}}\,dxdy<\infty\biggr\},\ \ \ s=\sigma\in(0,1), (11) and W_{2}^{s}(\Omega)=\bigl\{u\in W_{2}^{\lfloor s\rfloor}(\Omega),\ \ \ u^{(\lfloor s\rfloor)}\in W_{2}^{\sigma}(\Omega),\ \ \ \sigma=s-{\lfloor s\rfloor}\bigr\},\ \ \ s\geqslant 1. The parameter s in the inequalities ( 9 ) and ( 10