Moment-based Piecewise Polynomial Probability Density Estimation with Quantile-Based Binning
Meltem Turan, Joakim Munkhammar · 2026
Read Moment-based Piecewise Polynomial Probability Density Estimation with Quantile-Based Binning by Meltem Turan, Joakim Munkhammar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00209.txt.
Introduction
Turan and Munkhammar propose a quantile-based piecewise method for rebuilding densities from data. Classical global moment approximations often oscillate, destabilise in the tails, and hinge on support. Their approach pairs equal-probability binning with local moment polynomials in each bin, in monomial and Lagrange variants. Bin counts and degrees come from a grid search steered by the Kolmogorov-Smirnov test under non-negativity rules. Across benchmarks, the methods cut K-S errors by about 80 to 96 percent against standard approaches, and by about 83 to 97 percent against splines.
Catalog record
| CREATOR | Meltem Turan, Joakim Munkhammar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54118 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.00209
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Moment-based Piecewise Polynomial Probability Density Estimation with Quantile-Based Binning Meltem Turan, Joakim Munkhammar Abstract Accurate reconstruction of probability density functions (PDFs) from data is essential in engineering applications. Classical global moment-based polynomial approximations often suffer from oscillations, instability in the tails, and sensitivity to the choice of support. This work proposes a quantile-based piecewise polynomial density reconstruction approach that combines equal-probability binning with local moment-matched polynomials within each bin. Two variants are considered: piecewise monomial and piecewise Lagrange polynomials with Chebyshev nodes. The numbers of bins and polynomial degrees are selected by a proposed grid search approach guided by the Kolmogorov–Smirnov (K–S) test statistic under non-negativity constraints. Across several benchmark distributions, the proposed methods reduce K–S errors by about 80 80 – 96 % 96\% relative to standard monomial and Lagrange polynomial approaches, and by about 83 83 – 97 % 97\% compared with spline density estimation. For real-world household electricity consumption and solar irradiance data, the piecewise approaches achieve K–S test statistic performance comparable to kernel density estimation while offering improved control over tail behavior and oscillations. Overall, the results demonstrate that quantile-based localization substantially enhances the robustness and fidelity of moment-based polynomial PDF reconstruction. Keywords: Nonparametric estimation; Method of Moments; piecewise polynomial approximation; Quantile-based binning; Density reconstruction. 1 Introduction The probability density function (PDF) is a fundamental object in statistics and probability theory, describing how probability is distributed over the support of a random variable. In applications, the underlying PDF is rarely known in closed form and must be estimated from observed data 23 . Obtaining accurate and robust PDF estimates is important not only for purely statistical tasks (e.g., inference, goodness-of-fit testing) but also for engineering applications such as forecasting, reliability estimation, and risk assessment 12 , 14 . In energy engineering, PDF estimation is especially relevant for modeling stochastic processes such as the temporal variability of solar irradiance 18 , household electricity consumption 17 , and wind power generation 10 , 8 . In these contexts, distributions often exhibit skewness, heavy tails, or multimodality, and can deviate substantially from standard parametric families. Estimators must therefore be flexible enough to capture such complex behavior while remaining numerically stable and interpretable. Broadly, PDF estimation methods can be categorized into parametric and nonparametric methods. Parametric methods represent the data using a prescribed family of distributions, e.g., Normal, Log-Normal, Weibull, or Gamma 22 . Parameters are typically estimated via the Method of Moments or maximum likelihood. Moment-based methods, in particular, approximate a distribution by matching low-order moments (mean, variance, skewness, kurtosis, etc.) to those of the observed data 2 . Although this approach can be efficient and interpretable when the chosen family is appropriate, it suffers from model misspecification: when the true distribution does not belong to the assumed family, moment estimates may become biased and the resulting PDF inaccurate 26 . Nonparametric methods, by contrast, seek to reconstruct the distribution directly from the data without assuming a specific parametric form 9 . A widely used nonparametric method is Kernel Density Estimation (KDE), which approximates the density by placing a smooth kernel function at each data point ( 20 ) . The crucial hyperparameter in KDE is the bandwidth, which controls the amount of smoothing. A single global bandwidth is typically used across the entire support, which may be suboptimal: dense regions require fine resolution, whereas sparse regions (e.g., tails) benefit from stronger smoothing. This limitation can lead to oversmoothing of sharp features or undersmoothing of noisy regions ( 21 ) . Another line of nonparametric methods involves histogram-based approaches and their refinements ( 7 ) . Quantized Histogram-Based Smoothing (QHBS) is designed to overcome the discontinuities of standard histograms by smoothing bin counts to obtain a continuous and differentiable density estimate 11 . QHBS can capture multimodal or discontinuous distributions, but its performance remains sensitive to the choice of the number of bins and binning strategy 6 . Piece-wise polynomial-based probability density estimation has mainly been developed in the context of histogram smoothing and orthogonal polynomial-based methods such as B-spline functions 4 . Early work interprets histograms as piece-wise constant polynomials, with optimal bin-width rules mitigating—but not eliminating—bias–variance trade-offs and discontinuities at bin edges 1 , 21 . Spline Density Estimation (SDE) constructs the PDF as a non-negative mixture of B-spline basis functions, providing a flexible piecewise-polynomial representation with local support and smoothness control 19 . One defines a set of B-splines over the data range, typically with clamped knots at the endpoints to ensure coverage of the support. The spline coefficients are then obtained via a non-negative least-squares problem, guaranteeing non-negativity of the estimated PDF. However, the quality of the spline approximation depends heavily on the number and placement of knots: too few basis functions may oversmooth the density, while too many may overfit noise. Fixed spline bases may also struggle to adapt to regions with varying data density or to represent sharp peaks ( 13 ) . Recent studies construct higher-order piece-wise polynomials on finite supports, enforcing non-negativity and smoothness via quadratic programming and moment or interpolation constraints 27 . Among them, moment-based polynomial approaches approximate the probability density on a fixed interval by polynomials expressed in monomial, Chebyshev, Hermite, or Lagrange polynomial bases, which are orthogonal polynomials, Coefficients are determined by matching a finite number of moments ( 15 , 25 ) . These methods can be effective on suitably chosen intervals with an appropriate number of moments, but they often degrade in the presence of small variance, heavy tails, strong skewness, or poorly tuned intervals. Moreover, moment-based polynomial approximations are prone to oscillations (Runge-type behavior), misplacement of modes, and negativity issues that require ad hoc adjustments of the degree or support. This study presents and evaluates a modified moment-based polynomial approximation approach that introduces local adaptivity via quantile-based binning. Instead of applying a single global polynomial on a fixed interval, the approach partitions the data into bins using empirical quantiles and fits a separate polynomial in each bin via the Method of Moments. This approach can be viewed as a quantile-based piecewise polynomial reconstruction of the PDF. The key idea is to leverage the binning mechanism of QHBS, but rather than smoothing bin counts, the density within each bin is approximated locally using polynomials based on the moments. The bin boundaries are chosen so that each bin contains approximately the same number of observations, thereby addressing data sparsity in tail regions and providing a more balanced representation across the support. The proposed approach does not aim to produce a perfectly smooth global approximation; instead, it focuses on reducing oscillations and improving local fidelity, especially in tails and around peaks of skewed or multimodal distributions. Two polynomial bases, which are piecewise monomial and piecewise Lagrange polynomials with Chebyshev interpolation points in each bin, are considered for the local approximations. For both variants, the coefficients are obtained by matching local empirical moments in each bin. The number of bins N_{B} and the polynomial degree (or moment order) N_{M} are selected by scanning over a predefined grid (N_{B},N_{M}) and minimizing the two-sample Kolmogorov–Smirnov (K–S) test statistic between the empirical and reconstructed cumulative distribution functions. Performance of the proposed quantile-based piecewise monomial and Lagrange polynomial approaches are demonstrated on