Semiparametric robust estimation of population location

Ananyabrata Barua, Ayanendranath Basu · 2025

Read Semiparametric robust estimation of population location by Ananyabrata Barua, Ayanendranath Basu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03021.txt.

Introduction

Real data often mix a clear signal with messy noise. Ananyabrata Barua and Ayanendranath Basu wrote this 2025 study on how to find the true center of such data. Older tools, called mixture models, split mixed groups into smaller, cleaner parts.

The authors work on a flexible method that stays steady when noise is present. A steady center estimate matters when a few odd values could pull a result off course. Their approach fits fields like health, finance, and lab work, where mixed data are common. It gives analysts a safer way to name the main signal. Readers get a clear sense of why finding a center in messy data needs care.

Catalog record

CREATORAnanyabrata Barua, Ayanendranath Basu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03021

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Semiparametric robust estimation of population location Ananyabrata Barua, Ayanendranath Basu Abstract Real - world measurements often comprise a dominant signal contaminated by a noisy background. Robustly estimating the dominant signal in practice has been a fundamental statistical problem. Classically, mixture models have been used to cluster the heterogeneous population into homogeneous components. Modeling such data with fully parametric models risks bias under misspecification, while fully nonparametric approaches can dissipate power and computational resources. We propose a middle path: a semiparametric method that models only the dominant component parametrically and leaves the background completely nonparametric, yet remains computationally scalable and statistically robust. So instead of outlier downweighting, traditionally done in robust statistics literature, we maximize the observed likelihood such that the noisy background is absorbed by the nonparametric component. Computationally, we propose a new FFT-accelerated approximate likelihood maximization algorithm. Empirically, this FFT plug - in achieves order - of - magnitude speedups over vanilla weighted EM while preserving statistical accuracy and large sample properties. 1 Introduction Finite mixture models have been a standard tool for modeling heterogeneous populations, discovering subpopulations, and performing model - based clustering. Classical formulations impose a common parametric family on all components (e.g., Gaussian mixtures) and rely on identifiability assumptions or parsimonious parameterizations to render the estimation problem well - posed ( 4 ; 1 ; 8 ; 9 ) . The EM algorithm is the workhorse in practice ( 32 ; 24 ; 10 ; 13 ) . Yet the assumptions that make parametric mixtures tractable—common family, structured covariances, or a fixed number of components—are almost never aligned with actual noisy datasets. In many applications the investigator primarily cares about the most dominant signal peak (its location and mass), while the remainder of the distribution is a complicated amalgam of weaker modes, tails, or background phenomena that defy clear parametric specification. For such tasks, fitting a fully parametric K - component model can be brittle: identifiability hinges on modeling all components correctly, and estimation can deteriorate due to over - fitting or weak identifiability ( 31 ; 7 ) . A parallel line of work relaxes parametric assumptions on one component. In two - component mixtures where one distribution is known and the other is nonparametric (sometimes with symmetry or shape constraints), there are strong identifiability and estimation results for the mixing proportion and for features of the unknown component; see, e.g., ( 4 ) and ( 25 ) . In machine learning, the related mixture - proportion estimation problem has been studied in semi - supervised novelty detection and positive - unlabeled learning, with estimators and rates under separability or irreducibility conditions ( 3 ; 27 ; 26 ) . These strands underscore a theme: if the inferential target is a weight or a single component , strict distributional modeling of the remainder can be avoided. Our paper embraces this philosophy and pushes it in a direction that is distinct from classical robust statistics . Robust methods à la Huber and Hampel downweight or reweight observations to resist the effect of outliers—with M - estimators, influence - function design, or divergence - based criteria—but still typically posit a parametric data - generating model and optimize a single loss over all data. Robust clustering extensions either replace Gaussian errors by heavier - tailed t components or trim a fraction of points to curb spurious solutions. While powerful for outlier resistance, these approaches differ in motivation and technique from our objective of extracting the dominant peak and its mass without modeling the rest ( 18 ; 15 ; 2 ) . We consider a semiparametric “contamination” mixture f(y)\;=\;\pi_{0}\,f_{0}(y;\theta)+(1-\pi_{0})\,f_{\mathrm{bg}}(y),\qquad\pi_{0}\in(0,1), in which f_{0}(\cdot;\theta) is a parametric family for a dominant component (e.g., a location or location–scale family) and the background density f_{\mathrm{bg}} is left completely unrestricted . The inferential target is the dominant component’s location parameter \theta . We do not attempt full identifiability of a multi - component parametric mixture; rather, our goal is targeted recovery of the dominant component under certain regularity. This formulation sits at the intersection of semiparametric mixtures “with one unknown component” and mixture - proportion estimation ( 4 ; 3 ; 27 ; 25 ; 26 ) . Algorithmically, we maximize a plug–in log - likelihood where the unknown background f_{\mathrm{bg}} is replaced by a kernel density estimator (KDE) computed once per EM iteration via an FFT - accelerated convolution on a uniform grid with linear binning and zero padding ( 28 ; 29 ; 36 ; 35 ) . This reduces the nonparametric update from O(nG) to O(G\log G) for G grid points, while off - grid evaluations use linear interpolation whose error we bound by the usual C^{2} truncation rate O(\Delta^{2}/h^{3}) (here \Delta is the grid spacing and h the bandwidth), so the FFT/binned criterion differs from the exact plug–in criterion by a uniform o_{p}(1) term. On the statistical side, we establish (i) consistency of the FFT plug–in estimator \hat{\theta}_{n} under (a) standard smoothness/undersmoothing for KDE, (b) a windowed body–tail control for the log - likelihood, and (c) a local curvature (strong concavity) condition for the population objective around \theta^{*} ; and (ii) a CLT for smooth functionals after strengthening the discretization to \sqrt{n}\,\varepsilon_{n}\!\to\!0 , where \varepsilon_{n}\!=\!\tfrac{\|\mathbb{K}^{\prime\prime}\|_{\infty}}{4}\Delta_{n}^{2}/h_{n}^{3} is the binned - FFT interpolation error. The proofs combine a uniform oracle LLN for the parametric part ( 34 ) with (a) uniform control of the FFT/KDE approximation on a growing body window and (b) crude but sufficient tail envelopes that shrink against \log(1/h_{n}) . The resulting consistency and CLT coincide with “what one would expect” if the background density were known, modulo the small plug–in remainder. Classical robust statistics mitigates sensitivity by modifying the loss, bounding the influence function, or minimizing a robust divergence ( 19 ; 16 ; 23 ) . Our approach differs in these aspects: (1) we do not posit a global parametric model for all observations—only the dominant component is parametric, the rest is nonparametric; (2) the weights arise from posterior membership in a mixture rather than from a downweighting scheme engineered via an influence curve. In this sense our method is closer to the semiparametric mixture literature, except here the unknown component is neither known nor shape - constrained, and we leverage a fast nonparametric plug - in evaluated inside the EM algorithm. 2 Estimating a single dominant component We first consider the problem of estimating a single dominating subpopulation from a heterogeneous population. Towards this, we model the data Y_{1},\dots,Y_{n} through a two component mixture f, which can be written as f(y)\;=\;\pi_{0}f_{0}(y;\theta)+(1-\pi_{0})f_{1}(y), (1) where f_{0}(\cdot\,;\theta) is our main component of interest and it is modeled through a parametric family with unknown parameter \theta\in\Theta\subset\mathbb{R}^{q}, and f_{1} is kept unspecified, modeling the remaining mixture of the other background components. The mixing weights \pi_{0} and 1-\pi_{0} are unknown but constant. We observe n i.i.d. samples \mathbf{y}=(y_{1},\cdots,y_{n}) from this mixture. The average log-likelihood function of ( 1 ) is \mathcal{L}(\Theta;\mathbf{y})=\frac{1}{n}\sum_{i=1}^{n}\log\Bigl\{\pi_{0}f_{0}(y_{i};\theta)+(1-\pi_{0})f_{1}(y_{i})\Bigr\},\qquad\Theta=(\pi_{0},\theta) (2) We cannot optimize the above expression directly because f_{1}(y) is unknown. For this reason we approximate f_{1} via a kernel density estimator \tilde{f}^{\mathrm{exact}}_{1,n}(y;\omega)=\frac{1}{h_{n}}\sum_{j=1}^{n}\omega_{j}\,\mathbb{K}\!\left(\frac{y_{j}-y}{h_{n}}\right), (3) where \mathbb{K}(\cdot) is a kernel function satisfying Condition 1 , \omega_{j} ’s are weighting parameters such that \sum_{i=1}^{n}\omega_{j}=1 and h_{n}>0 is the bandwidth. \omega_{j} is

Read the complete text