Learning Smooth Populations of Parameters with Trial Heterogeneity

JungHo Lee, Valerio Baćak, Edward H. Kennedy · 2025

Read Learning Smooth Populations of Parameters with Trial Heterogeneity by JungHo Lee, Valerio Baćak, Edward H. Kennedy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23140.txt.

Introduction

JungHo Lee, Valerio Bacak, and Edward Kennedy study estimation of mixing distributions in a 2025 statistics study. Many data sets mix trials with different success chances, and recovering the spread of those chances is a classic problem. Earlier work mostly assumed every trial was alike, or handled only rough distributions, which gave slow accuracy gains.

The authors allow trials to differ and assume the underlying density is smooth. Under those conditions a kernel density estimator reaches faster error rates tied to an average of trial sizes. Even in the older uniform case their rate beats the best known result. They also estimate differences between two densities.

Catalog record

CREATORJungHo Lee, Valerio Baćak, Edward H. Kennedy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23140

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning Smooth Populations of Parameters with Trial Heterogeneity JungHo Lee, Valerio Baćak, Edward H. Kennedy Abstract We consider the classical problem of estimating the mixing distribution of binomial mixtures, but under trial heterogeneity and smoothness . This problem has been studied extensively when the trial parameter is homogeneous, but not under the more general scenario of heterogeneous trials, and only within a low smoothness regime, where the resulting rates are slow. Under the assumption that the density is s s -smooth, we derive fast error rates for the kernel density estimator under trial heterogeneity that depend on the harmonic mean of the trials. Importantly, even when reduced to the homogeneous case, our result improves on the state-of-the-art rate of Ye and Bickel, 2021 . We also study nonparametric estimation of the difference between two densities, which can be smoother than the individual densities, in both i.i.d. and binomial-mixture settings. Our work is motivated by an application in criminal justice: comparing conviction rates of indigent representation in Pennsylvania. We find that the estimated conviction rates for appointed counsel (court-appointed private attorneys) are generally higher than those for public defenders, potentially due to a confounding factor: appointed counsel are more likely to take on severe cases. Keywords: Binomial mixtures, mixing distribution, nonparametric density estimation, density difference, criminal justice 1 Introduction The problem of estimating the mixing distribution under binomial mixtures has received longstanding attention in the statistics literature ( Teicher, 1963 ; Lord, 1967 ; Lord and Cressie, 1975 ; Sivaganesan and Berger, 1993 ; Wood, 1999 ; Tian et al., 2017 ; Vinayak et al., 2019a ; Vinayak et al., 2019b ; Ye and Bickel, 2021 ) . In this problem, we observe n binomial random variables, each with potentially unique probabilities and number of trials. Early works primarily addressed identifiability ( Teicher, 1963 ; Wood, 1999 ) ; recent studies focus on optimal estimation under different regimes ( Tian et al., 2017 ; Vinayak et al., 2019b ; Ye and Bickel, 2021 ) as well as testing ( Kania et al., 2025 ) . Surprisingly, most prior work has focused on the special case in which the number of trials is homogeneous, even though heterogeneous trials are ubiquitous. For instance, in our application to estimating the conviction rates by attorney type in Pennsylvania, the number of cases vary significantly across counties. Kline and Walters, 2021 , which develops a model for detecting employer discrimination, is a notable exception. Even in contexts where the trial parameters are naturally heterogeneous, existing approaches largely remain ad hoc (e.g., trimming at the minimum number of trials, as in Tian et al., 2017 ), leaving much of the additional information from the trials untapped. Trial heterogeneity arises more frequently in the Bayesian literature where trials are random and treated as parameters of interest themselves ( Royle, 2004 ; Wenger and Freeman, 2008 ; Dail and Madsen, 2011 ; Wu et al., 2015 ) . By contrast, the binomial mixing distribution literature regards the trial parameter as fixed. We likewise condition on the realized t_{i} ’s, imposing a strictly weaker assumption and gaining robustness to any mis-specification of the trial distribution. Moreover, the problem has largely been studied under minimal structural assumptions, such as low smoothness ( Ye and Bickel, 2021 ) , which leads to slow rates. In contrast, more structural assumptions, such as higher-order smoothness, could yield significantly faster rates and thus be valuable in addressing these measurement error problems where known rates are generally slow ( Carroll and Hall, 1988 ; Fan and Truong, 1993 ) . In this paper, we thus study nonparametric estimation of the binomial mixing density under trial heterogeneity and smoothness . We derive improved error rates using a kernel density estimator under s -Hölder smoothness, a standard structural assumption in the nonparametric literature ( Tsybakov, 2008 ) . Notably, when reduced to trial homogeneity, our result improves upon the rates from Ye and Bickel, 2021 where the density is assumed only to be Lipschitz (e.g., 1 -smooth). Further, we analyze the density difference . This quantity is potentially of broader interest and has found widespread applications in areas including, but not limited to, change point detection ( Kawahara and Sugiyama, 2012 ) and feature selection ( Torkkola, 2003 ) . We study nonparametric estimation of the density difference when it is \gamma -smooth, where \gamma\geq s . We demonstrate that one can leverage standard nonparametric tools to optimally estimate this quantity with proper tuning. We illustrate our method in an application in criminal justice. Specifically, we compare the conviction rates of different indigent representations – appointed counsel (court-appointed private attorneys) and public defenders – by estimating their densities. Our data include the number of convictions (“successes”) and total cases (“trials”) for each county in Pennsylvania, which differ significantly across counties and attorney types and thus motivates the study of our problem. We find that the estimated conviction rates for appointed counsel are generally higher than those for public defenders, potentially due to a confounding factor: appointed counsel are more likely to take on severe cases. This suggests a need for further investigation into how appointed counsel are systemically assigned to cases in Pennsylvania. 1.1 Setup & Notation We assume independent data X_{1},\ldots,X_{n} where X_{i}\mid Q_{i}=q\sim\textnormal{Bin}(t_{i},q) , Q_{i} is drawn from the mixing density p supported on [0,1] , and t_{i} is fixed and known, for i=1,\ldots,n . Under the classical setting with homogeneous trials, we would replace t_{i} with t . Our goal is to study the estimation of p at a point u\in(0,1) with absolute pointwise bias |\mathbb{E}\{\hat{p}(u)\}-p(u)| and variance \textnormal{var}\{\hat{p}(u)\} . We consider the canonical kernel density estimator (KDE) \hat{p}_{h}(u)\coloneqq\frac{1}{n}\sum_{i=1}^{n}\frac{1}{h}K\bigg(\frac{X_{i}/t_{i}-u}{h}\bigg), (1) constructed from empirical proportions X_{i}/t_{i} , for a valid kernel K and some bandwidth h>0 . At times, we write K_{h}(X_{i}/t_{i})\coloneqq K\{(X_{i}/t_{i}-u)/h\}/h following the notational convention. Our key assumption is that p is s -smooth, i.e., p belongs to a Hölder class with index s . More precisely, let \lfloor s\rfloor denote the largest integer strictly smaller than s . Then the Hölder class indexed by s contains all functions f that are \lfloor s\rfloor times continuously differentiable with derivatives up to order \lfloor s\rfloor bounded, and the \lfloor s\rfloor order derivatives Lipschitz. That is, |\partial^{\alpha}f(u)|\leq L\text{ for all }\alpha\leq\lfloor s\rfloor,\quad\text{and}\quad|\partial^{\lfloor s\rfloor}f(u)-\partial^{\lfloor s\rfloor}f(u^{\prime})|\leq L|u-u^{\prime}|^{s-\lfloor s\rfloor}, for some constant L>0 and for all u,u^{\prime}\in[0,1] . For simplicity, we omit the constant L . We use \|p\|_{\infty}\coloneqq\sup_{u}|p(u)| for the sup norm of a real-valued function p . For two real sequences a_{n} and b_{n} , we write a_{n}\lesssim b_{n} if a_{n}\leq Cb_{n} and similarly a_{n}\gtrsim b_{n} if a_{n}\geq Cb_{n} for some C>0 independent of n . Paper outline. The remainder of the paper is organized as follows. In Section 2 , we provide our main theoretical results, including the error bounds for estimating s -smooth mixing densities under trial heterogeneity. In Section 3 , we study the density difference. In Sections 4 and 5 , we perform relevant simulation studies and discuss our application to estimating conviction rates by attorney type, respectively. Finally, we conclude our work with potential directions for future research in Section 6 . 2 Main Theoretical Results We begin by presenting a key

Read the complete text