MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimation

Se Yoon Lee, Jae-Kwang Kim · 2026

Read MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimation by Se Yoon Lee, Jae-Kwang Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05446.txt.

Introduction

Lee and Kim improve mean estimation when labels are scarce but unlabeled traits abound. Their MEC method reweights labeled cases to match the target group, using split-sample fits and Bregman projections to stay steady when predictors err. It meets the efficiency bound under weaker rules, with coverage near its stated level and tighter gaps than prediction-powered rivals.

Catalog record

CREATORSe Yoon Lee, Jae-Kwang Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE137372
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.05446

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimation Se Yoon Lee, Jae-Kwang Kim Abstract Obtaining high-quality labels is costly, whereas unlabeled covariates are often abundant, motivating semi-supervised inference methods with reliable uncertainty quantification. Prediction-powered inference (PPI) leverages a machine-learning predictor trained on a small labeled sample to improve efficiency, but it can lose efficiency under model misspecification and suffer from coverage distortions due to label reuse. We introduce Machine‑Learning‑Assisted Generalized Entropy Calibration (MEC), a cross‑fitted, calibration‑weighted variant of PPI. MEC improves efficiency by reweighting labeled samples to better align with the target population, using a principled calibration framework based on Bregman projections. This yields robustness to affine transformations of the predictor and relaxes requirements for validity by replacing conditions on raw prediction error with weaker projection‑error conditions. As a result, MEC attains the semiparametric efficiency bound under weaker assumptions than existing PPI variants. Across simulations and a real‑data application, MEC achieves near‑nominal coverage and tighter confidence intervals than CF‑PPI and vanilla PPI. 1 Introduction In many inference problems, high-quality labels are scarce while unlabeled covariates are abundant. Recent advancements in machine learning (ML) offer substantial potential to mitigate the reliance on gold-standard data while ensuring valid scientific discovery. Semi-supervised inference capitalizes on this setting by combining a small labeled sample with a large unlabeled sample to estimate population quantities with valid uncertainty quantification ( 47 ; 35 ; 44 ) . A powerful recent approach to this problem is prediction-powered inference (PPI) ( 2 ) . The core idea is elegant: use an ML predictor to impute outcomes on all unlabeled samples, then correct for bias using labeled residuals. PPI is broadly applicable to many scientific problems, as it can leverage flexible ML models, including deep neural networks ( 30 ) , gradient-boosted trees ( 8 ) , random forests ( 7 ) , and BART ( 11 ) . However, in practice, the efficiency of PPI can deteriorate when the predictive model is imperfect, the labeled fraction is small, or the PPI is applied incautiously. In response, multiple variants have been proposed. 3 develop PPI++, an efficiency-enhanced version of PPI that optimizes how predictions and labels are combined, potentially yielding tighter confidence intervals than the original PPI. 49 introduce a cross-prediction technique that trains the predictor out of fold via sample splitting to avoid overfitting from label reuse; in this paper, we refer to their method as cross-fitted PPI (CF–PPI). Other variants of PPI include 16 ; 22 ; 15 ; 32 , reflecting the growing popularity and adaptability of the PPI framework in modern semi-supervised inference. In this paper, we present a new PPI variant inspired by weight calibration ( 14 ) : Machine-Learning-Assisted Generalized Entropy Calibration (ML-GEC; hereafter, MEC) . MEC adapts generalized entropy calibration (GEC) ( 29 ) to the PPI framework, utilizing Bregman projections to calibrate weights for enhanced efficiency. This approach parallels long-standing practices in survey sampling—where carefully chosen weights mitigate bias and improve efficiency ( 18 ; 23 ) —but with a crucial distinction. While classical GEC is typically applied to finite-population mean estimation with prediction rules restricted to the linear span of a preset basis, MEC targets superpopulation mean estimation for semi-supervised inference. Crucially, MEC accommodates essentially arbitrary ML predictors to construct the calibration basis, thus fully leveraging the expressive power of modern ML. We prove that the MEC estimator enjoys desirable asymptotic properties under standard regularity conditions. Theoretically, MEC relaxes the requirements for consistency and asymptotic normality by replacing assumptions on the raw prediction error with weaker assumptions on its projection error. This is enabled by using an out-of-fold predictor for both cross-prediction and calibration-basis construction. We further show that MEC is robust to affine transformations of the predictor, thereby reducing misspecification-driven variance inflation and attaining the semiparametric efficiency bound under weaker conditions than CF-PPI/PPI. We also show that MEC generalizes PPI++ in a dual sense (calibration form vs. regression form), and they are asymptotically equivalent when the generator is quadratic. MEC is computationally stable and fast because the calibration basis is always two-dimensional, regardless of the covariate dimension. Simulations corroborate these guarantees, demonstrating improved coverage and robustness to moderate misspecification across diverse scenarios and varying labeled data fractions. The article is organized as follows. Section 2 introduces notation and basic setup. Section 3 reviews the related works. Section 4 develops the MEC formulation and algorithm. Section 5 presents theoretical guarantees. Section 6 reports simulation experiments. Section 7 concludes with broader implications and extensions. 2 Basic setup We study statistical inference for semi-supervised mean estimation, where collecting high-quality labels is challenging but feature observations are abundant. We posit the outcome-regression model Y=m_{0}(X)+\varepsilon for a generic draw (X,Y)\sim P , with \mathbb{E}[\varepsilon\mid X]=0 and \mathrm{Var}[\varepsilon\mid X]<\infty , where m_{0}(x):=\mathbb{E}[Y\mid X=x] denotes the true regression function. The inferential target is the superpopulation mean outcome \theta_{0}=\mathbb{E}[Y] . We work in an assumption-lean framework, following recent developments in semiparametric methods and the general PPI framework ( 44 ; 47 ; 10 ; 42 ; 27 ; 34 ) : (i) no parametric model is imposed on m_{0} ; (ii) no specific distributional assumptions are imposed on the joint law P —the only assumptions are standard regularity conditions (e.g., finite second moments) for asymptotic results; and (iii) no parametric or explicit convergence rate conditions on the ML predictor used downstream. We introduce the semi-supervised data structure. We observe two independent samples: an unlabeled i.i.d. covariate sample of size N , \{X_{i}\}_{i=1}^{N}\overset{\text{i.i.d.}}{\sim}P_{X} , and an independent labeled i.i.d. sample of size n , \{(X_{j},Y_{j})\}_{j\in S}\overset{\text{i.i.d.}}{\sim}P . Here S is an index set with |S|=n , P_{X} is the X -marginal of P , and X\in\mathcal{X}\subset\mathbb{R}^{p} . We focus on the regime N\gg n , as in applications where collecting features is far cheaper than acquiring labels. Let f_{N}:=n/N denote the label fraction. Throughout, N\to\infty , n=n(N)\to\infty , and f_{N}\to f\in(0,1) ; for brevity we write f for f_{N} . 3 Related works 3.1 Prediction-powered inference 2 proposed the PPI estimator of the superpopulation mean, \displaystyle\widehat{\theta}_{\mathrm{PPI},m}=\frac{1}{N}\sum_{i=1}^{N}m(X_{i})\;+\;\frac{1}{n}\sum_{j\in S}\{Y_{j}-m(X_{j})\}, (1) where m:\mathcal{X}\to\mathbb{R} is a (possibly misspecified) prediction rule. For the moment, we treat m as fixed—that is, not trained on the labeled data. In ( 1 ), the first term is a plug-in prediction component computed over the unlabeled covariates using m , while the second term serves as a residual-correction based on the labeled data. By the linearity of expectation, we have \mathbb{E}_{P}[\widehat{\theta}_{\mathrm{PPI},m}]=\mathbb{E}_{P}[m(X)]+\mathbb{E}_{P}[Y]-\mathbb{E}_{P}[m(X)]=\mathbb{E}_{P}[Y]=\theta_{0} for any fixed predictor m . Consequently, \widehat{\theta}_{\mathrm{PPI},m} is an unbiased estimator of the population mean, irrespective of whether m is misspecified. The choice of m dictates the estimator’s efficiency; specifically, the estimator is semiparametrically efficient if and only if the predictor coincides with the oracle regression function m(x)=m_{0}(x)=\mathbb{E}[Y\mid X=x] . (See Section B in the Appendix for theoretical details.) 2 show that, under mild regularity conditions, the 100(1-\alpha)\% Wald-type confidence interval attains asymptotically nominal coverage (see Theorem S1 in ( 2 ) for details): \displaystyle\liminf_{N,\,n(N)\to\infty}\,\mathbb{P}\!\left(\theta_{0}\in C^{\mathrm{PPI},m}_{\alpha}\right)\;\geq\;1-\alpha, (2) where \displaystyle C^{\mathrm{PPI},m}_{\alpha}:=\Big[\,\widehat{\theta}_{\mathrm{PPI},m}\,\pm\,z_{1-\alpha/2}\,\widehat{\mathrm{se}}_{m}\Big], (3) \displaystyle\widehat{\mathrm{se}}_{m}^{\,2}=\frac{\widehat{\Var}_{N}\!\big\{m(X)\big\}}{N}\;+\;\frac{\widehat{\Var}_{n}\!\big\{Y-m(X)\big\}}{n}, where z_{1-\alpha}=\Phi^{-1}(1-\alpha) denotes the critical value of the standard normal distribution corresponding to cumulative probability 1-\alpha . Here \widehat{\Var}_{N} and \widehat{\Var}_{n} denote empirical variances over all N covariates and over the labeled set S , respectively. In this paper, we consider the

Read the complete text