Refined Inference for Asymptotically Linear Estimators with Non-Negligible Second-Order Remainders

Lin Li, Pengcheng Wu · 2026

Read Refined Inference for Asymptotically Linear Estimators with Non-Negligible Second-Order Remainders by Lin Li, Pengcheng Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14561.txt.

Introduction

Li and Wu fix variance estimates for semiparametric estimators with second-order remainders. Standard practice trusts the influence-function variance from a von Mises expansion. That trust fails when the remainder adds real variance of its own. Sandwich errors then run small, and Wald intervals miss too often. The authors split total variance into influence and remainder parts. They show when the sandwich can fail and prove fixes work. Leave-one-out jackknife and cluster bootstrap both track total variance under stated conditions.

Catalog record

CREATORLin Li, Pengcheng Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51728
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14561

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Refined Inference for Asymptotically Linear Estimators with Non-Negligible Second-Order Remainders Lin Li, Pengcheng Wu Abstract Asymptotically linear estimators in semiparametric models use a von Mises expansion to reduce inference to the influence-function variance. This reduction is valid when the second-order remainder is negligible in variance, a condition that is not implied by the product-rate requirement guaranteeing asymptotic linearity. When the remainder contributes non-negligible variance, the standard sandwich underestimates the total sampling variance and Wald intervals undercover; we call this the near-boundary regime . We derive a finite-sample variance decomposition separating influence-function and remainder components, characterize the sandwich consistency condition sharply, and establish asymptotic validity of the leave-one-out jackknife and pairs cluster bootstrap in this regime. Jackknife validity follows from a self-normalization argument; bootstrap validity is established directly. An analytic formula for the amplification of the sandwich gap by intra-cluster correlation is derived for clustered data. A simulation study using a surrogate-assisted targeted learning estimator in stepped-wedge cluster-randomized trials illustrates the regime: the variance ratio V ^ JK / V ^ Sand \hat{V}_{\rm JK}/\hat{V}_{\rm Sand} is 1.14–1.38 and persistent across cluster counts, and the refined procedures substantially improve coverage. Keywords: asymptotic linearity; semiparametric inference; second-order remainder; jackknife; bootstrap; variance decomposition; stepped-wedge trial. 1 Introduction Asymptotically linear estimators (ALEs) in semiparametric models satisfy \sqrt{n}\bigl(\hat{\Psi}-\Psi(P_{0})\bigr)\;=\;\frac{1}{\sqrt{n}}\sum_{i=1}^{n}D^{*}(O_{i})+o_{P}(1), (1) where D^{*} is the efficient influence function (EIF) with variance \sigma^{2}_{\mathrm{EIF}} . This framework covers AIPW ( 10 ) , DML ( 6 ) , and TMLE ( 11 ) . Asymptotic linearity rests on a von Mises expansion in which a second-order remainder R_{\mathrm{rem}} is controlled via product-rate conditions on nuisance estimators. The standard Wald interval then uses the sandwich variance \widehat{\sigma}^{2}_{\mathrm{EIF}}/n as an estimate of the total sampling variance. This reasoning is asymptotically exact, but finite-sample coverage depends on a condition that is not implied by asymptotic linearity itself: the second-moment negligibility n\cdot\mathrm{Var}(R_{\mathrm{rem}})\to 0 . Standard product-rate conditions guarantee R_{\mathrm{rem}}=o_{P}(n^{-1/2}) , which suffices for consistency of the point estimator. First-order variance estimation requires additionally that \mathrm{Var}(R_{\mathrm{rem}})=o(n^{-1}) , a stronger condition that fails when nuisance estimation operates at the product-rate boundary. When \mathrm{Var}(R_{\mathrm{rem}})=O(n^{-1}) , the total sampling variance of \hat{\Psi} contains a structural component c_{R}/n>0 beyond \sigma^{2}_{\mathrm{EIF}}/n , the sandwich underestimates the total variance, and Wald intervals undercover. We call this the near-boundary regime . The gap between asymptotic linearity and valid first-order inference has been noted empirically for TMLE ( 11 ) , doubly robust estimators ( 13 ) , and semiparametric survival estimators ( 8 ) , but has not been given a general theoretical treatment. matsushita2020jackknife identify related nonstandard behaviour for jackknife empirical likelihood in the kernel semiparametric setting; their structural problem is different (nuisance rate controlled via bandwidth), but the remedy—resampling—is analogous. 4 study non-negligible bias from slow nuisance rates; our near-boundary remainder contributes non-negligible variance while being asymptotically unbiased, a structurally distinct problem. The motivating application is the surrogate-assisted TMLE (SA-TMLE) of 1 for nested bridge functionals under administrative censoring in stepped-wedge cluster-randomized trials. Across J\in\{10,\ldots,100\} clusters and ICC \in\{0.01,\ldots,0.20\} , the SA-TMLE achieves near-zero bias while the sandwich 95% intervals attain only 0.87–0.91 empirical coverage, with the variance ratio \hat{\rho}=\widehat{\mathrm{Var}}_{\mathrm{JK}}/\widehat{\mathrm{Var}}_{\mathrm{Sand}}\approx 1.6 constant across all J — a structural signature of the near-boundary regime. Contributions. We develop a sharp general framework for inference in the near-boundary regime. (i) A finite-sample variance decomposition separates influence-function variance from remainder-induced variance and their covariance. (ii) A sandwich consistency characterization (Theorem 4.1 ) gives a necessary and sufficient condition for the sandwich to estimate total variance: n\cdot\mathrm{Var}(R_{\mathrm{rem}})\to 0 . (iii) Two refined variance estimators — leave-one-unit-out jackknife and pairs cluster bootstrap — remain valid in the near-boundary regime; bootstrap validity is established directly, jackknife validity via a self-normalization argument in which numerator and denominator both track \sigma^{2}_{\mathrm{EIF}}+c_{R} . An HC-corrected sandwich is shown to be numerically equivalent to the jackknife Wald interval. (iv) A clustered-data extension derives an analytic formula for ICC amplification of the sandwich gap. Section 2 establishes notation; Sections 3 – 4 give the decomposition and sandwich characterization; Section 5 develops the refined estimators; Section 6 treats clustered data; Section 7 presents simulations; Section 8 concludes. 2 General Framework 2.1 Asymptotically Linear Estimators and the Von Mises Expansion Let \mathcal{P} be a nonparametric model and \Psi:\mathcal{P}\to\mathbb{R} a pathwise differentiable functional with efficient influence function D^{*}\in L^{2}_{0}(P_{0}) . An estimator \hat{\Psi} based on n i.i.d. observations O_{1},\ldots,O_{n}\sim P_{0} is asymptotically linear if it admits the expansion \hat{\Psi}-\Psi(P_{0})=\frac{1}{n}\sum_{i=1}^{n}D^{*}(O_{i})+R_{\mathrm{rem}}, (2) where R_{\mathrm{rem}}=R_{\mathrm{rem}}({\hat{P}},P_{0}) is a second-order remainder satisfying \sqrt{n}\,R_{\mathrm{rem}}=o_{P}(1) under appropriate regularity conditions. The key structural property of ( 2 ) is that the remainder R_{\mathrm{rem}} is second-order in the nuisance estimation error: it vanishes faster than the first-order influence-function term n^{-1/2} under standard product-rate conditions. Definition 2.1 (Standard von Mises Remainder Structure) . We say R_{\mathrm{rem}} has standard bilinear structure if it can be written as R_{\mathrm{rem}}=\int\bigl(\hat{\eta}_{1}-\eta^{0}_{1}\bigr)\bigl(\hat{\eta}_{2}-\eta^{0}_{2}\bigr)\,dP_{0}+o_{P}\bigl(n^{-1/2}\bigr), (3) where \eta_{1},\eta_{2} are nuisance functionals and \hat{\eta}_{k} are their estimators. The SA-TMLE remainder R_{2} satisfies ( 3 ) with \eta_{1}=\bar{Q}_{Y} and \eta_{2}=g_{\Delta} . By the Cauchy–Schwarz inequality, |R_{\mathrm{rem}}|\leq\left\|\hat{\eta}_{1}-\eta^{0}_{1}\right\|_{P_{0}}\cdot\left\|\hat{\eta}_{2}-\eta^{0}_{2}\right\|_{P_{0}} , so condition \left\|\hat{\eta}_{1}-\eta^{0}_{1}\right\|_{P_{0}}\cdot\left\|\hat{\eta}_{2}-\eta^{0}_{2}\right\|_{P_{0}}=o_{P}(n^{-1/2}) suffices for \sqrt{n}\,R_{\mathrm{rem}}=o_{P}(1) . Definition 2.2 (Product-Rate Boundary) . We say the estimator operates at the product-rate boundary if each nuisance estimator converges at rate exactly o_{P}(n^{-1/4}) in L^{2}(P_{0}) : \left\|\hat{\eta}_{k}-\eta^{0}_{k}\right\|_{P_{0}}=O_{P}(n^{-1/4}),\quad k=1,2. (4) At the boundary, \left\|\hat{\eta}_{1}-\eta^{0}_{1}\right\|_{P_{0}}\cdot\left\|\hat{\eta}_{2}-\eta^{0}_{2}\right\|_{P_{0}}=O_{P}(n^{-1/2}) , which just barely satisfies the product-rate condition o_{P}(n^{-1/2}) . The boundary is typical when nuisance functions are estimated via parametric models in dimension growing with n , or via nonparametric ensemble methods that have not yet entered their fast-rate regime. 2.2 Regularity Conditions We work under the following conditions throughout Sections 3 – 4 . Assumption 2.1 (i.i.d. Data) . O_{1},\ldots,O_{n}\overset{\mathrm{i.i.d.}}{\sim}P_{0} with O_{i}\in\mathcal{O} . Assumption 2.2 (Asymptotic Linearity) . The estimator \hat{\Psi} satisfies ( 2 ) with \sqrt{n}\,R_{\mathrm{rem}}=o_{P}(1) and D^{*}\in L^{2}_{0}(P_{0}) having \sigma^{2}_{\mathrm{EIF}}=\mathbb{E}_{P_{0}}[(D^{*})^{2}]\in(0,\infty) . Assumption 2.3 (Bounded Influence Function) . \|D^{*}\|_{\infty}\leq M<\infty almost surely. Assumption 2.4 (Remainder Rate) . The remainder satisfies R_{\mathrm{rem}}=r_{n}\cdot\xi_{n} where r_{n} is a deterministic rate and \xi_{n}=O_{P}(1) . We say R_{\mathrm{rem}} is at the strong decay regime if n\cdot r_{n}^{2}\to 0 , and at the near-boundary regime if n\cdot r_{n}^{2}=c_{R}>0 for some constant. 3 Finite-Sample Variance Decomposition 3.1 The Decomposition Theorem Theorem 3.1 (Finite-Sample Variance Decomposition) . Under Assumptions 2.1 – 2.4 , the mean squared error of the ALE decomposes as: \mathrm{Var}\bigl(\hat{\Psi}-\Psi(P_{0})\bigr)\;=\;\underbrace{\frac{\sigma^{2}_{\mathrm{EIF}}}{n}}_{\begin{subarray}{c}\text{influence-function}\\ \text{variance}\end{subarray}}\;+\;\underbrace{\mathrm{Var}(R_{\mathrm{rem}})}_{\begin{subarray}{c}\text{remainder}\\ \text{variance}\end{subarray}}\;+\;\underbrace{2\,\mathrm{Cov}\!\left(\frac{1}{n}\sum_{i=1}^{n}D^{*}(O_{i}),\;R_{\mathrm{rem}}\right)}_{\text{cross term}}\;+\;o(n^{-1}). (5) The cluster sandwich variance estimator \widehat{\mathrm{Var}}_{\mathrm{Sand}}(\hat{\Psi}) is consistent for \sigma^{2}_{\mathrm{EIF}}/n only; it does not target \mathrm{Var}(R_{\mathrm{rem}}) or the cross term. Proof. Apply the variance operator to ( 2 ): \displaystyle\mathrm{Var}\bigl(\hat{\Psi}-\Psi(P_{0})\bigr) \displaystyle=\mathrm{Var}\!\left(\frac{1}{n}\sum_{i}D^{*}(O_{i})\right)+\mathrm{Var}(R_{\mathrm{rem}})+2\,\mathrm{Cov}\!\left(\frac{1}{n}\sum_{i}D^{*}(O_{i}),R_{\mathrm{rem}}\right). The first term equals \sigma^{2}_{\mathrm{EIF}}/n by i.i.d. and the definition of \sigma^{2}_{\mathrm{EIF}} . The o(n^{-1}) residual accounts for the o_{P}(n^{-1/2}) residual in ( 2 ). The sandwich \widehat{\mathrm{Var}}_{\mathrm{Sand}}=(n-1)^{-1}\sum_{i}(\hat{D}(O_{i})-\bar{D}_{n})^{2}/n estimates \sigma^{2}_{\mathrm{EIF}}/n by the LLN (when \hat{D} is consistent for D^{*} ), but contains no term corresponding to \mathrm{Var}(R_{\mathrm{rem}}) or the covariance, since those involve the distribution of R_{\mathrm{rem}} across repeated samples — information not contained in the observed scores \{\hat{D}(O_{i})\} . ∎ 3.2 The Near-Boundary Gap Proposition 3.1 (Variance Gap at the Product-Rate Boundary) . Suppose the remainder has standard bilinear structure (Definition 2.1 ) with each nuisance at the product-rate boundary (Definition 2.2 ). Then: a. \mathrm{Var}(R_{\mathrm{rem}})=O(n^{-1}) , so the gap \mathrm{Var}(\hat{\Psi})-\sigma^{2}_{\mathrm{EIF}}/n=\Theta(n^{-1}) . b. The relative gap satisfies \frac{\mathrm{Var}(\hat{\Psi})}{\sigma^{2}_{\mathrm{EIF}}/n}\;=\;1+\frac{c_{R}}{\sigma^{2}_{\mathrm{EIF}}}+o(1), (6) where c_{R}=\lim_{n\to\infty}n\cdot\mathrm{Var}(R_{\mathrm{rem}})>0 . c. The

Read the complete text