Induced replication and the assessment of models
H. S. Battey, and, N. Reid · 2026
Read Induced replication and the assessment of models by H. S. Battey, and, N. Reid (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27718.txt.
Introduction
Battey and Reid rethink how complex models get assessed. Semiparametric fits often blur estimation and assessment steps. Smoothing choices drive much of that blur. Their approach induces replication inside the fitted model. Fisher-style separations split signal from noise parts. Within-sample prediction error then grades the model. Examples cover hazard models and Poisson processes. Matched-pair designs also fit the frame. The method sidesteps kernel tuning woes.
Catalog record
| CREATOR | H. S. Battey, and, N. Reid |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90424 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27718
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Induced replication and the assessment of models H. S. Battey, and, N. Reid Abstract We study the assessment of semiparametric and other highly-parametrised models from the perspective of foundational principles of parametric statistical inference. In doing so, we highlight the possibility of avoiding the usual semiparametric considerations, which typically require estimation of nuisance components through kernel smoothing or basis expansion, with the associated difficulties of tuning-parameter choice that blur the distinction between estimation and model assessment. A key aspect is the availability of preliminary manoeuvres that induce an internal replication of known form under the postulated model. This can be cast as a generalised version of the Fisherian sufficiency/co-sufficiency separation, replacing out-of-sample prediction error as a criterion for semiparametric model assessment by a type of within-sample prediction error. Framed in this light are new methodological contributions in multiple example settings, including model assessment for the proportional hazards model, for a time-dependent Poisson process with semiparametric intensity function, and for matched-pair and two-group examples. Also subsumed within the framework is a post-reduction inference approach to the construction of confidence sets of sparse regression models. Numerical work confirms recovery of nominal error rates under the postulated model and high sensitivity to departures in the direction of semiparametric alternatives. We conclude by emphasising open challenges and unifying perspectives. Some key words: co-sufficiency; confidence sets of models; exchangeability; model adequacy; post-selection inference; post-reduction inference. 1 Introduction Two widely used approaches to assessing regression models, semiparametric or otherwise, are to substitute unknown regression parameters by estimates and check residuals for any anomalous behaviour, or to assess the predictive performance of the fitted model. The visually compelling but sometimes informal approaches based on residuals, through their connection to co-sufficiency in parametric models, can be viewed as a way of evaluating predictive accuracy within sample. If a statistic S=s(Y) constructed from observations Y=(Y_{1},\ldots,Y_{n}) is sufficient for a scalar or vector parameter \theta , then it contains all the information in the data relevant for inference on \theta , potentially leaving information remaining in Y for assessment of the model, an observation due to Fisher 1950 . Specifically if the observed value y^{o} is extreme when calibrated against the conditional distribution of Y given the observed value S=s , then this provides evidence against the model ( Barndorff-Nielsen and Cox 1994 , p.29) . We call this residual information after conditioning co-sufficient in line with the terminology used in previous work. The idea, although conceptually appealing, typically does not translate to a convenient statistical procedure, as the conditional distribution is multidimensional, often constrained to a manifold of inexplicit form, and usually does not have a convenient analytic expression. Simulation to calculate extremal regions is not straightforward either, as simple bootstrap draws from the data violate the constraint S=s . Progress was made by Engen and Lillegård 1997 ; Lindqvist et al. 2003 ; Lindqvist and Taraldsen 2005 ; Lockhart et al. 2007 who appear to have been the first to attempt to operationalise co-sufficient sampling in any level of generality, and Barber and Janson 2022 who substantially advanced the methodology and associated theory. See also Battey 2024 for some relevant geometric perspectives and Battey, Rasines & Tang 2025 for an analytic approach designed for a particular setting, outlined in § 3.3 . The purpose of the present paper is to explore other inferential structures, some of which being generalisations of the sufficiency/co-sufficiency separation, with a view to opening new directions for research on model assessment in semiparametric and highly parametrised models. If a model contains a genuinely infinite-dimensional component, there is no hope for either first-order inference or model assessment from n observations. In practice, however, semiparametric models are not genuinely infinite dimensional. Instead, smoothness assumptions implicitly or explicitly constrain the effective parameter space to dimension smaller than n , often achieved by truncating an expansion in basis functions, by regularisation, or via kernel smoothing. The associated tuning-parameter selection for such estimators is typically based on cross-validation, blurring the distinction between estimation and model assessment. The present work is an attempt to reconcile inference for semiparametric and other highly-parametrised models with the Fisherian parametric foundations by illustrating the feasibility and merits of an approach to model assessment that evades estimation of the high- or infinite-dimensional nuisance component. The following simple example exposes two important points: that the need for smoothness or other assumptions on infinite-dimensional nuisance parameters can sometimes be removed, and that model assessment can be performed without estimating nuisance parameters, and without an additional sample to assess out of sample prediction error. Example 1.1 . Let (Y_{j1},Y_{j0}) be outcomes on treated and untreated units in the j th of m matched pairs of individuals, e.g. identical twins. Because treatment is randomised, these outcomes are independent, but inference on the treatment parameter \psi , and assessment of the model, is superficially challenging as every pair contributes a nuisance parameter \gamma_{j} , so that the pairs are not identically distributed, and the model has m+1 unknown parameters. This formulation of the matched pair problem, although highly parametrised, makes fewer assumptions than a standard semiparametric model in covariates x\in\mathbb{R}^{p} , which would model the nuisance parameters as \gamma_{j}=h(x_{j}) for some unknown function h:\mathbb{R}^{p}\rightarrow\Gamma , where the parameter space \Gamma is usually \mathbb{R} or \mathbb{R}^{+} . Suppose now that (Y_{j1},Y_{j0}) are modelled as independent and exponentially distributed with rates \gamma_{j}\psi , \gamma_{j} respectively. If the true distribution belongs to the model and has true parameter value \psi^{*} , then Y_{j0}+Y_{j1}\psi^{*}=:S_{j}(\psi^{*}) is sufficient for \gamma_{j} and has density function f_{S_{j}(\psi^{*})}(s)=\gamma_{j}^{2}s\exp(-\gamma_{j}s), (1) i.e., S_{j}(\psi^{*}) is gamma distributed with shape parameter 2 and rate parameter \gamma_{j} . The conditional density of Y_{j1} at y_{j1} , given S_{j}(\psi^{*})=s_{j}(\psi^{*}) , is \psi^{*}/s_{j}(\psi^{*}) uniformly in y_{j1} , showing that Y_{j1} is conditionally uniformly distributed between 0 and s_{j}(\psi^{*})/\psi^{*} . Equivalently U_{j}(\psi^{*}):=Y_{j1}\psi^{*}/s_{j}(\psi^{*}) has a standard uniform distribution for all j=1,\ldots,m . The above conclusions are invalidated if \psi^{*} is replaced by any other value \psi_{0} , or if the model is wrong, suggesting a route to assessment of model adequacy via the empirical behaviour of U_{1}(\psi_{0}),\ldots,U_{m}(\psi_{0}) for a postulated value \psi_{0} , which are the idealised analogues of residuals. Since some postulated values \psi_{0} may produce a distribution for U_{1}(\psi_{0}),\ldots,U_{m}(\psi_{0}) that is hard to distinguish from a standard uniform sample even when the model is violated, it is sensible for sufficiently large m to replace \psi_{0} by the value returned by a consistent estimator \hat{\psi} . In this example, the transformed random variables Z_{j}=Y_{j1}/Y_{j0} are, under the model, identically distributed with density function f_{Z}(z;\psi^{*})=\frac{\psi^{*}}{(1+\psi^{*}z)^{2}}. (2) Since ( 2 ) is free of all the pair-specific nuisance parameters, inference on \psi^{*} can be constructed from a likelihood function based on ( 2 ), the resulting maximum-likelihood estimator being consistent as m\rightarrow\infty . The approach of replacing \psi^{*} by \hat{\psi} in U_{1}(\psi^{*}),\ldots,U_{m}(\psi^{*}) is formally justified through an application of Proposition 2.1 in § 2.3 . ∎ Example 1.1 replaces the usual semiparametric approach of assessing prediction error after regularised estimation by an in-sample assessment based on the structure of the postulated model, avoiding, without sample splitting, any post-selection model inference issues that would arise from using the same sample to choose tuning parameters and to assess the model. Section