Post-Hoc Inference of Cross-Classified Statistics from Hierarchical Bayes Survey Weights

Siu-Ming Tam · 2026

Read Post-Hoc Inference of Cross-Classified Statistics from Hierarchical Bayes Survey Weights by Siu-Ming Tam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25381.txt.

Introduction

Tam extends his 2026 small-area frame to cross-classified stats from HB records. He adds PHIE, a Post-Hoc Inference Engine carrying HB-draw uncertainty to any cross-tab. PHIE turns MCMC draws through chi-square tuning into replicate weights, giving intervals in three tiers. Tier 1-E cells match tuning totals, giving exact intervals. Tier 2 cells gain near-nominal coverage via a Calibrated Bayes interval. Tier 3-NCV cells use a ratio interval tied to a linked variable. Cross-tab uncertainty comes most from sampling swings, and variation stays within bounds.

Catalog record

CREATORSiu-Ming Tam
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62353
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.25381

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Post-Hoc Inference of Cross-Classified Statistics from Hierarchical Bayes Survey Weights Siu-Ming Tam Abstract Tam 2026 shows that combining Bethel multivariate allocation with Hierarchical Bayes (HB) small area models can substantially reduce survey sample sizes while maintaining domain-level precision and near-nominal coverage of posterior credible intervals (CrIs). This paper extends that framework to cross-classified statistics derived from HB-calibrated unit record data. Its central contribution is a Post-Hoc Inference Engine (PHIE) that propagates uncertainty from HB domain posterior draws to arbitrary cross-tabulations. PHIE transforms each MCMC draw via chi-square calibration to produce replicate survey weights, from which CrIs are obtained. Three tiers of statistics are identified. Tier 1-E cells reproduce calibration totals and yield exact posterior CrIs. Tier 2 cells involve filtered sums of calibration variables; PHIE alone undercovers, but a Calibrated Bayes interval (CBI), augmenting PHIE with design-based compositional variance, restores near-nominal coverage. Tier 3-NCV cells involve non-calibration variables; a ratio-based CBI linked to a correlated calibration variable achieves reliable coverage even under weak correlation. A key empirical finding is that uncertainty in cross-tabulations is driven primarily by compositional sampling variability rather than HB model uncertainty. Resulting CBI-based coefficients of variation remain within standard publication thresholds. Keywords: Calibration; Calibrated Bayes intervals; Credible intervals; Cross-tabulation; Hierarchical Bayes; Replicate weights. 1 Introduction Tam 2026 showed that a survey sample can be reduced substantially by combining Bethel multivariate allocation with Hierarchical Bayes (HB) small area modelling. In that framework, the HB model produces posterior totals for a set of target variables, and the final mini-max sample is chosen so that national and domain precision requirements continue to be met. That earlier paper deals with the design and model-based estimation problem. The present paper deals with the next operational problem. Once the reduced survey has been fielded, an NSO will not publish only the target variables used in the HB model. It will usually release a weighted unit record file and produce many cross-classified tables: for example, employment by age group, employment by occupation, hours worked by domain, income by employment status, or health status by occupation. These tables are often constructed after the survey design and model fitting have been completed. They may involve variables that were not part of the HB calibration system. The question is therefore not how to reduce the sample size, but how to make valid statistical inference for cross-classified statistics derived from an HB-calibrated unit record file. This is the central problem addressed in this paper. Point estimation is relatively straightforward: one can construct survey weights so that the weighted sums of the HB calibration variables agree with the corresponding HB posterior estimates. The more difficult issue is uncertainty. If the HB posterior uncertainty is not propagated to the derived cross tabulations, the published table may look precise simply because it is based on a calibrated point estimate. This would understate the true uncertainty. Conversely, if the posterior draws are propagated mechanically without recognising the relationship between the cross-classified cell and the HB calibration variables, the resulting credible intervals may have poor repeated-sampling coverage. The paper introduces the Post-Hoc Inference Engine (PHIE) to address this problem. For each MCMC draw of the HB posterior domain totals, PHIE performs a chi-square calibration of the original survey weights to that draw. This produces a corresponding set of posterior-calibrated replicate weights. Applying these replicate weights to any cross-classified statistic gives an empirical posterior distribution for that statistic. The empirical quantiles of this distribution provide a credible interval when the statistic is directly supported by the HB calibration system, and a quasi-posterior interval otherwise. A key contribution of the paper is to show that not all cross tabulations have the same inferential status. The paper therefore develops a three-tier taxonomy. Tier 1-E cells exactly reproduce one of the HB posterior calibration totals and therefore inherit exact posterior credible intervals. Tier 2 cells sum a calibration variable over a filter. These cells are closer to the calibration system, but the uncorrected PHIE interval can still undercover; a CBI is therefore developed to restore repeated-sampling coverage. Tier 3-NCV cells involve a non-calibration outcome variable. For these cells, the paper proposes a ratio-estimator CBI, linking the non-calibration variable to the calibration variable most strongly associated with it. The contribution of the paper is thus not the two-stage sample reduction method itself. That is the subject of Tam 2026 . The contribution here is the post-hoc inference machinery needed after such a survey has been conducted: posterior-calibrated replicate weights, credible intervals for calibration-supported cross tabulations, CBI corrections for partially supported cross tabulations, and a ratio-estimator CBI for non-calibration variables. The methods are illustrated using Australian 2021 Census microdata, where population truth is available and Monte Carlo coverage can be assessed directly. The remainder of the paper is organised as follows. Section 2 summarises the HB survey framework from Tam 2026 and establishes notation. Section 3 develops the PHIE methodology, proves the calibrated-weight and replicate-weight propagation results, and introduces the tier taxonomy. Section 4 presents empirical results for all cell types. Section 5 concludes with recommendations for NSO publication practice. 2 The HB Survey Framework 2.1 Setting and Notation Let \mathcal{U}=\{1,\ldots,N\} denote a finite population of N units partitioned into H non-overlapping strata indexed h=1,\ldots,H , with stratum sizes N_{1},\ldots,N_{H} . A stratified simple random sample of size n_{h} is drawn without replacement from stratum h , giving total sample size n=\sum_{h}n_{h} . The sample is denoted \mathcal{A} , with Horvitz–Thompson (HT) weights w_{i}=N_{h}/n_{h} for unit i in stratum h . The population is partitioned into D geographic domains d=1,\ldots,D . There are V target variables v=1,\ldots,V , each with a domain-level precision target \mathrm{CV}\leq g_{d,v} . For each record i\in\mathcal{A} , define the calibration design vector by stacking V blocks of dimension D : \bm{y}_{i}=\bigl(y_{i}^{(v,d)}\bigr)_{v=1,\ldots,V;\;d=1,\ldots,D}\;\in\;\mathbb{R}^{p},\qquad p=V\times D, where y_{i}^{(v,d)}=y_{i}^{(v)}\cdot\mathbf{1}(i\in d) is the scalar value of target variable v for unit i if i belongs to domain d , and zero otherwise. Here y_{i}^{(v)}\in\mathbb{R} denotes the raw scalar measurement of variable v for unit i without domain interaction; since each unit belongs to exactly one domain, exactly one entry in each v -block of \bm{y}_{i} is non-zero. In the numerical example of Section 4.1, V=3 , D=8 , p=24 . Example . To make the definition concrete, consider a person i who resides in NSW ( d=1 ), is employed ( y_{i}^{(1)}=1 ), not unemployed ( y_{i}^{(2)}=0 ), and works 38 hours per week ( y_{i}^{(3)}=38 ). The calibration design vector \bm{y}_{i}\in\mathbb{R}^{24} has three non-zero entries: \bm{y}_{i}=\underbrace{(1,\,0,\,0,\,0,\,0,\,0,\,0,\,0)^{\top}}_{\text{Var1 block}\;\in\;\mathbb{R}^{8}}\!\!\oplus\!\!\underbrace{(0,\,0,\,0,\,0,\,0,\,0,\,0,\,0)^{\top}}_{\text{Var2 block}\;\in\;\mathbb{R}^{8}}\!\!\oplus\!\!\underbrace{(38,\,0,\,0,\,0,\,0,\,0,\,0,\,0)^{\top}}_{\text{Var3 block}\;\in\;\mathbb{R}^{8}}, where within each V -block the entry corresponding to the person’s domain ( d=1 , NSW) carries the variable value and all other domain entries are zero. 2.2 Two-Stage Strategy: Bethel Allocation and HB Reduction Tam 2026 establishes a two-stage strategy to reduce the operating cost of surveys without sacrificing precision. Stage 1 uses the R2BEAT package ( Falorsi et al. 2021 ) to solve the Bethel multivariate constrained optimisation ( Bethel 1989 ) , finding the minimum total sample n^{*} satisfying national CV targets of 3\% and domain CV targets of 8\% for all V\times D variable–domain combinations simultaneously, replacing the common NSO practice of computing Neyman allocations separately per variable and taking the element-wise maximum —

Read the complete text