Sampling distributions for complex design variance estimators in a Fay-Herriot model

2026

Read Sampling distributions for complex design variance estimators in a Fay-Herriot model (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23029.txt.

Introduction

McGovern, Fuglstad, and Wakefield derive sampling distributions for design variance estimators in a Fay-Herriot model for complex surveys. Standard chi-squared distributions hold only under strong population and design assumptions, an understudied choice for stratified two-stage clustering in Demographic and Health Surveys. They derive simple and complex distributions under that design, stating required assumptions clearly. Simulations show the standard undercovers, while variance smoothing gives better credible intervals, and the simple distribution matches the complex one. Height-for-age estimates from the 2022 Kenya survey illustrate them.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88101
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23029

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sampling distributions for complex design variance estimators in a Fay-Herriot model Abstract Fay-Herriot (FH) models with variance smoothing typically use chi-squared sampling distributions for the design variance estimators. This choice is only valid under strong assumptions on the population and the sampling design, and the choice of sampling distribution is understudied for complex survey designs such as the stratified two-stage clustering design used by the Demographic and Health Surveys (DHS). DHS conducts surveys in low- and middle-income countries and result in low sample sizes for unplanned domains of interest. Thus, accounting for the uncertainty in the estimated design variances is important. We derive two sampling distributions under the DHS design, a simple and a more complex, while clearly specifying and discussing the required superpopulation and design assumptions. In a simulation study, we compare the two sampling distributions to the empirical sampling distributions, and the resulting FH models with variance smoothing to the standard FH model. We find that the standard model exhibits undercoverage, while the variance smoothing models produce better credible intervals according to proper scoring rules. Interestingly, the simple sampling distribution, which is easiest to implement, performs equally as well as the more complex sampling distribution. We illustrate the proposed models by estimating height-for-age z-scores using the 2022 Kenya DHS. Alana McGovern 1∗ , Geir-Arne Fuglstad 2 , and Jon Wakefield 1,3 1 Department of Statistics, University of Washington 2 Department of Mathematical Sciences, Norwegian University of Science and Technology 3 Department of Biostatistics, University of Washington ∗ Corresponding author, [email protected] Keywords: Bayesian small area estimation, variance smoothing, complex surveys 1 Introduction The Fay-Herriot area-level model is a common choice for small area estimation (SAE) because it accounts for the design by modeling survey-weighted estimates and enables borrowing of information across areas through covariates and random effects, which often increases precision and is particularly beneficial when areas have little or no data ( 7 ). In the sampling model for weighted means, the variances of the weighted mean estimators are assumed to be known, but in practice, estimates of these variances are used. A common estimator of this variance is obtained via Taylor linearization ( 38 , chap. 6; 14 , chap. 2.4; 23 , chap. 5.5; 15 , chap. 9.1). While such estimators are design-consistent, they can be imprecise, particularly when sample size is small. A less-considered detriment is the tendency for this variance estimator to have downward bias for small sample sizes ( 23 , p. 176; 15 , p. 369). As a result, taking variance estimates as known in the Fay-Herriot model can result in interval estimates which are not only imprecise, but have systematic undercoverage for small sample sizes. This work is motivated by the challenges posed by estimating small area means using survey data in low- and middle-income countries (LMICs). The major surveys conducted in LMICs, particularly the Demographic and Health Surveys (DHS) ( 13 ) and Multiple Indicator Cluster Surveys (MICS) ( 31 ), use stratified two-stage cluster designs where at the first stage a fixed number of clusters are sampled from each stratum using probability proportional to size (PPS) sampling, and at the second stage a fixed number of households are sampled from each cluster. These strata are generally chosen to be the first administrative (Admin-1) areas crossed with urban and rural classification, resulting in data which is powered to provide reliable survey-weighted estimates at the Admin-1 level. This design makes estimation for unplanned domains, for example, second administrative (Admin-2) areas, challenging because data is sparse. As an example, Figure 1 maps the number of clusters sampled from Admin-1 and Admin-2 areas in the 2022 Kenya DHS ( 12 ). Design-based estimation for the 47 Admin-1 areas is feasible, as they are planned domains with an average of 36 clusters sampled per area. On average, 1.76\% of rural clusters and 3.8\% of urban clusters in each Admin-1 area are sampled. While the number of urban and rural clusters sampled from each Admin-1 area is fixed under the survey design, the number of clusters sampled from each Admin-2 area is random. In this survey, 6 out of Kenya’s 300 Admin-2 areas have no sampled clusters and 127 have less than five sampled clusters. As a result, there are several areas for which weighted mean estimates cannot be obtained and many for which estimates are imprecise or have unstable variance estimates. Figure 1: Number of sampled clusters in each Admin-1 and Admin-2 area in the 2022 Kenya DHS. Admin-2 areas with less than 5 sampled clusters are marked by hatching and areas with no sampled clusters are filled in gray. For example, consider the estimation of average height-for-age z-score (HAZ) for children under 5. The HAZ measures how many standard deviations a child’s height is from the median height for children of the same sex and age, using median and standard deviations from the 37 . This measure is useful to evaluate child nutritional status relative to the international population. Reducing the rate of stunting, defined as a HAZ below -2 , is one of the Sustainable Development Goals (SDGs) targeting malnutrition ( 32 ). In Figure 2 we map the design-based mean and standard deviation estimates for HAZ for children under 5, using the Kenya 2022 DHS. We observe notable between-area variation at the Admin-1 and Admin-2 levels. In this context it is particularly detrimental to use a Fay-Herriot model at the Admin-2 level which assumes the variances of the weighted estimates are known, as data sparsity makes variance estimates more unstable. Figure 2: Design-based mean and standard deviation estimates for HAZ at the Admin-1 and Admin-2 levels using 2022 Kenya DHS. There is a vast literature concerning how variance estimates may be adjusted or have their uncertainty accounted for. When the outcome of interest is a proportion or total, one common strategy is to use a generalized variance function (GVF), which exploits the mean-variance relationship assumed under a binomial distribution ( 33 ; 38 , chap. 7; 14 , chap. 5.6; 15 , chap. 9.4). However, in the case of continuous outcomes, justifying any particular choice of GVF becomes difficult, as there is not a clear mean-variance relationship to exploit. Some work has been done by the US Bureau of Labor Statistics to use GVFs for time series analyses of continuous outcomes ( 3 ; 18 ), but this requires frequent, data-rich surveys. Another common strategy is to jointly model the mean and variance, so that the uncertainty of the variance estimate is taken into account. This strategy requires specifying a sampling distribution for the design variance estimator. Previous work, including 40 , 17 , 29 , 6 , and 20 , assume that the survey is a stratified simple random sample with each area of interest, i , being a stratum, and assume individual outcomes within each stratum are identically and independently distributed (IID) normal. These assumptions result in the variance estimator, \hat{V}_{i} , having the sampling distribution V_{i}/\mathrm{df}_{i}\times\chi^{2}_{\mathrm{df}_{i}} , where V_{i} is the true design variance and the degrees of freedom ( \mathrm{df}_{i} ) are equal to the sample size minus one. 9 modify this sampling distribution to account for a stratified cluster sampling design by using the appropriate nominal

Read the complete text