Dynamic Mini–Max Design and Sequential HB Inference for Repeated Surveys

Siu-Ming Tam · 2026

Read Dynamic Mini–Max Design and Sequential HB Inference for Repeated Surveys by Siu-Ming Tam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03702.txt.

Introduction

Tam builds a dynamic mini-max framework for repeated surveys that must track levels and change. Repeated surveys need precision for both current levels and movements between waves. Sample size and wave overlap are chosen jointly in the design. A sequential hierarchical Bayes update then carries inference across waves. Limits on respondent burden and fieldwork budget bind the design.

Illustration uses 2021 Australian Census data as wave one, with simulated later waves. Both the new design and a classical design start from the same 42,018-unit allocation. The new design trims that to 40,251 units while meeting all precision targets. Cost falls by about 6 percent. Level coverage stays comparable between the designs. Movement coverage splits them: the new design hits 100 percent across all cells. The classical design reaches only 82 to 96 percent. Its intervals understate movement uncertainty by ignoring model variance.

Catalog record

CREATORSiu-Ming Tam
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03702

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamic Mini–Max Design and Sequential HB Inference for Repeated Surveys Siu-Ming Tam Abstract This paper develops a Dynamic Mini-Max (DMM) framework for repeated surveys comprising a Dynamic Mini-Max Design and a Sequential Hierarchical Bayes Update (SHBU). The DMM jointly optimises sample size and wave overlap subject to simultaneous precision constraints for levels and movements, a respondent burden limit and a fieldwork budget. The methods are illustrated using 2021 Australian Census data ( t = 1 t=1 ) and simulated waves t = 2 , 3 , 4 t=2,3,4 . Both the DMM and the classical design start from the same 5% proportional allocation of n A = 42,018 n^{A}=42{,}018 units. The DMM reduces this to n ∗ = 40,251 n^{*}=40{,}251 while meeting all precision constraints, achieving a cost saving of approximately 6.3%. Level coverage is comparable between the two designs (maximum absolute relative error (MARE) ratio 0.844–1.263). Movement coverage diverges markedly: the DMM achieves 100% across all 27 domain-variable cells while the classical design achieves only 82%–96% (87.5%–95.0% nationally). The classical confidence interval understates movement uncertainty because it addresses sampling variance only and does not account for the model variance component V ^ mod \hat{V}_{\mathrm{mod}} . Additional benefits of the DMM framework — coherent joint inference for levels and movements, sequential updating without ad hoc composite estimator chaining, and small area estimation — are outlined in the paper. 1 Introduction It is customary for national statistical offices (NSOs) to produce reliable estimates not only of levels at each wave, but also of movements over time for key indicators such as employment, unemployment, labour force participation, retail sales and other economic and social measures in repeated surveys. While cross-sectional surveys primarily focus on estimating the level of a characteristic at a single point in time, repeated surveys additionally require the accurate estimation of movement between successive waves. This introduces an additional design challenge because the precision of movement estimates depends not only on the sample size at each wave, but also on the degree of sample overlap between waves. Tam 2026a showed that combining multivariate Bethel ( Bethel 1989 ) allocation with Hierarchical Bayes (HB) small area models can substantially reduce survey sample sizes while maintaining domain-level precision and near-nominal interval coverage. That framework, the Mini-Max framework, addressed a single cross-sectional survey and focused on determining the minimum sample size required to satisfy precision requirements simultaneously across multiple variables and domains. In practice, however, many major surveys conducted by NSOs operate continuously through monthly, quarterly or annual cycles. Such surveys require a framework that extends beyond static sample allocation and incorporates the temporal evolution of the population. Repeated surveys have been studied extensively in both the design-based and model-based literature. The studies cited here represent only a small subset of a much broader body of work, including methods for estimating movement from overlapping samples and frameworks that exploit temporal dependence across waves. Within the classical survey sampling literature, Patterson 1950 developed foundational theory for sampling on successive occasions with partial replacement and established covariance relationships between estimates across waves. Rao and Graham 1964 extended these ideas to multi-occasion rotation designs, while Bailar 1975 documented the practical implications of rotation group bias in panel surveys. Cochran 1977 provides the standard textbook treatment of successive sampling and overlap. More recent developments increasingly exploit model-based frameworks for repeated surveys and small area estimation. Tam 1987 proposed a dynamic linear model framework for repeated surveys using state-space methods and maximum likelihood estimation. That framework focused on retrospective estimation of level trajectories from completed survey data; it did not address prospective design of sample sizes and overlaps, nor did it incorporate small area estimation or movement SE constraints. State-space approaches for modelling temporal dependence are discussed extensively by Harvey 1989 . Pfeffermann and Burck 1990 and Rao and Yu 1994 developed approaches combining cross-sectional and time-series information for small area estimation, while Pfeffermann 2003 reviewed broader developments and emerging directions in model-based small area estimation. Rao and Molina 2015 provide a comprehensive treatment of model-based and time-series approaches for small area estimation. The present paper builds on this foundation to address a complementary but distinct problem: prospective design rather than retrospective estimation. Given the information from wave t-1 , what sample size n_{h,t} and overlap m_{h,t} should be chosen for wave t to minimise fieldwork cost while meeting precision requirements for both levels and movements across all domains and variables, subject to respondent burden and budget constraints? This problem is distinct from the existing literature in the following sense. Patterson 1950 and Rao and Graham 1964 provide optimal overlap formulae for classical rotation designs, but treat the total sample size as given and do not incorporate model-based precision. Composite estimation methods ( Cochran 1977 ) exploit wave-to-wave overlap for estimation but do not address prospective design. Rao and Yu 1994 and Pfeffermann and Burck 1990 use state-space and time-series models for small area estimation in repeated surveys, but do not jointly optimise the design variables (n_{h,t},m_{h,t}) . The DMM framework addresses all three limitations simultaneously: it uses a Bayesian state-space model for estimation, treats (n_{h,t},m_{h,t}) as joint decision variables, and produces coherent uncertainty quantification for both levels and movements. To address this problem, we extend the Mini-Max framework from a static cross-sectional setting to a repeated-survey setting through a dynamic HB state-space framework comprising a sampling model, a linking model and an AR(1) propagation model. The propagation model acts as the prior distribution for the subsequent wave, allowing information from earlier waves to be carried forward through a Sequential Hierarchical Bayes Update (SHBU). Rather than treating survey waves independently, posterior uncertainty is propagated sequentially across waves. Several extensions are required to move from the cross-sectional framework to the repeated-survey setting. First, the static framework is replaced by a sequential wave-by-wave updating structure that reflects the operational reality of ongoing surveys where future observations are unavailable at the time of design. Second, the DMM framework is formulated at the stratum level while supporting domain-level publication requirements and retaining consistency with the multivariate allocation strategy described in Tam 2026a . Finally, sample overlap m_{h,t} is treated as an explicit design variable rather than a fixed operational parameter. The key contribution of this paper is the development of a DMM framework for repeated surveys that enables coherent Bayesian inference and joint optimisation of sample size and overlap. The DMM framework comprises two integrated components: a DMM Design that determines the optimal sample sizes and overlap fractions at each wave, and a SHBU that propagates posterior uncertainty across waves. The original Mini-Max framework of Tam 2026a identified the smallest sample satisfying level CV precision constraints using HB models for a single cross-sectional wave. The present paper extends this to repeated surveys by adding movement SE constraints, wave overlap as an explicit joint decision variable, and sequential wave-by-wave updating. The two papers address different constraint sets — Tam 2026a imposes level CV constraints only, while the present paper additionally imposes movement SE constraints — so direct comparison of achieved sample reductions is not meaningful. The central result is that the DMM, starting from the same 5% proportional allocation as the classical design ( n^{A}=42{,}018 ), reduces the required sample to n^{*}=40{,}251

Read the complete text