Spatial Dependence in the Self-Response: Spatial Dependence, Modeling, and Operational Consequences

Emanuel Ben-David · 2026

Read Spatial Dependence in the Self-Response: Spatial Dependence, Modeling, and Operational Consequences by Emanuel Ben-David (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30816.txt.

Introduction

Emanuel Ben-David examines the United States Census Bureau's Low Response Score, a planning score that flags neighbourhoods likely to need extra outreach in the census. The published score is built transparently from tract-level variables by ordinary least squares. Ben-David asks how much spatial structure remains after those variables have done their work, and what form it takes.

Using the 2010 mail non-return rate for over seventy-one thousand census tracts, he compares the family of spatial regression models. Ordinary least squares left strong residual spatial autocorrelation. Diagnostics said the leftover dependence was error-type, not a process where one tract's response drags its neighbours'. The best in-sample model by information criteria generalised worst under spatial-block validation. Error-family models generalised best. The middle-ground model absorbs the spatial leftovers while treating neighbourhood demographics as local spillovers, and the conclusions survived robustness checks.

Catalog record

CREATOREmanuel Ben-David
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.30816

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Spatial Dependence in the Self-Response: Spatial Dependence, Modeling, and Operational Consequences Emanuel Ben-David Abstract The U.S. Census Bureau’s Low Response Score (LRS) is a central planning instrument for identifying places likely to require additional self-response outreach and nonresponse follow-up. The published LRS is intentionally interpretable: it is built from tract-level covariates using an ordinary least squares specification. That transparency, however, leaves open an important question for official statistics: how much spatial structure remains after the own-tract covariates have done their work, and what form does that structure take? Using the observed 2010 Census mail non-return rate for 71,076 U.S. census tracts and the twenty-five Erdman–Bates LRS predictors, this paper compares the full spatial autoregressive model family under queen-contiguity weights and validates the leading candidates with both random and spatial-block cross-validation. OLS leaves strong residual spatial autocorrelation ( I = 0.399 I=0.399 ). Formal diagnostics and model comparisons indicate that the remaining dependence is primarily error-type rather than a global endogenous lag process. Although the spatial Durbin model minimizes in-sample AIC, spatial-block validation reverses that ranking: the error-family models (SEM/SDEM) generalize best, while the AIC-best SDM is weakest out of sample. The SDEM provides an interpretable middle ground, absorbing residual spatial dependence while representing neighborhood demographic effects as local spillovers. Robustness checks show that these conclusions are invariant to the weights definition and are not an artifact of tract-size-driven heteroskedasticity. The results suggest that LRS-style response models should be evaluated with spatial validation, not only in-sample fit, and that local neighborhood context can be operationally meaningful without invoking a global response-contagion mechanism. Keywords: Low Response Score; census self-response; spatial econometrics; spatial cross-validation; survey operations; official statistics. 1 Introduction National statistical agencies use response-propensity models to decide where limited outreach, partnership, and field resources should be concentrated. In a decennial census, even small improvements in identifying places likely to self-respond at low rates can affect cost, staffing, and coverage. This is the setting in which the U.S. Census Bureau developed the Low Response Score (LRS), a tract- and block-group-level planning measure designed to locate, predict, and manage hard-to-survey populations ( Erdman and Bates 2017 ) . The score’s value lies partly in its transparency: unlike many high-performing machine-learning entries in the Census return-rate prediction challenge, the LRS is a reproducible ordinary least squares model built from a fixed set of Planning Database predictors. Transparency does not remove spatial dependence. Census tracts are embedded in shared housing markets, transportation systems, media markets, local government contexts, and histories of civic participation. Adjacent tracts can therefore have similar response behavior even after own-tract demographic and housing characteristics are controlled. For an operational score, this matters in two ways. First, residual spatial autocorrelation can make conventional inference too optimistic. Second, if the remaining spatial structure is substantively interpretable, the score may be missing neighborhood information that outreach programs could use. A tract may be easier or harder to count not only because of its own characteristics, but because of the surrounding context in which those characteristics are embedded. This paper asks whether the residual structure left by the LRS-style OLS specification is spatial, what spatial process best describes it, and whether the resulting models improve prediction under validation designs that mimic operational deployment. The distinction between spatial mechanisms is central. A spatial lag model implies global response spillovers: a tract’s outcome depends on neighboring outcomes and changes propagate through (I-\rho W)^{-1} . A spatial error model instead treats the dependence as unobserved spatially correlated context. A spatial Durbin error model (SDEM) adds local neighbor-covariate effects while keeping the dependence in the error. These alternatives have very different interpretations for an official statistical agency: the first suggests response contagion, the second omitted regional context, and the third local neighborhood composition. The paper makes four contributions. First, it evaluates the original LRS covariate set against the observed mail non-return outcome rather than against the published LRS fitted value, avoiding an algebraic exercise in reproducing the original OLS score. Second, it applies the nested spatial autoregressive model family to a national tract-level response outcome and uses formal diagnostics to distinguish lag, error, and Durbin mechanisms. Third, it shows that spatial-block validation can overturn the in-sample information-criterion ranking: the AIC-best spatial Durbin model does not generalize best to withheld geography. Fourth, it separates point-estimate robustness from inference under tract-size-driven heteroskedasticity, a practical concern for rates built from heterogeneous tract populations and ACS-derived predictors. The analysis is anchored to the 2010 mail non-return outcome because that is the outcome on which the published Erdman–Bates LRS was defined and the only setting in which the twenty-five original predictors, their transformations, and the official score can be compared without changing the estimand. The contemporary Planning Database now includes a 2020-based Low Response Score that reflects a broader self-response environment, including internet response and contact-strategy changes ( U.S. Census Bureau 2026 ) . That evolution makes the present exercise more, not less, important: before extending the score to new modes and vintages, it is useful to know what kind of spatial dependence is left by the interpretable tract-level model in the original LRS setting. The conclusion returns to how the same validation design should be applied to the 2020-based score. The remainder of the paper is organized as follows. Section 2 describes the data, outcome, spatial weights, model family, and validation design. Section 3 reports the specification search, impact decomposition, validation results, and robustness checks. Section 4 discusses the contribution, limitations, and implications for future LRS revisions. 2 Data, Models, and Validation Design The Low Response Score ( Erdman and Bates 2017 ) is estimated by ordinary least squares (OLS) on twenty-five tract-level predictors drawn from the Planning Database. Because the predictors and the published score are deterministic functions of one another, this paper models the observed 2010 mail non-return rate directly, on the logit scale, so that a residual exists that can carry spatial structure. Throughout, y_{i}=\operatorname{logit}(\text{non-return}_{i}) for the n=71{,}076 tracts of the United States (the fifty states and the District of Columbia, including Alaska and Hawaii), X collects the Erdman–Bates predictors with their published transformations, and W is the row-standardized queen-contiguity weights matrix. The analytic sample contains the tracts for which the observed mail non-return rate and all twenty-five LRS predictors are available. Tracts with zero or suppressed denominators, missing ACS inputs, or incompatible geography are excluded. The predictors retain the Erdman–Bates transformations so that the spatial specifications isolate the contribution of spatial structure rather than a redesigned covariate set. We compare OLS with the standard spatial autoregressive lattice: the spatial lag of X (SLX), the spatial lag model (SLM), the spatial error model (SEM), the spatial Durbin model (SDM), the spatial Durbin error model (SDEM), and the combined lag-and-error model (SARAR). The general form is y=\rho Wy+X\beta+WX\theta+u,\qquad u=\lambda Wu+\varepsilon, with restrictions on \rho , \theta , and \lambda defining each named model. The primary weights matrix uses row-standardized queen contiguity, so Wy and WX are neighbor averages. A k=8 nearest-neighbor matrix provides a robustness check that removes variation in graph degree. Model choice is evaluated in three stages. First, Moran’s I and robust Rao-score diagnostics are applied to the OLS residuals to identify whether the remaining dependence is lag- or error-type.

Read the complete text