Smooth Sailing: Lipschitz-Driven Uncertainty Quantification for Spatial Association
David R. Burt, Renato BerlinghieriStephen BatesTamara BroderickMIT LIDS {dburt,renb,s_bates,tamarab}@mit.edu · 2025
Read Smooth Sailing: Lipschitz-Driven Uncertainty Quantification for Spatial Association by David R. Burt, Renato BerlinghieriStephen BatesTamara BroderickMIT LIDS {dburt,renb,s_bates,tamarab}@mit.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-06067.txt.
Introduction
David Burt, Renato Berlinghieri, Stephen Bates, and Tamara Broderick build honest error bars for spatial health and environment studies, in a 2025 paper. Officials often need an association, say between air pollution and illness, not just a prediction. Standard machine learning predicts well but says little about such links. Worse, the authors show existing interval methods can miss their promised coverage when the model is wrong and locations are not random, the normal case in spatial work.
Their method constructs frequentist confidence intervals that stay valid under minimal assumptions, driven by how smoothly the association can vary. Policy built on a spurious pollution effect, or a missed real one, is expensive either way. Trustworthy intervals are the difference between evidence and decoration.
Catalog record
| CREATOR | David R. Burt, Renato BerlinghieriStephen BatesTamara BroderickMIT LIDS {dburt,renb,s_bates,tamarab}@mit.edu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-06067
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Smooth Sailing: Lipschitz-Driven Uncertainty Quantification for Spatial Association David R. Burt, Renato BerlinghieriStephen BatesTamara BroderickMIT LIDS {dburt,renb,s_bates,tamarab}@mit.edu Abstract Estimating associations between spatial covariates and responses — rather than merely predicting responses — is central to environmental science, epidemiology, and economics. For instance, public health officials might be interested in whether air pollution has a strictly positive association with a health outcome, and the magnitude of any effect. Standard machine learning methods often provide accurate predictions but offer limited insight into covariate-response relationships. And we show that existing methods for constructing confidence (or credible) intervals for associations fail to provide nominal coverage in the face of model misspecification and distribution shift — despite both being essentially always present in spatial problems. We introduce a method that constructs valid frequentist confidence intervals for associations in spatial settings. Our method requires minimal assumptions beyond a form of spatial smoothness. In particular, we do not require model correctness or covariate overlap between training and target locations. Our approach is the first to guarantee nominal coverage in this setting and outperforms existing techniques in both real and simulated experiments. 1 Introduction Scientists and social scientists often seek to understand the direction and magnitude of associations in settings where variables vary spatially. And since these associations are often used to inform policy, communicating uncertainties is crucial. Example associations of interest include the relationship between aerosol concentrations and regional precipitation changes [ 70 ] , the link between proximity to major highways and the prevalence of dementia [ 32 ] , and the link between air pollution exposure and birth weight [ 31 ] . In each case, the covariates (e.g., aerosol concentrations, proximity to highways, and air pollution) may be viewed as functions of spatial location. Moreover, scientists often have data at some spatial locations but want to infer associations at others. For instance, a country might measure birth weight and air pollution at the municipal level for some municipalities and wish to understand their relationship in municipalities without data. A priori, we might expect a nonlinear relationship between air pollution (as a covariate) and birth weight (as the response). A natural idea is to fit a flexible model — such as a (deep) Gaussian process [ 49 , 13 ] , transformer [ 64 , 30 ] , or XGBoost [ 10 ] . These methods can achieve high predictive accuracy, but the methods on their own often lack interpretability and do not immediately yield conclusions about covariate-response associations [ 52 , 15 ] . Researchers have proposed a number of post hoc interpretability methods, such as Shapley values [ 56 , 35 ] , LIME [ 50 ] , partial dependence plots [ 18 ] and Accumulated Local Effects plots [ 3 ] . These methods work directly with the fitted model and can be used to describe associations between individual covariates and model predictions. And because they are interpreting the fitted model (rather than the response itself), there is no need (or mechanism) to quantify uncertainties due to insufficient data. When the fitted model closely approximates the true response, one can view the output of these interpretability methods as describing the relationship between the covariates and response. In many applications (e.g., in engineering, advertising, and marketing), the available data often contains enough information to be confident that the highly flexible machine learning model approximates the response everywhere of interest. Conversely, in many applications in the sciences and social sciences (such as those cited above), there is often insufficient data to confidently fit a nonparametric or high-dimensional model closely to the true (latent) response everywhere relevant. In particular, in many spatial problems, there is often not enough information for a flexible method to reconstruct the response well in many spatial locations of interest. Nonetheless, we might think there could still be sufficient data to capture associations — and, by quantifying uncertainty, we can check our confidence in any conclusions. The discrepancy between applications that are data-rich and data-poor in this sense can help explain the phenomenon observed by Rudin, 2019 : that post hoc approximations of black-box models may be worse than fitting interpretable models directly. For example, as illustrated in a real-life recidivism case, a linear model used to approximate a black-box model can seriously misrepresent key relationships — including that between race and recidivism. It remains to choose an appropriate interpretable model (rather than post hoc method) and quantify its uncertainty. Buja et al., 2019 demonstrated that (directly-fit, not post hoc) linear models can be used to interpretably summarize associations even in the face of potentially nonlinear relationships. The estimated parameters provide a best guess of association trends, and confidence intervals reflect uncertainty. And even in cases where data is sparse in the locations we are interested in, we might hope that we can learn simple linear associations between the covariate and response. These capabilities help explain why, despite known misspecification, linear models remain widely used. All of the applied studies cited above use linear regression. Moreover, Castro Torres and Akbaritabar, 2024 surveyed quantitative methods in papers up to 2022 and found that over half of those in fields such as agricultural science, social sciences, and health sciences reported results from a linear model. However, providing valid confidence intervals in this setting remains an open challenge. We are interested in the common scenario where the linear model is misspecified, and inference is needed at spatial locations that differ from those in the observed data. Under misspecification, Buja et al., 2019 notes that the ordinary least squares (OLS) estimator depends on the covariate values, and classical confidence intervals are valid only at the observed (training) locations. The sandwich estimator [ 27 , 71 , 72 , 7 ] offers valid intervals under misspecification, but only if all covariates are drawn from a single distribution. Generalized least squares (GLS) regression [ 2 ] is designed to handle spatial correlation in residuals [ 11 , pp. 22–24] , but it does not address the bias introduced by misspecification and distribution shift. Bayesian spatial models, such as those based on Gaussian processes, are also common, but their credible intervals tend to underestimate uncertainty in the presence of both misspecification and distribution shift [ 68 , 39 ] . Finally, importance weighting methods [ 57 ] face two issues: (1) They assume one is able to debias the estimator, which need not be true, and (2) the validity of the confidence interval relies on perfectly estimated importance weights — an unrealistic assumption. We discuss these and related approaches in more detail in Appendix A . In what follows, we show through real and simulated experiments ( Section 4 ) that all of the aforementioned methods can yield coverage far below the nominal level. Our principal contribution is to introduce the first method for constructing confidence intervals in spatial linear regression that guarantees frequentist coverage at the nominal level (a) under nonparametric assumptions on the data-generating distribution and (b) when the target locations differ from the observed ones. We are able to account for misspecification and covariate shift simultaneously by making more spatially appropriate assumptions than prior work. In particular, prior work relies on a (spatially inappropriate) assumption