A reduced rank model for spatial categorical data with many classes
Paul B. May, Andrew Simpson, Semhar Michael · 2026
Read A reduced rank model for spatial categorical data with many classes by Paul B. May, Andrew Simpson, Semhar Michael (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23277.txt.
Introduction
May, Simpson, and Michael build a leaner model for spatial data with many outcome classes. Their reduced-rank multinomial model ties class effects to a few shared latent factors. That cuts the parameter count while keeping links between classes. Standard samplers break under this setup, so they design a Gibbs sampler with Laplace-based proposals. Simulations check how to pick the rank and how well the proposals work. Applied to tree species in the Blue Ridge Mountains, the model scales well. It predicts single species, species unions, and area totals.
Catalog record
| CREATOR | Paul B. May, Andrew Simpson, Semhar Michael |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41912 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.23277
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A reduced rank model for spatial categorical data with many classes Paul B. May, Andrew Simpson, Semhar Michael Abstract We develop an identifiable reduced-rank spatial multinomial model for categorical data with many classes. The model represents class-specific spatial effects through a low-dimensional set of shared latent factors, substantially reducing parameter dimension while preserving joint dependence across classes. Because standard conjugate and Pólya–Gamma methods fail under this factorization, we propose a Gibbs sampler using Laplace-approximation proposals within Metropolis–Hastings updates. Simulation studies examine dimension selection and the accuracy of the Laplace proposals. An application to dominant tree species mapping in the Blue Ridge Mountains demonstrates scalable inference and flexible joint predictions for individual classes, class unions, and area-level summaries. 1 Introduction Spatial categorical data are prevalent in many domains, such as land cover mapping ( 1 ; 14 ) , soil taxonomy ( 17 ) , and species distribution studies ( 8 ) . These applications often leverage spatially sparse in situ measurements to predict classifications at unobserved locations. Modeling such data is challenging due to the spatial dependencies, compositional constraints, and frequent need for rigorous uncertainty quantification. Latent Gaussian models (LGMs) are popular for many forms of spatial data ( 21 ; 22 ; 2 ) . Latent Gaussian effects are used to model spatial dependencies, often with an autoregressive structure or a Gaussian process, while the data likelihood conforms to properties of the observed variable. Bayesian inference is commonly used for LGMs and other spatial hierarchical models, as it naturally allows uncertainty in the latent effects to be propagated through to predictions and derived quantities. LGMs have been applied to categorical and multinomial data ( 13 ; 9 ; 6 ; 12 ) , but often with few potential classes. As the number of potential classes increases, the dimension of the model unknowns can increase rapidly, which is concerning for both statistical and computational efficiency. An LGM could accommodate a unique spatial effect for every additional class. While this grants substantial flexibility in modeling the joint probability surface across space, it requires inference on all the spatial effects and potentially their cross-covariances. Further, such flexibility may not be warranted if the class probabilities exhibit dependencies beyond their natural constraint of summing to unity. The patterns of presence/absence across even many classes can be driven by a few latent factors, e.g., temperature, precipitation, and soil gradients simultaneously favoring some tree species while inhibiting others. This motivates the use of a spatial factor model ( 7 ; 20 ; 23 ) , where the multivariate spatial process is dependent on a relatively small set of shared factors, creating a reduced-rank linear predictor. A computational challenge to Bayesian inference on LGMs is integrating across the high-dimensional latent effects. 19 developed a Pólya-Gamma data augmentation scheme for binomial logistic models where the conditional posterior of the latent effects, given auxiliary Pólya-Gamma variables, is Gaussian, enabling an efficient Gibbs sampler. 5 instead specified a multivariate logit-beta prior for the latent effects (not an LGM in the strict sense, but allowing similar prior spatial structures) which is conjugate to the binomial logistic likelihood. Both techniques can be generalized to multinomial logistic models by exploiting conditional one-versus-the-rest binomial likelihoods. However, this requires a component-wise separability of the linear predictor, where the log-odds of each class depends on a unique latent effect. This precludes a factor model, where the log-odds for each class depends on a shared set of latent effects. The Pólya-Gamma technique can be salvaged in this scenario by using a “stick-breaking” link function instead of the multinomial logistic link function ( 15 ) . However, the stick-breaking link is highly asymmetric and dependent on the class ordering, and for most applications there is no natural ordering of the classes. Alternatively, the conditional posterior of the latent effects can be approximated with Laplace approximations. This is most notably employed in the Integrated Nested Laplace Approximation ( 22 ; INLA), where a Laplace approximation is substituted for the conditional posterior of the latent effects, integrating across the remaining parameters through a deterministic quadrature. Software package ‘R-INLA’ ( www.r-inla.org ) can fit multinomial LGMs with or without shared spatial factors. However, even with a modest number of classes and small number of latent factors, it is difficult to accurately depict the posterior distribution of the factor weights through a deterministic quadrature. We propose an identifiable logistic multinomial model with reduced-rank spatial effects. Computationally, inference is conducted through a Gibbs sampler. To sample the latent spatial effects, we use Laplace approximations to generate proposals for a Metropolis-Hastings step. The same procedure is used to sample the factor weights. This inference scheme does not require separability of the linear predictor and avoids deterministic quadratures, remaining tractable for data with many classes. The focus of this work is on categorical data, but the model and computational techniques are applicable to multinomial models with an arbitrary, but known, number of trials. The rest of the paper is organized as follows. Section 2 introduces a spatial categorical model, the reduced-rank counterpart, and a Gibbs sampler for posterior inference. Section 3 contains simulation studies examining dimension selection, the model’s predictive performance when a reduced-rank structure is present in the data, and the accuracy of the Laplace proposals. Section 4 demonstrates the method on a practical dataset, predicting the probability of species dominance across 24 tree species groups within the Blue Ridge Mountains. Section 5 provides further discussion on the work and possible extensions. 2 Methods 2.1 Spatial categorical model Consider the categorical process model for J classes \displaystyle\boldsymbol{y}(\boldsymbol{s}) \displaystyle\sim\mathrm{Categorical}\left(\boldsymbol{p}(\boldsymbol{s})\right), (1) \displaystyle\boldsymbol{p}(\boldsymbol{s}) \displaystyle=\mathrm{softmax}_{J}\left(\boldsymbol{\psi}(\boldsymbol{s})\right), (2) \displaystyle\boldsymbol{\psi}(\boldsymbol{s}) \displaystyle=\boldsymbol{\mu}+\boldsymbol{\eta}(\boldsymbol{s}), (3) for all locations \boldsymbol{s} in some spatial domain \mathcal{D} , where \mathrm{softmax}_{J}(\boldsymbol{\psi})=\left[\frac{\exp(\psi_{j})}{1+\sum_{\ell=1}^{J-1}\exp(\psi_{\ell})}\right]_{j=1,\ldots,J-1} (4) with \boldsymbol{\psi}(\boldsymbol{s})\in\mathbb{R}^{J-1} being a vector of logits, \boldsymbol{\mu}\in\mathbb{R}^{J-1} is a logit-scale mean vector and \boldsymbol{\eta}(\boldsymbol{s})\in\mathbb{R}^{J-1} is a multivariate Gaussian process. Here we have arbitrarily set class J as our control class, with p_{J}(\boldsymbol{s}) uniquely determined by the other J-1 probabilities. An important feature of this model is the joint separability of the logits and effects, \boldsymbol{\psi}_{j}(\boldsymbol{s})=\mu_{j}+\eta_{j}(\boldsymbol{s});\quad\text{for}~~j=1,\ldots,J-1, (5) where each logit is a function of a distinct set of effects. Considering posterior inference, this is necessary for the Pólya-Gamma sampler of 19 and logit-beta conjugate prior of 5 . Both methods require that, conditional on the remaining effects, the likelihood for (\mu_{j},\eta_{j}(s)) is binomial and a well-defined conditional prior exists for these components. Gaussian process \boldsymbol{\eta}(\boldsymbol{s}) is intended to capture spatial patterns in the data, reflecting the prior belief that locations closer together have more similar class probabilities. For the rest of our development, we will assume a fixed-rank Gaussian process, \displaystyle\boldsymbol{\eta}(\boldsymbol{s}) \displaystyle=\boldsymbol{Z}^{T}\boldsymbol{b}(\boldsymbol{s}), (6) \displaystyle\mathrm{vec}(\boldsymbol{Z}) \displaystyle\sim\mathrm{MVN(\boldsymbol{0},\boldsymbol{\Sigma}\otimes\boldsymbol{Q}^{-1})}, (7) where \boldsymbol{b}(\boldsymbol{s})\in\mathbb{R}^{k} is a vector of spatial basis functions and \boldsymbol{Z}\in\mathbb{R}^{k\times(J-1)} is a matrix of spatial weights with between-class covariance \boldsymbol{\Sigma} and spatial precision \boldsymbol{Q} . The spatial weights represent random effects at a discrete set of k locations, while the basis functions project these effects onto the continuous spatial domain. In particular, we use the predictive process of 3 : First, k spatial knots, \boldsymbol{\ell}_{1},\ldots,\boldsymbol{\ell}_{k}\in\mathcal{D} , are fixed across the study domain. The spatial precision matrix and basis functions are generated by any positive-definite kernel; we used the exponential correlation function, \displaystyle Q_{ij} \displaystyle=\exp\left(-\frac{\|\boldsymbol{\ell}_{i}-\boldsymbol{\ell}_{j}\|}{\phi}\right)\quad\text{for}~~i,j=1,\ldots,k, (8) \displaystyle b_{i}(\boldsymbol{s}) \displaystyle=\exp\left(-\frac{\|\boldsymbol{s}-\boldsymbol{\ell}_{i}\|}{\phi}\right)\quad\text{for}~~i=1,\ldots,k.