On Asymptotic Outlier Rejection in Bayesian Mixed Poisson Regression Models Under Extreme Target and Covariate Values

Ilaria Pia, Jarno Vanhatalo · 2026

Read On Asymptotic Outlier Rejection in Bayesian Mixed Poisson Regression Models Under Extreme Target and Covariate Values by Ilaria Pia, Jarno Vanhatalo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00231.txt.

Introduction

Pia and Vanhatalo test if Bayes count models can shrug off wild data points. A model is called robust if a point flung far off can not sway the end result. In straight-line fits, wild inputs and wild outputs act much the same. Count fits break that match.

Past work set rules for shrugging off wild outputs in mixed Poisson fits. Pia and Vanhatalo turn to wild inputs, the traits fed to the model. They prove such fits fail that test, even when they pass for outputs. As an input grows vast, its weight in the fit shrinks to a point at zero. Their new x-OR form fixes the flaw. Sims and a real case show it spurns both kinds of wild points.

Catalog record

CREATORIlaria Pia, Jarno Vanhatalo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00231

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On Asymptotic Outlier Rejection in Bayesian Mixed Poisson Regression Models Under Extreme Target and Covariate Values Ilaria Pia, Jarno Vanhatalo Abstract Bayesian models are claimed to be fully robust against outliers if, asymptotically, observations infinitely far from the other data do not influence the posterior. Early works in robust Bayesian inference concentrated on continuous distributions and i.i.d. observations. Robustness results were then extended to linear regression in the presence of infinite residuals – either through an outlying outcome or an outlying covariate. Recently, Hamura:2025 presented a count regression model, with Poisson-Rescaled Beta (-RSB) target distribution and Gaussian latent variables (GLVs), which is robust against infinitely large counts and able to handle zero-inflation. We continue from the work of Hamura et al. and study the robustness properties of mixed Poisson regression models with GLVs in the presence of outlying data points arising from either corrupted covariates or corrupted target values. While in linear regression the two cases are interchangeable, as both infinite target or covariates lead to infinite residuals, we show that in count regression infinite covariates is not a symmetric case to infinite target. Specifically, we show that mixed Poisson models are not asymptotically robust to outliers resulting from infinite covariates. We then consider three alternative mixed Poissons (Poisson-Gamma, Poisson-log-t, and Poisson-RSB) as target distribution and examine, both theoretically and via simulations as well as real-world case studies, their behavior in the presence of outliers of three alternative types: large target value as well as large and small covariate values. Our results show that models robust to data points with an anomalous target are not robust to data points with anomalous covariates, calling for methodological development for models that are robust for covariate outliers. While we do not provide solution to the challenge of outlying covariates, our work builds theoretically novel and practically valuable understanding on the properties of these models. keywords Count Regression , Robust Bayesian Inference , High Leverage Points † † orcid: 0009-0008-7983-2163 † † orcid: 0000-0002-6831-0211 and 1 Introduction Observations that strongly deviate from the bulk of the other data points, referred to as outliers, can have a large impact on inference and prediction under standard statistical models, leading to biases in the data analysis results. For this reason, the development of models that are robust to outliers, capable of automatically detecting and diminishing, or even rejecting, the effect of outliers on inference, has been a long lasting topic in Bayesian research ( DeFinetti:1961 ; Neyman:1971 ; OHagan+Pericchi:2012 ; Desgagne:2015 ) . The need for robust methods has grown further in recent years due to the increase in the size of datasets and heterogeneity of data sources, which makes the appearance of outliers increasingly more likely. In this paper, we present a cohesive classification of different types of outliers in count regression and examine how mixed Poisson regression models, analyzed under the Bayesian framework, behave both in the presence of infinitely large outliers and in the presence of finite but anomalous observations arising from either corrupted target values or corrupted covariate values. In Bayesian analysis, the presence of outliers generates a conflict between the outlier likelihood component counterpoised to the likelihood of the rest of the data together with the priors ( OHagan+Pericchi:2012 ) . The resolution of this conflict is typically expressed in terms of the posterior asymptotic behavior: a Bayesian model is generally claimed to be fully robust when the posterior given all the data converges in distribution to the posterior given all but the outlier observations, as the outliers move infinitely far from the bulk of the rest of the data. Such posterior convergence is generally referred to as asymptotic outlier rejection , as well as outlier-proneness ( OHagan:1979 ) . It should be noted that the concept of outlier-proneness was first introduced by Neyman:1971 to refer to the ability of the data generating process to generate extremely large data. As such, in a regression modeling context it only corresponds to robustness against outlying targets, but it cannot be used to refer to robustness against covariates, as these are not considered a product of a data generating process. We hence define robustness in terms of asymptotic outlier rejection. Recent studies have provided sufficient conditions for the robustness of linear regression models to outlying target and covariate values ( Gagnon:2020 ; Desgagne:2021 ; Hamura:2023 ) as well as for the robustness of generalized linear Gamma ( Gagnon:2023 ) and count regression models ( Hamura:2025 ) to outlying target values. Specifically, in regression models, an outlying data point arises as an anomalous combination of covariates and target values with respect to the rest of the data. Traditional examples are anomalous target values resulting from measurement or reporting errors in the data transcription. However, corrupted covariate observations, also known as high leverage points ( Plummer:2025 ) , are also possible. For example, in environmental sciences and spatial data analyses, satellite images and raster maps are routinely used to create covariate data. These products often contain large errors and biases arising from the inaccuracies in the satellite measurements and map production, which may then lead to a mismatch between a spatially referenced target values and covariates associated with them. In linear regression, both infinite target and infinite covariate lead symmetrically to infinite residual. We can hence define outliers in terms of their errors, without distinguishing between the source in which the data point presents an anomalous value ( Desgagne:2021 ) . However, in count regression, the behavior of likelihood is not symmetric with respect to an infinite covariate and an infinite target. This non-symmetry has, however, largely been ignored in the literature and we will show that it has important implications to the posterior inference. Moreover, in count regression, target values are limited to non-negative values. As suggested by Hamura:2025 , outliers formed by a zero count associated with large intensity can be framed as a zero-inflation problem. While zero-inflated count models have been extensively studied ( Cragg:1971 ; Lambert:1992 ) and the recent works by Hamura:2020 and Hamura:2025 have significantly advanced our understanding of the treatment of large outlying counts, we still lack a comprehensive understanding of how these models behave with different types of outliers originating from anomalous covariate values. In this work, we classify outliers in count regression based on the corrupted source: the target (type- y ) or the covariate (type- x ). We further classify outliers as large (L) if the corrupted value is very large, in extreme case +\infty , and small (S) if the corrupted value is very small, in the extreme case -\infty for outliers of type- x and 0 for outliers of type- y . Since the behavior of count models under type- x outliers differs depending on whether the target value is 0 or positive, we further separate outliers of type- x in two subgroups, based on this division. We summarize the five alternative types of outliers considered in this work in Table 1 . We then study asymptotic robustness to different types of outliers for a selection of mixed Poisson regression models with Gaussian-latent variables (GLVs), which are among the most common models used in the study of count data ( Wang+Blei:2018 ) . Together with

Read the complete text