Flexible extreme thresholds through generalised Bayesian model averaging
Jessup, Sébastien, Mailhot, Mélina, Pigeon, Mathieu · 2025
Read Flexible extreme thresholds through generalised Bayesian model averaging by Jessup, Sébastien, Mailhot, Mélina, Pigeon, Mathieu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20216.txt.
Introduction
Sébastien Jessup, Mélina Mailhot, and Mathieu Pigeon help insurers model their largest claims without betting everything on one threshold, in a paper published in two thousand twenty-five. Actuarial models often split losses at a cutoff: ordinary claims below, extreme value theory above. Choosing that cutoff is an unsolved headache, since results swing with the choice.
Bayesian model averaging offers an escape by weighing several thresholds at once. The authors show a generalized version, an error integration algorithm, can even let the best threshold vary with the policy's features. Different risk profiles get different effective thresholds automatically. Combining mixture models this way captures the whole loss distribution more faithfully. It also softens the damage from any single bad threshold pick. The method is validated on insurance-style problems. Extremes drive insurance solvency, so small accuracy gains at the tail carry real money.
Catalog record
| CREATOR | Jessup, Sébastien, Mailhot, Mélina, Pigeon, Mathieu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-20216
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Flexible extreme thresholds through generalised Bayesian model averaging Jessup, Sébastien, Mailhot, Mélina, Pigeon, Mathieu Abstract Insurance products frequently cover significant claims arising from a variety of sources. To model losses from these products accurately, actuarial models must account for high-severity claims. A widely used strategy is to apply a mixture model, fitting one distribution to losses below a given threshold and modeling excess losses using extreme value theory. However, selecting an appropriate threshold remains an open question with no universally agreed-upon solution. Bayesian Model Averaging (BMA) provides a promising alternative by enabling the simultaneous consideration of multiple thresholds. In this paper, we show that an error integration BMA algorithm can effectively detect heterogeneous optimal thresholds that adapt to predictive variables through the combination of mixture models. This method enhances model accuracy by capturing the full loss distribution and lessening sensitivity to threshold choice. We validate the proposed approach using simulation studies and an application to an automobile claims dataset from a Canadian insurer. As a special case, we also study the homogeneous setting, where a single optimal threshold is selected, and compare it to automatic selection algorithms based on goodness-of-fit tests applied to an actuarial dataset. Keywords Bayesian Model Averaging; Extreme Values; Threshold Selection 1 Introduction Insurers are often exposed to significant losses from diverse sources, including injuries following accidents, crashes involving high-value vehicles, and natural catastrophes. In 2023, 23 of these events in Canada each resulted in over $30 million in damages, contributing to nearly a quarter of the $3.1 billion in total insured losses ( CatIQ, 2024 ) . As such, insurers require models that can capture both high-severity claims and the broader distribution of smaller claims to ensure a comprehensive risk assessment. One approach to dealing with large losses is to use a branch of extreme value theory (EVT) called Peak-over-threshold. This approach examines values that exceed a specified level. For a sufficiently high limit, the excess values can be demonstrated to follow a generalised Pareto distribution (GPD), developed by Pickands, 1975 , with cumulative density function G(x)=\begin{cases}1-\left(1+\frac{\xi(x-u)}{\sigma}\right)^{-1/\xi}&\text{ for $\xi\neq 0$ and $x>u$}\\ 1-\exp\left(-\frac{x-u}{\sigma}\right)&\text{ for $\xi=0$ and $x>u$}\mathchar 59\relax\end{cases} (1) with location, scale, and shape parameters u\mathchar 59\relax\sigma\mathord{\mathchar 59\relax} and \xi . This approach can be used in a variety of contexts, such as extreme daily precipitation ( Thiombiano et al., 2017 ) , operational risk ( Chavez-Demoulin et al., 2006 ) , stock returns ( He et al., 2022 ) , and catastrophe risk ( Li et al., 2016 ) . The main challenge with this method is to identify a suitable threshold beyond which losses follow a GPD. Threshold selection, however, is an open problem with no universally accepted method. Caeiro and Gomes, 2015 explain a few of the available methods based on a heuristic choice or minimisation of mean squared error. What defines the optimal threshold varies depending on the method used, but it is generally accepted to represent the value which minimises the bias-variance tradeoff in the GPD tail of the distribution. For example, we can use EVT to determine this optimal value as the lowest point where the Mean Residual Life (MRL) plot becomes approximately linear ( Embrechts et al., 2013 ) . Recently, in a homogeneous setting, automatic threshold selection methods have been proposed such as using L-moments ( Silva Lomba and Fraga Alves, 2020 ) , parameter stability ( Curceac et al., 2020 ) , goodness of fit ( Bader et al., 2018 ) , and other methods partly reviewed by Benito et al., 2023 , who find that different thresholds can yield similar market risk measures. These methods generally require establishing potential threshold values through a range of quantiles, from which a "best" threshold is chosen. Although there is a significant body of literature devoted to identifying an optimal threshold, a question central to this article is whether it could be better to use model combination to simultaneously consider multiple threshold values. Such a combination could potentially be less affected by threshold misspecification than selecting a single best threshold. In fact, Northrop et al., 2017 recently used Bayesian Model Averaging (BMA), a method initially proposed by Raftery et al., 1997 that gained significant popularity in many scientific fields ( Fragoso et al., 2018 ) , to reduce sensitivity to threshold selection when studying the number of exceedances over a high threshold in ocean storms. While Northrop et al., 2017 focus on the tail of the distribution, actuarial applications often require considering the entire range of potential values rather than only exceedances above a threshold. In such cases, models must capture the full distribution of the data, calling for an approach that models both the bulk and the tail. Laudagé et al., 2019 proposed a mixture of a generalised linear model (GLM) and a GPD for a known threshold, which was expanded on by Ghaddab et al., 2023 in an excess-of-loss reinsurance context, where the threshold was estimated using MRL plots and Hill plot estimators. Li and Liu, 2023 proposed a three-part mixture model dividing low, medium and high claims according to a 20%/60%/20% rule of thumb. While these approaches consider the full data, they are subject to threshold misspecification. We propose using a tail-weighted version of a BMA algorithm, namely, the error integration algorithm proposed by Jessup et al., 2025 to combine mixture models with a single threshold, as suggested by MacDonald et al., 2011 . We will show that this allows for identifying the lowest threshold such that the distance between the fitted distribution and the observed tail data is minimised while improving the fit in the bulk of the distribution. We will also show that model combination is preferable to a single misspecified threshold. Furthermore, error integration allows for flexible thresholds depending on predictive variables. As such, in this article, we propose a modification to a Bayesian model averaging algorithm to identify (flexible) optimal thresholds that allow the full distribution to be fitted, with an improved fit in the bulk of the distribution and reduced sensitivity to threshold selection. Section 2 establishes the theoretical results, Section 3 illustrates these results using simulation studies and real datasets, and Section 4 concludes the article. 2 Tail-weighted BMA for threshold selection To reduce the issue of threshold selection, we will focus on a mixture model proposed by MacDonald et al., 2011 . In a homogeneous setting, the authors suggested using a non-parametric distribution with kernels for the bulk of the data and a GPD for the tail beyond a threshold u . Replacing the kernel distribution by a parametric distribution, this has density f(y|\bm{\Lambda}\mathord{\mathchar 59\relax}u\mathord{\mathchar 59\relax}\sigma\mathord{\mathchar 59\relax}\xi)=\left\{\begin{array}[]{ll}(1-\phi_{u})\times\frac{h(y|\bm{\Lambda})}{H(u|\bm{\Lambda})}&y\leq u\\ \phi_{u}\times g(y|u\mathchar 59\relax\sigma\mathchar 59\relax\xi)&y>u\mathchar 59\relax\end{array}\right. (2) where h(y|\bm{\Lambda}) is the bulk density with parameters \bm{\Lambda} , while g(y|u\mathord{\mathchar 59\relax}\sigma\mathord{\mathchar 59\relax}\xi) is a GPD density with parameters \sigma and \xi . Note that \phi_{u} is simply the proportion of data above u and is not a parameter as such. Furthermore, we can easily generalise ( 2 ) to take predictive variables into account To this end, consider a generalised mixture model with a fixed threshold such that f(y^{(k)}|\textbf{X}^{(k)}\mathord{\mathchar 59\relax}\bm{\Lambda}(\textbf{X}^{(k)})\mathord{\mathchar 59\relax}u\mathord{\mathchar 59\relax}\sigma(\textbf{X}^{(k)})\mathord{\mathchar 59\relax}\xi(\textbf{X}^{(k)}))=\left\{\begin{array}[]{ll}(1-\phi_{u})\times\frac{h(y|\textbf{X}^{(k)}\mathchar 59\relax\bm{\Lambda}(\textbf{X}^{(k)}))}{H(u|\textbf{X}^{(k)}\mathchar 59\relax\bm{\Lambda}(\textbf{X}^{(k)}))}&y\leq u\\ \phi_{u}\times g(y^{(k)}|u\mathchar 59\relax\sigma(\textbf{X}^{(k)})\mathchar 59\relax\xi(\textbf{X}^{(k)}))&y>u\mathchar 59\relax\end{array}\right. (3) where the prediction depends on the characteristics \textbf{X}^{(k)} for the k^{\text{th}} observation.