Considering parallel tempering and comparing post-treatment procedures in Bayesian Profile Regression Models for a survival outcome and correlated exposures
Julie Fendler, Chantal Guihenneuc, Sophie Ancelet · 2025
Read Considering parallel tempering and comparing post-treatment procedures in Bayesian Profile Regression Models for a survival outcome and correlated exposures by Julie Fendler, Chantal Guihenneuc, Sophie Ancelet (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23571.txt.
Introduction
Julie Fendler, Chantal Guihenneuc, and Sophie Ancelet improve a Bayesian tool used in health risk studies. Bayesian profile regression mixture models group people by their pattern of exposures and link those groups to a health outcome, here survival. In practice the computer sampling behind the models, Markov chain Monte Carlo, has given unstable clusterings across applications.
The authors blame two causes: the sampler getting trapped in local modes of the posterior distribution, and different post-processing choices applied to its output. They consider parallel tempering, a technique that runs coupled chains to escape local traps, and they run a simulation study comparing sampling algorithms and post-treatment procedures. Guidelines follow from the comparison, and the methods are applied to a problem in radiation epidemiology.
Catalog record
| CREATOR | Julie Fendler, Chantal Guihenneuc, Sophie Ancelet |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-23571
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Considering parallel tempering and comparing post-treatment procedures in Bayesian Profile Regression Models for a survival outcome and correlated exposures Julie Fendler, Chantal Guihenneuc, Sophie Ancelet Abstract Bayesian profile regression mixture models (BPRM) allow to assess a health risk in a multi-exposed population. These mixture models cluster individuals according to their exposure profile and their health risk. However, their results, based on Monte-Carlo Markov Chain (MCMC) algorithms, turned out to be unstable in different application cases. We suppose two reasons for this instability. The MCMC algorithm can be trapped in local modes of the posterior distribution and the choice of post-treatment procedures used on the output of the MCMC algorithm leads to different clustering structures. In this work, we propose improvements of the MCMC algorithms proposed in previous works in order to avoid the local modes of the posterior distribution while reducing the computation time. We also carry out a simulation study to compare the performances of the MCMC algorithms and different post-processing in order to provide guidelines on their use. An application in radiation epidemiology is considered. K eywords Dirichlet process mixture models \cdot MCMC algorithm \cdot Multi-exposure \cdot Clustering \cdot Radiation epidemiology † † footnotetext: * This authors contributed equally. 1 Introduction In epidemiology, a common problem is to identify subgroups of individuals in a given population that have similar characteristics, for example, environmental exposure conditions or gene expression [ 1 , 2 , 3 , 4 , 5 , 6 ] . In statistics, the problem of partitioning individuals into different groups (also called clusters), such that individuals within the same group are more similar for given characteristics than to those in other groups, is referred to as clustering. In addition to clustering individuals according to their observed characteristics, called covariates, another question of interest is whether individuals assigned to the same group also tend to have a more similar level of risk, for one disease of interest, than those in other groups and to identify clusters with higher or lower risks. In radiation epidemiology, for example, we are interested in identifying subgroups of uranium miners sharing similar risk of death by lung cancer and similar professional exposure characteristics to ionising radiation [ 7 , 8 ] . To address the above issues, the standard approach is to cluster individuals in a first step and to estimate the health risk associated to each identified cluster in a second step [ 9 , 10 , 11 ] . However, in health-related applications, clusters are often not well separated and the incertitude on the clustering is often high. An important limitation of the standard approach is that this incertitude is not taken into account when estimating the health risk associated to each cluster. Furthermore, the information contained in the health-related outcome (or response) is not used as an input variable in the clustering algorithm when it could guide the inference algorithm towards a relevant clustering structure. Bayesian Profile Regression Mixture models (BPRM), introduced by Molitor et al. (2010) [ 12 ] , overcome both of these limitations. Inferring these probabilistic models allows both the identification of groups of individuals with similar exposure characteristics (also called profiles) and similar health risks as well as estimation of the associated risk for each group in a unique step. Moreover, all uncertainty, including uncertainty associated with the clustering structure, is reflected in the estimation of risk parameters. BPRM are increasingly applied in environmental epidemiology [ 13 , 14 , 15 , 16 , 17 , 18 ] , nutritional epidemiology [ 19 ] , occupational epidemiology [ 8 ] and genomic [ 20 ] . In this paper, we focus on the use of BPRM models to deal with a censored survival health outcome as proposed by Belloni et al. (2020) [ 8 ] and Liverani et al. (2021) [ 21 ] . Compared to Belloni et al. (2020) [ 8 ] , we assume an increasing continuous function to describe the instantaneous baseline hazard rate function, following Fendler et al. (2024) [ 22 ] . BPRM models are semi-supervised clustering models in which the prior number of clusters is assumed to be infinite: a Dirichlet process prior is assigned to the mixture weights. As a consequence, BPRM models belong to the class of Dirichlet Process Mixture (DPM) models. Standard MCMC algorithms are generally not suitable to infer mixture models like BPRM models. This is mainly due to both multiple modes in the joint posterior distribution, which requires the ability to efficiently visit these different modes, and to the unfixed number of non-empty clusters, which requires the ability to efficiently change the dimension of the approximate posterior distribution during the MCMC run. Thus, to infer BPRM models, Liverani et al. (2015) [ 23 ] proposed an MCMC algorithm based on a slice sampler and including three label switching moves. Unfortunately, this advanced sampling scheme is not yet sufficiently effective : the estimated number of clusters may remain unstable, as reported in different applications [ 8 , 20 , 24 ] . In this work, we extend Liverani et al. (2015)’s algorithm with a parallel tempering algorithm, in order to escape from local modes and thus, visit more efficiently the support of (potentially highly) multimodal posterior distributions. The parallel tempering algorithm for MCMC, also known as Metropolis-coupled MCMC or MC 3 , allows a Markov chain to jump to a new highly probable position if stuck in a local mode [ 25 ] . Napier et al. (2019) [ 26 ] showed through a simulation study that this algorithm outperformed classic MCMC algorithms to recover a clustering partition from complex mixture models. The parallel tempering algorithm for MCMC is rarely used in the clustering literature and, to the best of our knowledge, it has never been used to infer BPRM models. In this paper, a simulation study is performed to compare the performance of the MCMC algorithm proposed in Liverani et al. (2015) with an MCMC algorithm coupled with a parallel tempering algorithm, to infer BPRM models. We also propose to speed up the Bayesian inference of BPRM models using the JAX library in Python. When fitting a BPRM model with an MCMC algorithm, the outputs are samples of the approximate posterior distribution of all the possible partitions 0 0 0 A partition corresponds to the assignment of the individuals into a specific number of clusters. For n individuals, there exists B_{n}=\sum_{k=1}^{n}\frac{1}{k!}\sum_{j=0}^{k}(-1)^{k-j}\binom{k}{j}j^{n} different partitions. of the individuals. Thus, different posterior numbers of non-empty clusters may be derived from these MCMC outputs. In order to unravel a single clustering structure of the data, an optimal partition has to be selected via a post-processing step. Various methods have been proposed in the literature. Methods based on the minimisation of the distance to the mean similarity matrix and the Partitioning Around Medoids (PAM) algorithm are classically used in the BPRM literature [ 8 , 12 , 23 , 24 ] . Liverani et al. (2015) [ 23 ] reports that PAM algorithm is less subject to Monte Carlo error. However, this post-treatment procedure is often criticized in the literature for being ad-hoc and not properly designed for DPM [ 27 ] . Wade and Ghahramani (2018) [ 27