Improving the evaluation of samplers on multi-modal targets

Louis Grenioux & Maxence NobleCMAP, CNRSÉcole polytechnique, Institut Polytechnique de Paris91120 Palaiseau, France, Marylou GabriéLaboratoire de Physique de l’École normale supérieureENS, Université PSL, CNRS, Sorbonne Université, Université de Paris75005 Paris, France · 2025

Read Improving the evaluation of samplers on multi-modal targets by Louis Grenioux & Maxence NobleCMAP, CNRSÉcole polytechnique, Institut Polytechnique de Paris91120 Palaiseau, France, Marylou GabriéLaboratoire de Physique de l’École normale supérieureENS, Université PSL, CNRS, Sorbonne Université, Université de Paris75005 Paris, France (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08916.txt.

Introduction

Grenioux, Noble, and Gabrié argue for stricter grading of sampling algorithms in a 2025 reflection paper. Samplers draw values from a target spread, and multi-peak targets trip many of them. Two hardships matter most: how far apart the peaks sit and how many dimensions the space has. The team proposes a made-up test ground that varies both.

Their key score is whether a sampler recovers each peak's true share of weight. A small set of known samplers is run through the ground to show the method. The authors say such checks reveal which tools can truly handle many peaks. Better grading, they argue, will steer the field toward stronger samplers.

Catalog record

CREATORLouis Grenioux & Maxence NobleCMAP, CNRSÉcole polytechnique, Institut Polytechnique de Paris91120 Palaiseau, France, Marylou GabriéLaboratoire de Physique de l’École normale supérieureENS, Université PSL, CNRS, Sorbonne Université, Université de Paris75005 Paris, France
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-08916

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improving the evaluation of samplers on multi-modal targets Louis Grenioux & Maxence NobleCMAP, CNRSÉcole polytechnique, Institut Polytechnique de Paris91120 Palaiseau, France, Marylou GabriéLaboratoire de Physique de l’École normale supérieureENS, Université PSL, CNRS, Sorbonne Université, Université de Paris75005 Paris, France Abstract Addressing multi-modality constitutes one of the major challenges of sampling. In this reflection paper, we advocate for a more systematic evaluation of samplers towards two sources of difficulty that are mode separation and dimension. For this, we propose a synthetic experimental setting that we illustrate on a selection of samplers, focusing on the challenging criterion of recovery of the mode relative importance. These evaluations are crucial to diagnose the potential of samplers to handle multi-modality and therefore to drive progress in the field. 1 Introduction Consider the problem of sampling from a probability density known up to a normalizing constant. More precisely, let \pi be a target distribution with probability density given by x\mapsto\gamma(x)/\mathcal{Z} , where \gamma:\mathbb{R}^{d}\to\mathbb{R}_{+} can be pointwise evaluated and the normalizing constant \mathcal{Z}=\int_{\mathbb{R}^{d}}\gamma(x)\mathrm{d}x is intractable. This reflection paper is concerned with cases where the distribution \pi is multi-modal, i.e., \gamma admits several local maxima. Such high-dimensional multi-modal distributions appear in various fields. In physics, they describe the thermodynamics of metastable systems, or the action of quantum field theories ( Wolff, 1990 ) . Bayesian modeling can also face multi-modal posterior distributions in cases where the observations fail to lift ambiguities between several distinctive sets of parameters ( Yao et al., 2022 ) . Hence, continuing efforts have been made to design sampling strategies that handle multi-modality. However, sampling from multi-modal distributions is notoriously difficult, especially in large dimension d . There are two major sources of difficulties to overcome: (i) locating the modes, that is the different high-probability regions of \pi induced by its local maxima, and (ii) estimating their relative importance. Performing an exhaustive search of modes is equivalent to the problem of finding the local maxima of the possibly high-dimensional function \gamma , which is NP-hard Pardalos & Schnitger (1988) . Although a flurry of heuristics have been developed to explore probability landscapes and find modes ( Fletcher, 2000 ; Nocedal & Wright, 2006 ) , this fact sets the problem of sampling from multi-modal distributions as arbitrarily hard in general. In fact, even when the location of the modes is known, the second difficulty of estimating their relative proportion remains a significant challenge to this day. The ability of samplers to represent the different modes with correct proportions is, however, seldom reported, with exceptions including Grenioux et al. (2023) ; Blessing et al. (2024) ; Shi et al. (2024) ; Noble et al. (2025) . In this reflection paper, we wish to advocate for: \bullet Running systematic experiments on toy mixture distributions with increasing dimension and mode separation, as these two parameters are commonly mediating the hardness of the task for common sampling technics. \bullet Evaluation based on the criterion of accurate estimation of the statistical weight of each mode, possibly assuming knowledge of mode locations. The reasons are twofold: first because it is an interpretable metric, incurring almost no additional computational cost, and second precisely because it is a challenging test. Running these experiments and evaluation would enable diagnosing strengths and weaknesses of newly proposed algorithms, which is crucial to foster the development of robust algorithms in the multi-modal setting, and therefore drive progress in the field. In the following, we start with some reminders in Section 2 on the difficulty of sampling from multi-modal distributions, and in particular in estimating relative importance of modes. In Section 3 , we examine the strengths and weaknesses of common sampling strategies in multi-modal scenarios and illustrate the importance of reporting performance within the proposed experimental framework. 2 What is hard in sampling from multi-modal distributions? As mentioned in the introduction, the first challenge in sampling from a multi-modal distribution is identifying all its modes. We do not discuss this issue further, as exhaustive searches can be arbitrarily complex. Moreover, even when mode locations are known, accurate sampling remains difficult and practically relevant. In some cases, heuristics or expert knowledge can help identify modes. For instance, in physics and drug design ( Jorgensen, 2004 ) , determining molecular binding events involves two modes: the bonded complex and the unbound molecules. Benefits and pitfalls of local samplers. If the target’s mode locations are known, it may seem that the sampling problem is solved by using this prior information to initialize a Markov Chain Monte Carlo (MCMC) sampler. MCMCs based on local updates are among the most widely used sampling approaches, including Random Walk Metropolis-Hastings (RWMH) ( Metropolis et al., 1953 ) , Metropolis-Adjusted Langevin Algorithm (MALA) ( Roberts & Tweedie, 1996 ) , Hamiltonian Monte Carlo (HMC) ( Duane et al., 1987 ; Brooks et al., 2011 ) , and No U-Turn Sampler (NUTS) ( Hoffman & Gelman, 2014 ) . These algorithms have demonstrated both theoretical and practical efficiency when the target density satisfies log-concavity assumptions ( Dalalyan, 2017 ; Durmus & Moulines, 2019 ; Dwivedi et al., 2018 ; Bou-Rabee et al., 2020 ) . Paradoxically, the very properties that make these samplers effective for log-concave distributions hinder their performance in the multi-modal case, where log-concavity does not hold. While MCMC transition kernels are designed to guide the chain toward target modes, they also, with high probability, trap it within a mode, preventing broader exploration. Consequently, initializing an MCMC sampler at the modes of \pi —where \gamma is locally log-concave—may yield locally accurate samples while failing to capture the global mode weights of \pi . Mode weight estimation. To define the mode weights of the distribution of interest \pi , one can leverage a partition of its support (taken equal to \mathbb{R}^{d} here for simplicity) that draws a one-to-one correspondence between the target modes and space subsets. Then, the mode weights of \pi can be defined as the relative statistical weights of the constituents of this partition with respect to \pi . Formally, assume that \pi has K modes and that we have access to a partition \{S_{1},\ldots,S_{K}\} of \mathbb{R}^{d} , where S_{k}\subset\mathbb{R}^{d} represents a region including the k -th mode of \pi . The (un-normalized) k -th mode weight of \pi is simply defined by \displaystyle w_{k}=\int_{\mathbb{R}^{d}}\mathbbm{1}_{S_{k}}(x)\gamma(x)\mathrm{d}x=\mathcal{Z}\pi(S_{k})\;. (1) The important quantities are the weight ratios w_{k}/w_{k^{\prime}} for k^{\prime}\neq k for which the normalizing constant \mathcal{Z} simplifies. Therefore, the weights w_{k} may be defined up to a common multiplicative constant. Fixing the multiplicative constant, w_{k} can be interpreted as the normalization constant of the target distribution \pi restricted to S_{k} , with un-normalized density given by x\mapsto\mathbbm{1}_{S_{k}}(x)\gamma(x) . As such, it becomes clear that mode weight estimation is related to the estimation of a normalization constant. The need to go beyond local MCMC samplers for multi-modal distributions is well established, with annealing-based methods playing a key role (detailed in the next section). However, accurately estimating mode weights, even when mode locations are known, remains an open challenge in high dimensions. This issue parallels free energy computations in statistical mechanics, an active area of research ( Lelièvre et al., 2010 ; Chipot, 2023 ) . Despite this, new samplers rarely evaluate their accuracy in estimating mode

Read the complete text