Ensemble Monte Carlo Calculations with Five Novel Moves

Burkhard Militzer · 2024

Read Ensemble Monte Carlo Calculations with Five Novel Moves by Burkhard Militzer (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00276.txt.

Description

Abstract We introduce five novel types of Monte Carlo (MC) moves that brings the number of moves of ensemble MC calculations from three to eight. So far such calculations have relied on affine invariant stretch moves that were originally introduced by Christen (2007), walk moves by Goodman and Weare (2010) and quadratic moves by Militzer (2023).

Catalog record

CREATORBurkhard Militzer
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-00276

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ensemble Monte Carlo Calculations with Five Novel Moves Burkhard Militzer Abstract We introduce five novel types of Monte Carlo (MC) moves that brings the number of moves of ensemble MC calculations from three to eight. So far such calculations have relied on affine invariant stretch moves that were originally introduced by Christen (2007), walk moves by Goodman and Weare (2010) and quadratic moves by Militzer (2023). Ensemble MC methods have been very popular because they harness information about the fitness landscape from a population of walkers rather than relying on expert knowledge. Here we modified the affine method and employed a simplex of points to set the stretch direction. We adopt the simplex concept to quadratic moves. We also generalize quadratic moves to arbitrary order. Finally, we introduce directed moves that employ the values of the probability density while all other types of moves rely solely on the location of the walkers. We apply all algorithms to the Rosenbrock density in 2 and 20 dimensions and to the ring potential in 12 and 24 dimensions. We evaluate their efficiency by comparing error bars, autocorrelation time, travel time, and the level of cohesion that measures whether any walkers were left behind. Our code is open source. I Introduction Since the seminal paper by Metropolis et al. [30] , Monte Carlo (MC) techniques, in particular Markov Chain Monte Carlo (MCMC) methods, have been employed in many areas of science including physics, astronomy, geoscience and chemistry [ 22 , 12 , 25 ] . These methods are particularly effective when states in a high-dimensional space need to be studied but only a small but nontrivial subset of the available states are relevant. The distribution of n gas molecules in a three-dimensional room is one example to illustrate their effectiveness. A MC simulation would only generate configurations in the 3n dimensional space in which the molecules are more or less evenly distributed in the room, as one would expect. Formally with analytical statistical methods, one would be required to also integrate over highly unlikely configuration, in which, e.g., many molecules are concentrated in one corner of the room. Such states are irrelevant because they only occupy a negligible measure of the accessible configuration space. MC methods are very good in avoiding unlikely configuration and in sampling only a representative subset of the relevant configurations, which makes such MC method orders of magnitude more efficient than exhaustive integration methods. Consequently, MC methods offer no direct access to the entropy nor to free energies but these quantities can be derived indirectly via thermodynamic integration [ 10 , 44 , 45 , 43 , 15 ] . In the field of statistical physics, MC methods have thus found numerous applications to sample the states of classical and quantum systems [ 5 , 7 , 35 , 11 ] that are weighted by the Boltzmann factor, \pi(\vec{r})=\exp\left\{-\frac{E(\vec{r})}{k_{B}T}\right\}\;\;. (1) \pi is the unnormalized probability density of states, \vec{r} , with an energy, E(\vec{r}) . The product of temperature, T , and Boltzmann constant, k_{B} , controls the relative weights of high- and low-energy states. Throughout this article, \vec{r}=\{r_{1},\ldots,r_{N}\} represents a vector in the N dimensional space of states that is to be sampled. We often refer to such vectors as walkers . \vec{r}_{i} refers to the i th walker in an ensemble while when we discuss the specific sampling functions like the Rosenbrock density or the ring potential, r_{m} represents the m th component of a vector \vec{r} . It should be noted that a walker does not play the role of a particle in physics-based MCMC calculations where typically n particles move in 3D space, which leads to a N=3n dimensional sampling space. In such applications, one typically moves one or a handful of particles with specialized types of moves that are particularly efficient for specific interactions. The MCMC methods that we discuss in this article are not focused on sampling particle coordinates but are more general. They should for example allow one to construct ensembles of models of Jupiter’s interior for which a walker may represent the masses and composition of certain layers [ 34 ] . So we do not assume that the N dimensional sampling space can be divide into n equivalent 3D subspaces. When one moves a particle in physics-based simulations, only its 3 coordinates change while when we move a walker here, all its N elements are affected. Besides statistical physics, there is another broad area of applications where MCMC are typically employed. In fields like astrophysis, one often constructs models to match sets of telescope observations or spacecraft measurements [ 19 , 6 ] , y_{i} , that come with a statistical uncertainty, \delta y_{i} . MCMC calculations are then used to map out the space of model parameters, \vec{r} , that is compatible with the observations by sampling probability density [ 36 , 39 , 38 ] , \pi(\vec{r})=\exp\left\{-\chi^{2}/2\right\}{\;\;\rm with\;\;}\chi^{2}=\sum_{i=1}^{N}\left(\frac{y_{i}^{\rm model}(\vec{r})-y_{i}^{\rm obs.}}{\delta y_{i}}\right)^{2} (2) The affine invariant MCMC method by Christen [8] and Goodman & Weare [16] along with its practical implementation by Foreman-Mackey et al. [13] have been very popular to solve such kind of sampling problems. Many applications came from the field of astrophysics. For example, the affine sampling method has been employed to detect stellar companions in radial velocity catalogues [ 40 ] , to study the relationship between dust disks and their host stars [ 2 ] , to examine the first observations of the Gemini Planet Imager [ 26 ] , to analyze photometry data of Kepler’s K2 phase [ 42 ] , to study the mass distribution in our Milky Way galaxy [ 29 ] , to identify satellites of the Magellanic Clouds [ 24 ] , to analyze gravitational-wave observations of a binary neutron star merger [ 9 ] , to constrain Hubble constant with data of the cosmic microwave background [ 4 ] , or to characterize the properties of M-dwarf stars [ 27 ] to name a few applications. On the other hand, Huijser et al. [20] demonstrated that the affine (linear) stretch moves exhibit undesirable properties when the Rosenbrock density in more than 50 dimensions is sampled. The MCMC in this article are not taylored towards any specific application nor do they require knowledge of any derivitatives of the sampling function \pi(\vec{r}) because they may very difficult to compute for complex applications. This means however that the algorithm has little information to distinguish favorable direction to move into from unfavorable ones, and this is why one employs an ensemble of walkers. Ensemble MC methods propagates an entire ensemble of walkers rather than moving just a single one. While this seems to imply more work, such methods often win out because they harness information from the distribution of walkers in the ensemble to propose favorable moves that have an increased chance of being accepted without the need for a detailed investigation of the local fitness landscape as the traditional Metropolis-Hastings MC method requires. Many extensions of the Metropolis-Hastings approach have been advanced [ 3 ] . For example, Haario et al. [18] use the entire accumulated history along the Monte Carlo chain of states to adjust the shape of the Gaussian proposal

Read the complete text