Bridging Spherical Black-Box Optimizers
Johannes Ackermann, Stefano Peluchetti · 2026
Read Bridging Spherical Black-Box Optimizers by Johannes Ackermann, Stefano Peluchetti (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25761.txt.
Introduction
When no gradient exists, optimiser families wander the landscape by sampling. Evolution strategies keep a parametric search cloud. Consensus methods herd loose particles. Integration based methods tilt a distribution by fitness. Johannes Ackermann and Stefano Peluchetti unify these spherical black box optimisers in 2026 within one theoretical frame. The families differ mainly in two choices. One is how fitness is aggregated, setting a taste for sharp or flat minima. The other is how widely consensus is gathered, setting whether one peak or many are kept.
Knowing the dials, the pair build hybrids that interpolate between the classics. One hybrid steers the flatness preference explicitly, trading raw performance for robustness in continuous control. Others fuse parametric efficiency in high dimensions with particle based multimodality, and proved competitive at merging language models on tight evaluation budgets. On standard benchmarks and locomotion tasks, the hybrids sometimes beat both of their parents.
Catalog record
| CREATOR | Johannes Ackermann, Stefano Peluchetti |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.25761
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bridging Spherical Black-Box Optimizers Johannes Ackermann, Stefano Peluchetti Abstract When gradient information is unavailable, black-box optimization (BBO) methods provide a practical alternative. While Evolution Strategies (ES), Consensus-Based Optimization (CBO), Optimization via Integration (OVI), and related methods have each been studied independently, their connections remain underexplored. We unify these approaches within a common theoretical framework, revealing that they differ primarily in two design choices: fitness aggregation (controlling sharpness preference) and consensus scope (controlling modality). Leveraging these insights, we introduce hybrid optimizers that interpolate between existing methods. Our ES-OVI hybrid allows explicit control over the preference for flat minima, enabling a trade-off between performance and robustness in continuous control tasks. Our CBO-OVI hybrids combine the higher-dimensional efficiency of parametric methods with the multimodal capabilities of particle-based approaches, achieving competitive results on language model merging under limited evaluation budgets. We validate our methods on standard BBO benchmarks and higher-dimensional locomotion tasks, demonstrating that the hybrid methods can outperform their constituent algorithms. † † affiliationnotice: JA did his work while interning at Sakana AI. 1 Introduction Stochastic gradient descent and its variants have become the dominant optimizers for deep learning models. However, gradients may be unavailable or not useful for training ( Metz et al. 2022 ) , for example when optimizing through simulators, using external APIs, or in Reinforcement Learning. In such cases, zeroth-order or black-box optimizers offer a solution as they only require objective function evaluations. There are two main families of black-box optimizers, which are usually treated separately: Parametric and non-parametric methods. On the parametric side, a prominent family are Evolution Strategies (ES) ( Rechenberg 1973 ) . Within ES, we specifically focus on Natural ES (NES) ( Wierstra et al. 2008 ) , which maintain a parametric search distribution, updating parameters based on the expectation of the objective over sampled points. Optimization via Integration (OVI) ( Andrieu et al. 2024 ) is also parametric, but proposes to instead repeatedly tilt a search distribution by the objective values. On the non-parametric side, particle-based approaches such as Consensus Based Optimization (CBO) ( Pinnau et al. 2017 ) evolve a population of candidate solutions. This is done based on the function value of all particles, or in the case of Polarized CBO (pCBO) ( Bungert et al. 2025 ) only based on the value of nearby particles, allowing us to obtain multiple optima. Parametric Nonparametric unimodal, work well in d\gg 1 work well in d\lesssim 30 ES \theta^{*}_{\mathrm{ES}} OVI \theta^{*}_{\mathrm{OVI}} ES-OVI (Section 4.4 ) control convergence \lambda=1,d\gg 1 SchedPol AdaPol (Section 4.5 ) multimodal in d\gg 1 m_{c,t}^{i} CBO unimodal cCBO/pCBO multimodal Figure 1 : We investigate connections between the parametric ES, OVI, the nonparametric CBO, and further related optimizers. By utilizing these connections, we can derive hybrid methods, indicated by green arrows, that combine the strengths of existing optimizers: ES-OVI allows us to control convergence characteristics, SchedPol and AdaPol combine CBO and OVI updates, allowing us to obtain multiple optima in higher-dimensional tasks. Table 1 : Instantiations of the master update Equation MU , unifying all considered BBO methods. Method \Psi(F) (sharpness) K_{t}^{i,j} (scope / interaction) (\mu_{t},\lambda_{t}) (transport) \sigma_{t}s(x-m) (noise) CH / OVI \exp\{-\beta F\} 1 (global) (0,1) \sigma ES † 1-\frac{\eta}{\sigma^{2}}\Bigl(F-\overline{F}\Bigr) 1 (global) (0,1) \sigma CBO \exp\{-\beta F\} 1 (global) (1-\lambda,\lambda) \sigma\|x-m\| pCBO \exp\{-\beta F\} \exp\bigl\{-\|x_{t}^{i}-x_{t}^{j}\|^{2}/(2\kappa^{2})\bigr\} (1-\lambda,\lambda) \sigma\|x-m^{i}\| cCBO ‡ \exp\{-\beta F\} \sum_{c=1}^{N_{C}}\frac{p_{t}^{i,c}p_{t}^{j,c}}{Z_{t}^{c}} (1-\lambda,\lambda) \sigma\|x-m^{i}\| DE \exp\{-\beta F\} \exp\bigl\{-\|x_{t}^{i}-\sqrt{\alpha_{t}}x_{t}^{j}\|^{2}/(2(1-\alpha_{t}))\bigr\} (\mu_{t}^{\mathrm{DDIM}},\lambda_{t}^{\mathrm{DDIM}}) \sigma_{t}^{\mathrm{DDIM}} ES † : with antithetic sampling; \Psi depends on \overline{F} as well (population mean of loss values). cCBO ‡ : p_{t}^{i,c} are cCBO assignments Equation 4 , Z_{t}^{c}=\sum_{j=1}^{N}p_{t}^{j,c}\exp\{-\beta F(x_{t}^{j})\} . While ES, OVI, and CBO have each been linked to gradient descent ( Salimans et al. 2017 ; Riedl et al. 2023 ; Andrieu et al. 2024 ) , the connections between distribution-update methods (ES/OVI) and CBO particle methods have, to our knowledge, not been investigated. In this work, we propose a unified framework ( Section 2 ) for these optimizers: a single master update equation Equation MU from which ES, OVI, CBO, and their variants emerge as special cases, differing primarily in their fitness aggregation and interaction scope ( Table 1 ). We then leverage these insights to derive new optimizers that address the weaknesses of each method. We provide an overview in Figure 1 . We empirically evaluate their convergence characteristics, and evaluate their performance on low-dimensional BBO benchmarks and higher-dimensional locomotion tasks. Finally, we investigate their application to evolutionary model merging under limited evaluation budgets. We propose to address this setting as a multi-modal optimization problem, in which our proposed CBO-OVI combinations are successful. 2 Unifying Framework We can view many black-box optimizers as iterating two steps: (i) compute a (possibly local) fitness-weighted consensus point, and (ii) update particles by (partially) moving toward this consensus while injecting exploration noise. This yields a single master update that recovers ES, OVI, CH, CBO, pCBO, clustered CBO (cCBO), and Diffusion Evolution (DE). Master Update (MU) Given particles x_{t}^{1},\ldots,x_{t}^{N}\in\mathbb{R}^{d} , define \displaystyle x_{t+1}^{i} \displaystyle=\mu_{t}x_{t}^{i}+\lambda_{t}m_{t}^{i}+\sigma_{t}s(x_{t}^{i}-m_{t}^{i})\epsilon_{t}^{i},\quad\epsilon_{t}^{i}\overset{\text{\tiny{i.i.d.}}}{\sim}\mathcal{N}(0,I), ( \mathrm{MU} ) \displaystyle m_{t}^{i} \displaystyle=\sum_{j=1}^{N}w_{t}^{i,j}x_{t}^{j},\qquad w_{t}^{i,j}=\frac{a_{t}^{i,j}}{\sum_{\ell=1}^{N}a_{t}^{i,\ell}}, \displaystyle a_{t}^{i,j} \displaystyle=\Psi(F(x_{t}^{j}))K_{t}^{i,j}. Here \Psi is a fitness transformation (sharpness preference), K_{t}^{i,j}\geq 0 is an interaction matrix controlling how particles influence each other (global vs. local vs. clustered interactions), \lambda_{t} controls attraction toward consensus, \mu_{t} controls persistence, \sigma_{t} controls exploration, and s(\cdot) determines noise scaling. In all methods aside from cCBO, K_{t}^{i,j} is constructed from a kernel: K_{t}^{i,j}=k_{t}(x_{t}^{i},x_{t}^{j}) . If K_{t}^{i,j}=1 , then m_{t}^{i} does not depend on i , and we obtain a global consensus point m_{t} . Most methods satisfy \mu_{t}+\lambda_{t}=1 (convex transport), but we keep (\mu_{t},\lambda_{t}) separate to accommodate the DDIM ( Song et al. 2021a ) sampler in DE. If \mu_{t}=0 and \lambda_{t}=1 , then Equation MU resamples the population around the consensus ( x_{t+1}^{i}=m_{t}^{i}+\sigma_{t}\epsilon_{t}^{i} ), covering OVI/CH and ES. Table 1 shows how the discussed BBO methods instantiate Equation MU . For ES, we assume mean-zero perturbations via antithetic sampling, a standard practice ( Salimans et al. 2017 ) . Under this assumption, ES can be written exactly in terms of Equation MU . Without it, the correspondence remains a close approximation for N\gg 1 . We defer to Section A.6 for details. The equivalence of CH and OVI is established in Section A.5 . Finally, cCBO fits Equation MU by using a cluster-induced interaction matrix K_{t} ( Section A.7 ). 3 Background We consider a loss function F:\mathbb{R}^{d}\to\mathbb{R} , which we aim to minimize. In the black-box optimization setting, we can evaluate F at any point, but cannot access its gradient \nabla F . 3.1 Parametric Methods Stochastic Smoothing (SS) constructs a differentiable surrogate for non-differentiable or black-box functions ( Katkovnik & Kulchitsky 1972 ; Spall 2003 ; Nesterov & Spokoiny 2017 ) . Given a smoothing distribution with density \pi , the smoothed objective is J^{\mathrm{SS}}_{\pi}(\theta)=\mathbb{E}_{\epsilon\sim\pi}[F(\theta+\epsilon)] . Using the likelihood-ratio estimator, the gradient can be expressed as \nabla_{\theta}J^{\mathrm{SS}}_{\pi}(\theta)=\mathbb{E}_{\epsilon\sim\pi}[F(\theta+\epsilon)\nabla_{\epsilon}{-}\log\pi(\epsilon)] (see Section A.2 for details). For a spherical Gaussian \pi=\mathcal{N}(0,\sigma^{2}I) , this yields the gradient descent updates \theta_{t+1}=\theta_{t}-\frac{\eta}{\sigma N}\sum_{i=1}^{N}F(\theta_{t}+\sigma\epsilon^{i})\epsilon_{t}^{i},\quad\epsilon_{t}^{i}\overset{\text{\tiny{i.i.d.}}}{\sim}\mathcal{N}(0,I), (SS) where \eta>0 is the learning rate. Natural Evolution Strategies (NES) ( Wierstra et al. 2008 ; Wierstra et al. 2014 ) optimize a parametric search distribution \pi(x;\theta) to maximize expected fitness J^{\mathrm{ES}}_{\pi}(\theta)=\mathbb{E}_{x\sim\pi(\cdot;\theta)}[-F(x)] . For a Gaussian \pi=\mathcal{N}(\theta,\sigma^{2}I) with fixed variance, the NES updates are \theta_{t+1}=\theta_{t}-\eta\mathbb{E}_{\epsilon\sim\mathcal{N}(0,\sigma^{2}I)}\left[F(\theta_{t}+\epsilon)\epsilon\right].