Posterior Inference with Diffusion Models for High-dimensional Black-box Optimization

Taeyoung Yun, Kiyoung Om, Jaewoo Lee, Sujin Yun, Jinkyoo Park · 2025

Read Posterior Inference with Diffusion Models for High-dimensional Black-box Optimization by Taeyoung Yun, Kiyoung Om, Jaewoo Lee, Sujin Yun, Jinkyoo Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16824.txt.

Introduction

Many science problems ask for the best input to a costly black-box system, from drug doses to robot settings. Taeyoung Yun and co-authors present DiBO in a 2025 paper, a method built for such searches in high dimensions. Classic Bayesian optimization is sample-thrifty but wilts as dimensions and trials grow.

DiBO alternates two stages. First, a diffusion model learns the shape of good inputs while helper networks predict values with honest uncertainty. Second, picking the next trial is cast as a posterior inference problem, which the diffusion model is tuned to solve directly. That balance of exploring and exploiting held up across synthetic and real tasks, beating strong rival methods.

Catalog record

CREATORTaeyoung Yun, Kiyoung Om, Jaewoo Lee, Sujin Yun, Jinkyoo Park
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-16824

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Posterior Inference with Diffusion Models for High-dimensional Black-box Optimization Taeyoung Yun, Kiyoung Om, Jaewoo Lee, Sujin Yun, Jinkyoo Park Abstract Optimizing high-dimensional and complex black-box functions is crucial in numerous scientific applications. While Bayesian optimization (BO) is a powerful method for sample-efficient optimization, it struggles with the curse of dimensionality and scaling to thousands of evaluations. Recently, leveraging generative models to solve black-box optimization problems has emerged as a promising framework. However, those methods often underperform compared to BO methods due to limited expressivity and difficulty of uncertainty estimation in high-dimensional spaces. To overcome these issues, we introduce DiBO , a novel framework for solving high-dimensional black-box optimization problems. Our method iterates two stages. First, we train a diffusion model to capture the data distribution and deep ensembles to predict function values with uncertainty quantification. Second, we cast the candidate selection as a posterior inference problem to balance exploration and exploitation in high-dimensional spaces. Concretely, we fine-tune diffusion models to amortize posterior inference. Extensive experiments demonstrate that our method outperforms state-of-the-art baselines across synthetic and real-world tasks. Our code is publicly available here . † † affiliationnotice: Equal contribution 1 Introduction Optimizing high-dimensional and complex black-box functions is crucial in various scientific and engineering applications, including hyperparameter optimization ( Šehić et al., 2022 ) , material discovery ( Hernández-Lobato et al., 2017 ) , chemical design ( Gómez-Bombarelli et al., 2018 ; Griffiths et al., 2023 ) , and control systems ( Candelieri et al., 2018 ) . Bayesian optimization (BO) ( Kushner, 1964 ; Garnett, 2023 ) is a powerful method for solving black-box optimization. BO constructs a surrogate model from observed data and finds an input that maximizes the acquisition function to query the black-box function. However, it scales poorly to high dimensions due to the curse of dimensionality ( Wang et al., 2016 ) and struggles scaling to thousands of evaluations ( Wang et al., 2018 ; Eriksson et al., 2019 ) . To address these challenges, several approaches have been suggested to scale up BO for high-dimensional optimization problems. Some works propose a mapping from high-dimensional space into low-dimensional subspace ( Gómez-Bombarelli et al., 2018 ; Maus et al., 2022 ; Nayebi et al., 2019 ; Letham et al., 2020 ) or assume additive structures of the target function ( Duvenaud et al., 2011 ; Rolland et al., 2018 ) to perform optimization in low-dimensional spaces. However, these methods often rely on unrealistic assumptions. Other works partition the search space into promising local regions and search candidates within such regions ( Eriksson et al., 2019 ; Wang et al., 2020 ) , which exhibits promising results. However, these methods may struggle to escape from local optima within a limited number of evaluations due to several challenges. First, it is notoriously difficult to find an input that maximizes the acquisition function in high-dimensional spaces since the function is often highly non-convex and contains numerous local optima ( Ament et al., 2023 ) . Furthermore, as the data points lie on a tiny manifold compared to the entire search space, the uncertainty becomes extremely high in regions too far from the dataset ( Oh et al., 2018 ) . Recently, generative model-based approaches have shown promising results in black-box optimization ( Brookes et al., 2019 ; Kumar & Levine, 2020 ; Wu et al., 2024 ) . These methods utilize an inverse mapping from function values to the input domain and propose candidates via sampling from the trained model conditioned on a high score. While they alleviate aforementioned issues in BO by converting optimization as sampling ( Janner et al., 2022 ) , their performance degrades in higher dimensions due to the limited expressivity of underlying models ( Brookes et al., 2019 ; Kumar & Levine, 2020 ) or the difficulty of uncertainty estimation in high-dimensional spaces ( Wu et al., 2024 ) . Figure 1 : Motivating example of our method. In high-dimensional spaces, directly searching for input that maximizes UCB score may lead to sub-optimal results (As depicted in of the second figure). Sampling from the posterior distribution prevents overemphasized exploration in the boundary of search space and leads to efficient exploration (As depicted in of the last figure). To overcome these issues, we introduce Di ffusion models for B lack-box O ptimization ( DiBO ), a novel generative model-based approach for high-dimensional black-box optimization. Our key idea is to cast the candidate selection problem as a posterior inference problem. Specifically, we first train a proxy and diffusion model, which serves as a reward function and the prior. Then, we construct a posterior distribution by multiplying two components and sample candidates from the posterior to balance exploration and exploitation in high-dimensional spaces. Instead of searching for input that maximizes the acquisition function, sampling from the posterior prevents us from choosing the samples that lie too far from the dataset, as illustrated in Figure 1 . Our method iterates two stages. First, we train a diffusion model to effectively capture high-dimensional data distribution and an ensemble of proxies to predict function values with uncertainty quantification. During training, we adopt a reweighted training scheme proposed in prior generative model-based approaches to focus on high-scoring data points ( Kumar & Levine, 2020 ; Tripp et al., 2020 ) . Second, we sample candidates from the posterior distribution. As the sampling from the posterior distribution is intractable, we train an amortized sampler to generate unbiased samples from the posterior by fine-tuning the diffusion model. While the posterior distribution remains highly non-convex, we can capture such complex and multi-modal distribution by exploiting the expressivity of the diffusion models. By repeating these two stages, we progressively get close to the high-scoring regions of the target function. As we have a limited budget for evaluations, it is beneficial to choose modes of the posterior distribution as proposing candidates. To accomplish this, we propose two post-processing strategies after training the amortized sampler: local search and filtering. Concretely, we generate many samples from the amortized sampler and improve them via local search. Then, we filter candidates with respect to the unnormalized posterior density. By incorporating these strategies, we can further boost the sample efficiency of our method across various optimization tasks. We conduct extensive experiments on four synthetic and three real-world high-dimensional black-box optimization tasks. We demonstrate that our method achieves superior performance on a variety of tasks compared to state-of-the-art baselines, including BO methods, generative model-based methods, and evolutionary algorithms. Figure 2 : Overview of our method. Phase 1: Train diffusion models and ensemble of proxies. Phase 2: Sampling candidates from the posterior distribution and post-processing via local search and filtering. Then, we evaluate samples, update the dataset, and repeat the process until we find an optimal design. 2 Preliminaries 2.1 Black-box Optimization In black-box optimization, our objective is to find a design \mathbf{x}\in\mathcal{X} that maximizes the target black-box function f(\mathbf{x}) . \displaystyle\text{find }\mathbf{x}^{*}=\arg\max_{\mathbf{x}\in\mathcal{X}}f(\mathbf{x}) \displaystyle\text{ with }R\text{ rounds of }B\text{ batch of queries} (1) Querying designs in batches is practical in many real-world scenarios, such as biological sequence designs ( Jain et al., 2022 ; Kim et al., 2024a ) . As the evaluation process is expensive in most cases, developing an algorithm with

Read the complete text