Posterior Inference in Latent Space for Scalable Constrained Black-box Optimization
Kiyoung Om, Kyuil Sim, Taeyoung Yun, Hyeongyu Kang, Jinkyoo Park · 2025
Read Posterior Inference in Latent Space for Scalable Constrained Black-box Optimization by Kiyoung Om, Kyuil Sim, Taeyoung Yun, Hyeongyu Kang, Jinkyoo Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00480.txt.
Introduction
Design problems often hide their rules: a candidate can be scored only by running a costly test, and many candidates break hidden constraints. Kiyoung Om, Kyuil Sim, Taeyoung Yun, Hyeongyu Kang, and Jinkyoo Park recast that search as a reasoning problem in this 2025 paper. Instead of hunting in the raw design space, they hunt inside the compact code space of a generative model.
First, flow-based models learn what past candidates look like, and helper models predict each candidate's score and rule breaks. Then candidate choice becomes drawing from a probability distribution that favors high scores and clean records. A borrowed diffusion model does the drawing, which avoids a common failure where all samples collapse to one point. On test problems, both made-up and real, the method beat its rivals.
Catalog record
| CREATOR | Kiyoung Om, Kyuil Sim, Taeyoung Yun, Hyeongyu Kang, Jinkyoo Park |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-00480
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Posterior Inference in Latent Space for Scalable Constrained Black-box Optimization Kiyoung Om, Kyuil Sim, Taeyoung Yun, Hyeongyu Kang, Jinkyoo Park Abstract Optimizing high-dimensional black-box functions under black-box constraints is a pervasive task in a wide range of scientific and engineering problems. These problems are typically harder than unconstrained problems due to hard-to-find feasible regions. While Bayesian optimization (BO) methods have been developed to solve such problems, they often struggle with the curse of dimensionality. Recently, generative model-based approaches have emerged as a promising alternative for constrained optimization. However, they suffer from poor scalability and are vulnerable to mode collapse, particularly when the target distribution is highly multi-modal. In this paper, we propose a new framework to overcome these challenges. Our method iterates through two stages. First, we train flow-based models to capture the data distribution and surrogate models that predict both function values and constraint violations with uncertainty quantification. Second, we cast the candidate selection problem as a posterior inference problem to effectively search for promising candidates that have high objective values while not violating the constraints. During posterior inference, we find that the posterior distribution is highly multi-modal and has a large plateau due to constraints, especially when constraint feedback is given as binary indicators of feasibility. To mitigate this issue, we amortize the sampling from the posterior distribution in the latent space of flow-based models, which is much smoother than that in the data space. We empirically demonstrate that our method achieves superior performance on various synthetic and real-world constrained black-box optimization tasks. Our code is publicly available here . 1 Introduction Optimizing high-dimensional black-box functions under black-box constraints is a fundamental task across numerous scientific and engineering problems, including machine learning ( gardner2014bayesian ) , drug discovery ( griffiths2020constrained ; korovina2020chembo ) , control ( berkenkamp2016safe ; berkenkamp2023bayesian ) , and industrial design ( anjos2009mopta ; maathuis2024high ) . In most cases, these problems are much harder than unconstrained problems due to analytically undefined and hard-to-find feasible regions ( eriksson2021scalable ) . Bayesian Optimization (BO) has been widely used to solve black-box optimization problems in a sample-efficient manner ( frazier2018tutorial ; garnett2023bayesian ) . While most BO methods focus on unconstrained optimization problems, some works address problems with black-box constraints by developing new acquisition functions ( gardner2014bayesian ; hernandez2015predictive ) or relaxing the constraints ( picheny2016bayesian ; JMLR:v20:18-227 ) . However, even without constraints, BO methods scale poorly to high dimensionality ( eriksson2019scalable ) . Moreover, incorporating constraints makes the function landscape highly complex, hindering accurate estimation of surrogate models. Recently, generative models have emerged as an alternative solution for black-box optimization problems with constraints ( kong2025diffusion ; xing2025black ; uehara2025reward ) . For example, we can leverage generative models to sample protein sequences that maximize the binding affinity while preserving the naturalness of the design. However, existing methods rely on MCMC-based approaches kong2025diffusion , which limit scalability in high-dimensional spaces. While one can fine-tune pretrained generative models with reward functions ( venkatraman2024amortizing ; domingo-enrich2025adjoint ; uehara2024fine ) , naive application of fine-tuning methods is vulnerable to mode collapse when the target distribution is highly multi-modal ( venkatraman2025outsourced ) , which leads to a convergence on sub-optimal solutions. In this paper, we propose a novel generative model-based framework for constrained black-box optimization to overcome the aforementioned limitations. To efficiently explore high-dimensional spaces, we first frame the candidate selection problem as sampling from the posterior distribution, which can be constructed by multiplying the prior distribution with a Lagrangian-relaxed objective. To sample candidates from the posterior distribution, our key idea is to amortize inference in the latent space of a flow-based model using an outsourced diffusion sampler venkatraman2025outsourced , as illustrated in Figure 1 . Since the posterior distribution in the latent space is much smoother than that in the data space, we can approximate the distribution more accurately and alleviate the mode collapse problem ( coeurdoux2023normalizing ) . Our method iterates through two stages. First, we train a flow-based model to capture the current data distribution and surrogate models to predict the objective value and constraints, respectively. For the surrogate models, we use an ensemble to quantify the uncertainty of the prediction, as we have only a small amount of data that covers a tiny fraction of the whole search space. We treat a trained flow-based model as a prior, and Lagrangian relaxation of the objective as a reward function. Second, we sample candidates from the posterior distribution. As the posterior distribution is highly multi-modal and has a large plateau due to constraints, especially when constraint feedback is given as binary indicators of feasibility, we train a diffusion sampler that amortizes the posterior distribution in the latent space of flow models. Then, we sample latents from the diffusion sampler and project them into data space using a deterministic mapping derived from the trained flow model. By repeating these two stages, we can effectively capture high-scoring regions that satisfy the constraints. We conduct extensive experiments on three synthetic and three real-world benchmarks to validate the superiority of our method on scalable constrained black-box optimization problems. We also consider a more challenging scenario where the feedback from the constraints is given as a binary value. We empirically show that our method outperforms several competitive baselines across different tasks. Figure 1 : Motivating figure. In a high-dimensional setting, sampling from the posterior distribution is beneficial for selecting candidates. However, the posterior distribution is highly multi-modal and has a large plateau due to the constraints (orange one) . We can mitigate this issue by sampling latents from the posterior distribution (purple one) of the latent space and projecting them into the data space. 2 Related Works 2.1 Constrained Black-box Optimization Most scientific and engineering optimization problems involve black-box constraints, such as the synthesizability of molecules in chemical design ( griffiths2020constrained ) and safety constraints in robot control policies ( berkenkamp2016safe ) . Various strategies have been proposed to handle such constraints in the BO literature. cEI schonlau1998global and LogcEI ament2023unexpected incorporate constraints into the acquisition function to search for data points in feasible regions. On the other hand, SCBO eriksson2021scalable proposes a trust-region approach with bilog transformations to address scalable constrained black-box optimization problems. PCAGP-SCBO maathuis2024high extends this idea by applying PCA jolliffe2002principal to handle large-scale constraints in the latent space. Another line of work integrates the objective function with constraints via augmented Lagrangian or the Alternating Direction Method of Multipliers (ADMM) picheny2016bayesian ; JMLR:v20:18-227 , and solves unconstrained optimization problems by vanilla BO methods. While our method also applies Lagrangian relaxation to handle constraints, we take a fundamentally different approach from standard BO literature in the candidate selection procedure. Instead of searching for inputs that maximize the acquisition function, we frame candidate selection as a posterior inference problem. Evolutionary algorithms can also be applied to constrained black-box optimization. CMA-ES hansen2006cma ; atamna2016augmented employs continuous parameter adaptation and handles constraints either by assigning the objective values of infeasible points to zero or by applying the augmented Lagrangian method. Despite these advancements, we observe that most methods suffer from severe performance degradation as dimensionality increases, indicating that a new scalable algorithm should be proposed. Figure 2 : Overview of our method. Phase 1: