ParetoFlow: Guided Flows in Multi-Objective Optimization
Ye Yuan, Can (Sam) Chen, Christopher Pal, Xue Liu · 2024
Read ParetoFlow: Guided Flows in Multi-Objective Optimization by Ye Yuan, Can (Sam) Chen, Christopher Pal, Xue Liu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03718.txt.
Introduction
Ye Yuan and co-authors introduce ParetoFlow for offline multi-objective optimization in this 2024 paper. Real design problems must balance several goals at once, not just one. Offline work starts from a fixed set of past designs and their scores.
Most past methods used evolution or Bayesian search on such data. The team instead use flow matching, a generative method known for speed and quality. ParetoFlow guides the sampling toward the front of best trade-offs. It builds on standard guidance ideas from generative modeling. Designers could use it to propose strong candidates without new costly tests. Fields from drugs to engineering face this same offline balance problem.
Catalog record
| CREATOR | Ye Yuan, Can (Sam) Chen, Christopher Pal, Xue Liu |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03718
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ParetoFlow: Guided Flows in Multi-Objective Optimization Ye Yuan, Can (Sam) Chen, Christopher Pal, Xue Liu Abstract In offline multi-objective optimization (MOO), we leverage an offline dataset of designs and their associated labels to simultaneously minimize multiple objectives. This setting more closely mirrors complex real-world problems compared to single-objective optimization. Recent works mainly employ evolutionary algorithms and Bayesian optimization, with limited attention given to the generative modeling capabilities inherent in such data. In this study, we explore generative modeling in offline MOO through flow matching, noted for its effectiveness and efficiency. We introduce ParetoFlow , specifically designed to guide flow sampling to approximate the Pareto front. Traditional predictor (classifier) guidance is inadequate for this purpose because it models only a single objective. In response, we propose a multi-objective predictor guidance module that assigns each sample a weight vector, representing a weighted distribution across multiple objective predictions. A local filtering scheme is introduced to address non-convex Pareto fronts. These weights uniformly cover the entire objective space, effectively directing sample generation towards the Pareto front. Since distributions with similar weights tend to generate similar samples, we introduce a neighboring evolution module to foster knowledge sharing among neighboring distributions. This module generates offspring from these distributions, and selects the most promising one for the next iteration. Our method achieves state-of-the-art performance across various tasks. Our code will be available here . 1 Introduction Offline optimization, a fundamental challenge in science and engineering, involves minimizing a black-box function using solely an offline dataset, with diverse applications ranging from protein design Sarkisyan et al. (2016) ; Angermüller et al. (2020) to neural architecture design Lu et al. (2023) . Previous research primarily focuses on single-objective optimization, aiming to optimize a single desired property Trabucco et al. (2022) ; however, this fails to capture the complexities of real-world challenges that often require balancing multiple conflicting objectives, such as designing a neural architecture that demands both high accuracy and minimal parameter count Lu et al. (2023) . In this study, we explore offline multi-objective optimization (MOO), leveraging an offline dataset of designs and their associated labels to simultaneously minimize multiple objectives. The pioneering work Xue et al. (2024) adapts evolutionary algorithms Deb et al. (2002) ; Zhang & Li (2007) and Bayesian optimization Daulton et al. (2023) ; Zhang & Golovin (2020) ; Qing et al. (2023) to handle the offline MOO setting. Besides, some studies design controllable generative models that manage multiple properties Wang et al. (2024) . However, these studies generally either focus on different settings, such as online optimization Gruver et al. (2023) and white-box optimization Yao et al. (2024) , or utilize less advanced generative models, such as VAEs Wang et al. (2022) . None of these studies fully exploits the potential of advanced generative modeling in offline MOO. To bridge this gap, we employ a flow matching framework, renowned for its effectiveness and efficiency over diffusion models Lipman et al. (2023) ; Le et al. (2023) ; Polyak et al. (2024) , to investigate generative modeling in offline MOO. We introduce the ParetoFlow method, specifically designed to guide flow sampling to approximate the Pareto front. The Pareto front is defined as the set of optimal objective values that are not dominated by any other points. As illustrated in Figure 1 (a), the solid blue curve represents the Pareto front in a two-dimensional objective space for the conflicting objectives f_{1} and f_{2} . Traditional predictor (classifier) guidance 1 1 1 Classifier guidance , initially for classification, is adapted to predictor guidance to generalize to regression. Dhariwal & Nichol (2021) , focusing solely on a single objective, fails to adequately explore the entire Pareto front. As demonstrated in Figure 1 (a), directing sample generation from pure noise (circles) towards a single objective, such as f_{1} or f_{2} , yields isolated Pareto samples (pentagrams) without capturing the full spectrum of optimal samples. To address this, we propose Module 1 , termed multi-objective predictor guidance , which assigns each sample a weighted distribution. This distribution, characterized by a weight vector across multiple objective predictions, guides sample generation towards its corresponding Pareto-optimal point. To navigate non-convex Pareto fronts, this module adopts a local filtering scheme, to filter out samples whose objective prediction vector deviates from the weight vector. These weight vectors uniformly cover the entire objective space, thereby effectively guiding sample generation towards the Pareto front. As shown in Figure 1 (b), uniform weight vectors \bm{\omega}^{1-5} represent five weighted distributions over f_{1} and f_{2} , ensuring that the generated samples (pentagrams) approximate the Pareto front. Figure 1: Motivation of Module 1 in (b) and Module 2 in (c). Distributions with similar weight vectors tend to generate similar samples. As shown in Figure 1 (c), the distributions with weights \bm{\omega}^{2} and \bm{\omega}^{3} are neighboring and they generate similar sample along the sampling trajectory. This motivates us to introduce Module 2 , termed neighboring evolution , to foster knowledge sharing among these neighboring distributions. We propose to generate diverse offspring samples from neighboring distributions, and select the most promising one for the next iteration. For instance, consider \bm{\omega}^{2} with \bm{\omega}^{3} as its sole neighbor in Figure 1 (c). We generate offspring samples from both \bm{\omega}^{2} and \bm{\omega}^{3} , and then select the most promising one—identified by a dashed circle—as the next iteration state for the \bm{\omega}^{2} distribution. A similar scheme applies to \bm{\omega}^{3} , assuming \bm{\omega}^{2} as its neighbor. This module facilitates valuable knowledge sharing between neighboring distributions ( \bm{\omega}^{2} and \bm{\omega}^{3} ), enhancing the effectiveness of the overall sampling process. To summarize, our contributions are three-fold: • We explore the use of generative modeling in offline MOO by introducing ParetoFlow , specifically designed to effectively steer flow sampling to approximate the Pareto front. • We propose a multi-objective predictor guidance module that assigns a uniform weighted distribution to each sample, ensuring comprehensive coverage of the objective space. • We establish a neighboring evolution module to enhance knowledge sharing among distributions with close weight vectors, which improves the sampling effectiveness. 2 Preliminaries 2.1 Offline Multi-Objective Optimization Offline multi-objective optimization (MOO) seeks to simultaneously minimize multiple objectives using an offline dataset \mathcal{D} of designs and their corresponding labels. Consider a design space denoted as \mathcal{X}\subseteq\mathbb{R}^{d} , where d represents the dimension of the design. In MOO, we aim to find solutions that achieve the best trade-offs among conflicting objectives. Formally, the multi-objective optimization problem is defined as: \text{Find }\bm{x}^{*}\in\mathcal{X}\text{ such that there is no }\bm{x}\in\mathcal{X}\text{ with }\bm{f}(\bm{x})\prec\bm{f}(\bm{x}^{*}), (1) where \bm{f}:\mathcal{X}\rightarrow\mathbb{R}^{m} is a vector of m objective functions, and \prec denotes Pareto dominance. A solution \bm{x} is said to Pareto dominate another solution \bm{x}^{*} (denoted as \bm{f}(\bm{x})\prec\bm{f}(\bm{x}^{*}) ) if: \forall i\in\{1,\ldots,m\},\quad f_{i}(\bm{x})\leq f_{i}(\bm{x}^{*})\quad\text{and}\quad\exists j\in\{1,\ldots,m\}\text{ such that }f_{j}(\bm{x})<f_{j}(\bm{x}^{*}). (2) In other words, \bm{x} is no worse than \bm{x}^{*} in all objectives and strictly better in at least one objective. A solution \bm{x}^{*} is Pareto optimal if there is no other solution \bm{x}\in\mathcal{X} that Pareto dominates \bm{x}^{*} . The set of all Pareto optimal solutions constitutes the Pareto set (PS) . The corresponding set of objective vectors, defined as \{\bm{f}(\bm{x})\mid\bm{x}\in{PS}\} , is known as the Pareto front (PF) . The goal of MOO is to identify a set of solutions that effectively approximates the