Learning Design-Score Manifold to Guide Diffusion Models for Offline Optimization

Tailin Zhou, Zhilin Chen, Wenlong Lyu, Zhitang Chen, Danny H.K. Tsang, Jun Zhang · 2025

Read Learning Design-Score Manifold to Guide Diffusion Models for Offline Optimization by Tailin Zhou, Zhilin Chen, Wenlong Lyu, Zhitang Chen, Danny H.K. Tsang, Jun Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-05680.txt.

Introduction

Tailin Zhou and five co-authors improve offline optimization, the art of designing better things from old data alone. Engineers often hold a dataset of past designs and their scores, for drugs, materials, or robot settings, and want a design better than any in the set. Standard learners can misjudge new regions and hand back weak designs. Their framework, ManGO, trains a diffusion generator on the joint landscape of designs and scores together, rather than studying each side apart.

That joint view lets one model both predict scores and generate designs, and reach beyond the training data. A guidance scheme that needs no derivatives steers generation, while the sampling path rescales itself as it runs. Across synthetic tasks, robot control, materials, DNA sequences, and engineering problems, ManGO beat two dozen single-goal and ten multi-goal rival methods.

Catalog record

CREATORTailin Zhou, Zhilin Chen, Wenlong Lyu, Zhitang Chen, Danny H.K. Tsang, Jun Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-05680

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning Design-Score Manifold to Guide Diffusion Models for Offline Optimization Tailin Zhou, Zhilin Chen, Wenlong Lyu, Zhitang Chen, Danny H.K. Tsang, Jun Zhang Abstract Optimizing complex systems—from discovering therapeutic drugs to designing high-performance materials—remains a fundamental challenge across science and engineering, as the underlying rules are often unknown and costly to evaluate. Offline optimization aims to optimize designs for target scores using pre-collected datasets without system interaction. However, conventional approaches may fail beyond training data, predicting inaccurate scores and generating inferior designs. This paper introduces ManGO, a diffusion-based framework that learns the design-score manifold, capturing the design-score interdependencies holistically. Unlike existing methods that treat design and score spaces in isolation, ManGO unifies forward prediction and backward generation, attaining generalization beyond training data. Key to this is its derivative-free guidance for conditional generation, coupled with adaptive inference-time scaling that dynamically optimizes denoising paths. Extensive evaluations demonstrate that ManGO outperforms 24 single- and 10 multi-objective optimization methods across diverse domains, including synthetic tasks, robot control, material design, DNA sequence, and real-world engineering optimization. Across scientific and industrial domains, from drug discovery [ 1 ] to engineering superconducting materials [ 2 ] , researchers face a common bottleneck: creating new designs to optimize specific property scores in complex systems where the rules governing performance are unknown or costly to evaluate. Numerous methods require either expensive trial-and-error experimentation or building system models with long-term accumulation of domain knowledge. Consider the decades-long quest for fusion reactor materials—each physical test costs millions and risks equipment damage [ 3 ] or the ethical constraints in developing neuroactive drugs where failed designs could harm patients [ 4 , 5 ] . These limitations call for a general optimization framework that learns directly from historical data while eliminating the need for iterative evaluation. Offline optimization [ 6 ] , also named offline model-based optimization, has emerged as a promising solution, enabling design improvement using pre-collected datasets. This approach has proven valuable in molecule generation [ 7 ] , protein properties [ 8 ] , and hardware accelerators [ 9 ] . Current methods adopt a unidirectional strategy: (i) Training surrogate models to predict scores from designs. These predicted scores are then utilized by various optimizers to identify the optimal designs (forward modeling) [ 10 , 11 ] ; (ii) Generating designs that are conditioned on desired scores through the use of generative models (backward generation). An example of this approach is the employment of diffusion models [ 12 ] , wherein small amounts of noise are incrementally added to a design sample, and a neural network is trained to reverse this noise-adding procedure. However, forward methods mislead optimizers with overconfident out-of-distribution predictions [ 6 ] , while backward methods struggle with out-of-distribution generation (OOG) on unseen conditions [ 13 ] . These struggles stem from a deeper oversight: existing works operate in isolated design or score spaces, missing the underlying design-score manifold where optimal designs reside. We propose to learn the design-score man ifold to g uide diffusion models for offline o ptimization (ManGO). As illustrated in Figure 1 , we leverage score-augmented datasets to train an unconditional diffusion model. By learning on the manifold, the model effectively captures the bidirectional relationships between designs and their corresponding scores. We then introduce a derivative-free guidance mechanism for conditional generation, which enables bidirectional guidance—generating designs based on target scores and predicting scores for given designs, thus eliminating the reliance on error-prone forward models. To further enhance generation quality, we implement adaptive inference-time scaling for ManGO, which computes model fidelity on unconditional samples. This scaling approach dynamically optimizes denoising paths through ManGO’s self-supervised rewards. Moreover, ManGO is adaptable to both single-objective optimization (SOO) and multi-objective optimization (MOO) tasks, making it a comprehensive solution for various optimization scenarios. The comprehensive evaluation showcases ManGO’s state-of-the-art versatility in offline optimization, consistently surpassing existing approaches across both SOO and MOO tasks. In comparison with the baselines, ManGO significantly enhances performance, attaining the top position among 24 SOO methods and 10 MOO methods. We anticipate that ManGO will serve as a valuable tool for data-driven design. By unifying optimization through learning on the design-score manifold, it offers a scalable and accessible solution for future scientific and industrial challenges. Figure 1: Overview of the ManGO framework for offline optimization. ( a ) Illustration of offline optimization on the unknown black-box function (no environment interaction) using an offline dataset. ( b ) Learning on the design-score manifold with score-augmented training data. ( c ) Fidelity estimation via unconditional samples generated by ManGO. ( d ) Bidirectional conditional generation: At the denoising timestep t for sample i , it enables both preferred-score and preferred-design guidance, as well as a fidelity-based activation mechanism for inference-time scaling to enhance generation quality (illustrated via the self-supervised importance sampling (self-IS) method). ( e ) Conceptual illustration of ManGO, which learns on the design-score manifold and enjoys enhanced out-of-distribution generation (OOG) capability. In contrast, learning in the design space faces the out-of-distribution (OOD) issue on unseen conditions. ( f ) Case study on superconductor’s temperature optimization [ 14 ] to demonstrate the superior OOG performance via ManGO versus the design-space approach across varying top data removal. Results In this section, we first present the motivation and key idea of ManGO and visualize its manifold and trajectory generation. We then conduct extensive experimental validation on offline SOO and MOO using Design-Bench [ 6 ] and Off-MOO-Bench [ 15 ] . Finally, we perform systematic ablation studies to analyze the contributions of ManGO’s core components. Motivation of Learning on Design-Score Manifold The proposed ManGO framework explicitly learns the design-score manifold and leverages the underlying manifold geometry to co-generate designs and scores. Specifically, ManGO learns a bidirectional mapping between designs and scores: (i) Design-to-Score Prediction : Given any design configuration, ManGO predicts its corresponding score; (ii) Score-to-Design Generation : For any preferred score, ManGO generates its corresponding design. As illustrated in Figure 1 .e, this bidirectional mapping provides ManGO with a robust OOG capability to extrapolate beyond training distributions. Let \hat{\bm{x}}_{t}=({\bm{x}}_{t},{\bm{y}}_{t}) denotes a score-augmented design vector at timestep t , where \bm{x} and \bm{y} represent the design and its score, respectively. The denoising update can be represented as: \hat{\bm{x}}_{t-1}=({\bm{x}}_{t},{\bm{y}}_{t})+\underbrace{(\Delta{\bm{x}}_{t},\Delta{\bm{y}}_{t})}_{\text{Co-update}}=\frac{1}{2}\underbrace{({\bm{x}}_{t}+2\Delta{\bm{x}}_{t},{\bm{y}}_{t})}_{\text{Design update}}+\frac{1}{2}\underbrace{({\bm{x}}_{t},{\bm{y}}_{t}+2\Delta{\bm{y}}_{t})}_{\text{Score update}}, where the co-update term indicates the denoising update based on the learned manifold geometry, the design-update term indicates the denoising update of {\bm{x}}_{t} conditioned on {\bm{y}}_{t} , and the score-update term indicates the denoising update of {\bm{y}}_{t} conditioned on {\bm{x}}_{t} . Unlike the design-space approaches that treat \bm{y}_{t} as a fixed condition and only update \bm{x}_{t} unidirectionally, ManGO jointly updates both \bm{x}_{t} and \bm{y}_{t} based on the bidirectional mapping. The design-space methods struggle with extrapolation under unseen conditions. In contrast, ManGO leverages co-updates to dynamically capture the geometric relationship between design and score: each denoising step not only pushes \bm{x}_{t} toward the local manifold conditioned on \bm{y}_{t} (design-update) but also refines \bm{y}_{t} to align with the evolving \bm{x}_{t} (score-update). This bidirectional feedback enables progressive extrapolation and converges to the conditioned points on the manifold, achieving a robust OOG capability. We conduct a controlled experiment to elucidate the advantage of the bidirectional mapping of ManGO on a superconductor [ 14 ] task, an 86-D materials design optimization task

Read the complete text