Constrained Flow Optimization via Sequential Fine-Tuning for Molecular Design
Sven Gutjahr, Riccardo De Santi, Luca Schaufelberger, Kjell Jorner, Andreas Krause · 2026
Read Constrained Flow Optimization via Sequential Fine-Tuning for Molecular Design by Sven Gutjahr, Riccardo De Santi, Luca Schaufelberger, Kjell Jorner, Andreas Krause (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30610.txt.
Introduction
Gutjahr and colleagues adapt generative foundation models, diffusion and flow models, to boost rewards like binding affinity while respecting constraints like ease of making. Recent reward-guided fine-tuning leaves open how to trade reward against constraint meeting well. Their Constrained Flow Optimization method reduces the problem to step-by-step tuning with proven large-scale methods, weighing the two aims on its own and with proof that it converges. Tests on mock settings and a molecular design task show steady reward gains with high constraint meeting.
Catalog record
| CREATOR | Sven Gutjahr, Riccardo De Santi, Luca Schaufelberger, Kjell Jorner, Andreas Krause |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75921 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30610
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Constrained Flow Optimization via Sequential Fine-Tuning for Molecular Design Sven Gutjahr, Riccardo De Santi, Luca Schaufelberger, Kjell Jorner, Andreas Krause Abstract Adapting generative foundation models, in particular diffusion and flow models, to optimize given reward functions (e.g., binding affinity) while satisfying constraints (e.g., molecular synthesizability) is fundamental for their adoption in real-world scientific discovery applications such as molecular design or protein engineering. While recent works have introduced scalable methods for reward-guided fine-tuning of such models via reinforcement learning and control schemes, it remains an open problem how to algorithmically trade-off reward maximization and constraint satisfaction in a reliable and predictable manner. Motivated by this challenge, we first present a rigorous framework for Constrained Generative Optimization , which brings an optimization viewpoint to the introduced adaptation problem and retrieves the relevant task of constrained generation as a sub-case. Then, we introduce C onstrained F low O ptimization ( CFO ), an algorithm that automatically and provably balances reward maximization and constraint satisfaction by reducing the original problem to sequential fine-tuning via established, scalable methods. We provide convergence guarantees for constrained generative optimization and constrained generation via CFO . Ultimately, we present an experimental evaluation of CFO on both synthetic, yet illustrative, settings, and a molecular design task. Across these evaluations, CFO achieves consistent increases in reward while ensuring high constraint satisfaction, showcasing its practical utility for constrained generative optimization. † † affiliationnotice: Equal contribution 1 Introduction Recent advances in generative modeling, particularly the advent of diffusion ( 23 ; 45 ; 44 ) and flow models ( 32 ) , have led to state-of-the-art performance in several fields such as image synthesis ( 42 ) , biology ( 11 ; 55 ) , and chemistry ( 25 ) . In particular, they have been applied for the design of protein structures ( 56 ) , drug-like molecules ( 18 ) , and DNA sequences ( 46 ) , among others. These generative models excel at capturing complex data distributions and generating realistic samples. However, approximately sampling from the data distribution is insufficient for most real-world discovery applications, where one typically wishes to generate candidates maximizing task-specific rewards , a problem recently denoted by generative optimization ( 14 ; 30 ) . Examples of rewards of interest include binding affinity in drug discovery ( 38 ) , or drug-likeness ( 5 ) . To tackle the generative optimization problem, recent works have introduced scalable fine-tuning methods that adapt a pre-trained flow or diffusion model to maximize a given reward function under KL-regularization from the pre-trained model, via reinforcement learning (RL) or control theoretic methods ( 17 ; 50 ; 47 , e.g.,) . The importance of known constraints in generative optimization. Many generative design and scientific discovery problems require generated samples to satisfy explicit, domain-specific constraints, e.g., bounded toxicity ( 1 ) , synthetic accessibility ( 19 ; 36 ) , or biophysical plausibility of docking poses ( 9 ) . Even though current fine-tuning schemes regularize toward a pre-trained model ( 17 ; 50 ; 47 ) , which limits the distributional drift, they cannot certify hard constraints to be satisfied ( 49 ) . This limitation arises because task-specific constraints may not be encoded in the original dataset or may be learned only imperfectly from finite training data. A naive approach to address such explicit constraints would be to include them as rewards, i.e., as another term in a manually weighted objective function. However, this approach is unreliable in practice, as the appropriate weighting between rewards and constraints varies across tasks and training phases, and needs to be determined through inefficient trial and error. Furthermore, as optimization explores high-reward regions, the chosen weights can unexpectedly favor reward at the expense of constraint satisfaction, yielding samples with attractive rewards, which, however, violate the domain-specific constraints. Driven by these limitations of current flow adaptation methods for constraint satisfaction, we pose the following question: How can we fine-tune a pre-trained flow or diffusion model to reliably and predictably trade-off reward optimization and constraint satisfaction? Our approach. A growing body of work demonstrates that classical optimization ideas can be meaningfully adapted to the fine-tuning of flow and diffusion models, including formulations motivated by mirror descent ( 37 ; 14 ) , chance constraints ( 4 ; 59 ) , and bilevel optimization ( 8 ; 57 ) . Analogously, in this work, we aim to tackle this question by introducing a formal framework for Constrained Generative Optimization (Sec. 3 ) via flow model fine-tuning, which entails adapting a pre-trained flow model to generate samples maximizing a reward function while satisfying arbitrary constraints. Moreover, the proposed formulation retrieves the relevant task of constrained generative modeling as the sub-case where the reward function is constant. Next, we introduce C onstrained F low O ptimization ( CFO ), a dual approach based on the augmented Lagrangian scheme ( 6 ) that turns the constrained objective into a sequence of ordinary generative optimization subproblems. At a high level, CFO alternates between two steps: solving a KL-regularized fine-tuning problem ( 17 ; 50 ) to maximize an augmented reward function, and updating the parameters of the augmented reward using estimated constraint violations on generated samples (see Sec. 4 ). This sequentially tunes the penalty on constraint violations, thereby avoiding the need to manually trade-off weight selection. CFO renders it possible to adapt a pre-trained flow model to maximize expected rewards while enforcing satisfaction of arbitrary constraints and preserving closeness to the pre-trained model. We provide guarantees that ensure constraint satisfaction under the realistic assumptions of an approximate solver, and that achieve reward maximization under a more idealized setting (Sec. 5 ). Finally, we evaluate CFO for both constrained generative optimization and modeling problems, showcasing its performance in both visually interpretable settings and in molecular design tasks, showing constrained optimization of quantum mechanical properties (Sec. 6 ). Our contributions. We present the following contributions: • We formulate Constrained Generative Optimization via flow fine-tuning, capturing the practically relevant task of reward-guided adaptation under given constraints (Sec. 3 ). • We introduce C onstrained F low O ptimization ( CFO ), an augmented Lagrangian-based method that provably tackles the introduced problem via sequential fine-tuning (Sec. 4 ). • We provide guarantees for constrained generation and optimization via CFO under two oracle assumptions, leveraging augmented Lagrangian theory (Sec. 5 ). • We demonstrate CFO ’s ability to trade-off reward maximization and constraint satisfaction in both a visually interpretable setting and a high-dimensional molecular design task (Sec. 6 ). (a) Constrained generative optimization via fine-tuning problem. (b) Adaptation to low-cost area within black line. Figure 1 : ( 1(a) ) Pre-trained and fine-tuned policies inducing densities p^{\text{pre}}_{1} and optimal density p_{1}^{*} w.r.t. reward r increasing downwards and in red a high-cost area. ( 1(b) ) Pre-trained model p^{\text{pre}}_{1} adapts into p_{1}^{*} to maximize r and stay within the constraint region inside the black line. 2 Background and Notation Flow Models. Flow-based generative models constitute a prominent class of approaches for transforming a simple base p^{\text{base}} distribution (e.g., Gaussian) into a complex data distribution p_{\rm{data}} ( 44 ; 45 ; 32 ) . Formally, a flow is a time-dependent map \psi:[0,1]\times\mathbb{R}^{d}\to\mathbb{R}^{d} , where \psi_{t}(x_{0}) denotes