Projected Gradient Ascent for Efficient Reward-Guided Updates with One-Step Generative Models
Jisung Hwang, Minhyuk Sung · 2026
Read Projected Gradient Ascent for Efficient Reward-Guided Updates with One-Step Generative Models by Jisung Hwang, Minhyuk Sung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08646.txt.
Description
Reward-guided generation with one-step models can be unlocked by optimizing noise at test time, but that trick invites reward hacking and runs slowly. Jisung Hwang and Minhyuk Sung propose gradient preconditioning to make it efficient and reliable. Their arXiv paper projects reward gradients onto a compact spectral set that captures white Gaussian noise statistics.
Each update is reshaped into a noise-aligned direction, driving faster reward ascent while blocking hacking. The projection is closed-form with fast-Fourier-transform complexity, adding negligible overhead. On FLUX with four reward models, the method matches the leading regularized method's aesthetic score using only thirty percent of its wall-clock time. Readers get a cheap guardrail for test-time reward optimization.
Catalog record
| CREATOR | Jisung Hwang, Minhyuk Sung |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08646