Projected Gradient Ascent for Efficient Reward-Guided Updates with One-Step Generative Models

Jisung Hwang, Minhyuk Sung · 2026

Read Projected Gradient Ascent for Efficient Reward-Guided Updates with One-Step Generative Models by Jisung Hwang, Minhyuk Sung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08646.txt.

Description

Reward-guided generation with one-step models can be unlocked by optimizing noise at test time, but that trick invites reward hacking and runs slowly. Jisung Hwang and Minhyuk Sung propose gradient preconditioning to make it efficient and reliable. Their arXiv paper projects reward gradients onto a compact spectral set that captures white Gaussian noise statistics.

Each update is reshaped into a noise-aligned direction, driving faster reward ascent while blocking hacking. The projection is closed-form with fast-Fourier-transform complexity, adding negligible overhead. On FLUX with four reward models, the method matches the leading regularized method's aesthetic score using only thirty percent of its wall-clock time. Readers get a cheap guardrail for test-time reward optimization.

Catalog record

CREATORJisung Hwang, Minhyuk Sung
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08646

Browse the full library · About the Tower of Babel