Lookahead Sample Reward Guidance for Test-Time Scaling of Diffusion Models

Yeongmin Kim, Donghyeok Shin, Byeonghu Na, Minsang Park, Richard Lee Kim, Il-Chul Moon · 2026

Read Lookahead Sample Reward Guidance for Test-Time Scaling of Diffusion Models by Yeongmin Kim, Donghyeok Shin, Byeonghu Na, Minsang Park, Richard Lee Kim, Il-Chul Moon (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03211.txt.

Description

Guiding diffusion sampling toward higher-reward images without backpropagation is achieved by Yeongmin Kim and a group of 5 collaborators. Generated samples often miss human intent, so test-time scaling seeks regions with higher human-aligned reward. Computing expected future reward is hard. Backward rollouts cost too much, while common approximations suffer bias and sampling problems that distort the guidance signal during generation.

The authors show expected future reward can be computed from marginal samples of a pretrained model alone, giving closed-form guidance with no neural backpropagation. A few-step lookahead sampler then steers particles toward high-reward lookahead samples. Their LiDAR sampling matched the latest gradient guidance method on a generation benchmark at nearly ten times the speed. Code is released.

Catalog record

CREATORYeongmin Kim, Donghyeok Shin, Byeonghu Na, Minsang Park, Richard Lee Kim, Il-Chul Moon
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03211

Browse the full library · About the Tower of Babel