Learning To Sample From Diffusion Models Via Inverse Reinforcement Learning

Constant Bourdrez, Alexandre Vérine, Olivier Cappé · 2026

Read Learning To Sample From Diffusion Models Via Inverse Reinforcement Learning by Constant Bourdrez, Alexandre Vérine, Olivier Cappé (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08689.txt.

Description

Diffusion models generate images by iterative denoising, but the sampling recipe itself, schedules, guidance, and randomness, usually needs costly grid search. Constant Bourdrez and two co-authors propose learning that recipe with inverse reinforcement learning, without retraining the denoiser. Their arXiv paper frames sampling as a finite-horizon decision process.

Actions modify sampling dynamics, and policy-gradient methods match the target sampler behavior directly, avoiding an explicit reward function. Tests show the learned sampler matches fine-tuned samplers at modest cost. On ImageNet-64, one training run stands in for exhaustive search at up to nine times lower cost, with only sixteen percent inference overhead. Readers get a cheaper way to tune diffusion samplers.

Catalog record

CREATORConstant Bourdrez, Alexandre Vérine, Olivier Cappé
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08689

Browse the full library · About the Tower of Babel