Learnable Chernoff Baselines for Inference-Time Alignment

Sunil Madhow, Yuchen Liang, Ness Shroff, Yingbin Liang, Yu-Xiang Wang · 2026

Read Learnable Chernoff Baselines for Inference-Time Alignment by Sunil Madhow, Yuchen Liang, Ness Shroff, Yingbin Liang, Yu-Xiang Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07738.txt.

Description

Aligning a generative model with a reward at inference time usually means costly sampling tricks or model-specific surgery. Sunil Madhow and four co-authors propose Learnable Chernoff Baselines, a method that approximates the ideal reward-tilted distribution using only black-box samples from the pretrained model.

The approach uses rejection sampling with acceptance probabilities learned on the fly, giving fine control over how much extra compute alignment consumes. Theory bounds the distance to the ideal aligned model, and tests on continuous and discrete diffusion models show close matches to exact rejection sampling with far fewer model queries. The paper gives practitioners a cheaper, portable route to inference-time alignment.

Catalog record

CREATORSunil Madhow, Yuchen Liang, Ness Shroff, Yingbin Liang, Yu-Xiang Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE133 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07738

Browse the full library · About the Tower of Babel