Learnable Chernoff Baselines for Inference-Time Alignment
Sunil Madhow, Yuchen Liang, Ness Shroff, Yingbin Liang, Yu-Xiang Wang · 2026
Read Learnable Chernoff Baselines for Inference-Time Alignment by Sunil Madhow, Yuchen Liang, Ness Shroff, Yingbin Liang, Yu-Xiang Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07738.txt.
Description
Aligning a generative model with a reward at inference time usually means costly sampling tricks or model-specific surgery. Sunil Madhow and four co-authors propose Learnable Chernoff Baselines, a method that approximates the ideal reward-tilted distribution using only black-box samples from the pretrained model.
The approach uses rejection sampling with acceptance probabilities learned on the fly, giving fine control over how much extra compute alignment consumes. Theory bounds the distance to the ideal aligned model, and tests on continuous and discrete diffusion models show close matches to exact rejection sampling with far fewer model queries. The paper gives practitioners a cheaper, portable route to inference-time alignment.
Catalog record
| CREATOR | Sunil Madhow, Yuchen Liang, Ness Shroff, Yingbin Liang, Yu-Xiang Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 133 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07738