Diamond Maps: Efficient Reward Alignment via Stochastic Flow Maps

Peter Holderrieth, Douglas Chen, Luca Eyring, Ishin Shah, Giri Anantharaman, Yutong He, Zeynep Akata, Tommi Jaakkola, Nicholas Matthew Boffi, Max Simchowitz · 2026

Read Diamond Maps: Efficient Reward Alignment via Stochastic Flow Maps by Peter Holderrieth, Douglas Chen, Luca Eyring, Ishin Shah, Giri Anantharaman, Yutong He, Zeynep Akata, Tommi Jaakkola, Nicholas Matthew Boffi, Max Simchowitz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05993.txt.

Description

Flow and diffusion models make fine samples, but steering them toward a user's taste after training is slow and fragile. Peter Holderrieth and nine co-authors argue that easy steering should be built into the model, not bolted on later. Their answer is Diamond Maps, stochastic flow-map models that line up with any reward at run time, with no retraining.

The trick is to fold many simulation steps into a one-step sampler while keeping the randomness that good alignment needs. That keeps search, sequential Monte Carlo, and guidance cheap, since the value function can be estimated cleanly. The maps learn well by distillation from GLASS Flows, align more strongly than current methods, and scale better as effort grows. The work points to generative models that bend to new tastes on demand.

Catalog record

CREATORPeter Holderrieth, Douglas Chen, Luca Eyring, Ishin Shah, Giri Anantharaman, Yutong He, Zeynep Akata, Tommi Jaakkola, Nicholas Matthew Boffi, Max Simchowitz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05993

Browse the full library · About the Tower of Babel