Diamond Maps: Efficient Reward Alignment via Stochastic Flow Maps
Peter Holderrieth, Douglas Chen, Luca Eyring, Ishin Shah, Giri Anantharaman, Yutong He, Zeynep Akata, Tommi Jaakkola, Nicholas Matthew Boffi, Max Simchowitz · 2026
Read Diamond Maps: Efficient Reward Alignment via Stochastic Flow Maps by Peter Holderrieth, Douglas Chen, Luca Eyring, Ishin Shah, Giri Anantharaman, Yutong He, Zeynep Akata, Tommi Jaakkola, Nicholas Matthew Boffi, Max Simchowitz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05993.txt.
Description
Flow and diffusion models make fine samples, but steering them toward a user's taste after training is slow and fragile. Peter Holderrieth and nine co-authors argue that easy steering should be built into the model, not bolted on later. Their answer is Diamond Maps, stochastic flow-map models that line up with any reward at run time, with no retraining.
The trick is to fold many simulation steps into a one-step sampler while keeping the randomness that good alignment needs. That keeps search, sequential Monte Carlo, and guidance cheap, since the value function can be estimated cleanly. The maps learn well by distillation from GLASS Flows, align more strongly than current methods, and scale better as effort grows. The work points to generative models that bend to new tastes on demand.
Catalog record
| CREATOR | Peter Holderrieth, Douglas Chen, Luca Eyring, Ishin Shah, Giri Anantharaman, Yutong He, Zeynep Akata, Tommi Jaakkola, Nicholas Matthew Boffi, Max Simchowitz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05993