Intrinsic Credit Assignment for Long Horizon Interaction
Ilze Amanda Auzina, Joschka Strüber, Sergio Hernández-Gutiérrez, Shashwat Goel, Ameya Prabhu, Matthias Bethge · 2026
Read Intrinsic Credit Assignment for Long Horizon Interaction by Ilze Amanda Auzina, Joschka Strüber, Sergio Hernández-Gutiérrez, Shashwat Goel, Ameya Prabhu, Matthias Bethge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-12342.txt.
Description
Agents that must act over long horizons face a credit problem: which middle steps actually helped? Ilze Amanda Auzina led this work with five co-authors, proposing DeltaBelief-RL, which rewards intermediate progress using the language model's own beliefs. Credit follows the change in probability the agent assigns to the target solution, rather than waiting for a final outcome alone.
Training on synthetic interaction data teaches information-seeking skills that beat purely outcome-based rewards, and gains carry to out-of-distribution uses from customer service to personalisation. Performance keeps improving as test-time interactions run beyond the training horizon, with interaction efficiency rising even on Pass at k measures. The method offers a scalable way to teach agents to navigate uncertainty step by step.
Catalog record
| CREATOR | Ilze Amanda Auzina, Joschka Strüber, Sergio Hernández-Gutiérrez, Shashwat Goel, Ameya Prabhu, Matthias Bethge |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 124 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-12342