Intrinsic Credit Assignment for Long Horizon Interaction

Ilze Amanda Auzina, Joschka Strüber, Sergio Hernández-Gutiérrez, Shashwat Goel, Ameya Prabhu, Matthias Bethge · 2026

Read Intrinsic Credit Assignment for Long Horizon Interaction by Ilze Amanda Auzina, Joschka Strüber, Sergio Hernández-Gutiérrez, Shashwat Goel, Ameya Prabhu, Matthias Bethge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-12342.txt.

Description

Agents that must act over long horizons face a credit problem: which middle steps actually helped? Ilze Amanda Auzina led this work with five co-authors, proposing DeltaBelief-RL, which rewards intermediate progress using the language model's own beliefs. Credit follows the change in probability the agent assigns to the target solution, rather than waiting for a final outcome alone.

Training on synthetic interaction data teaches information-seeking skills that beat purely outcome-based rewards, and gains carry to out-of-distribution uses from customer service to personalisation. Performance keeps improving as test-time interactions run beyond the training horizon, with interaction efficiency rising even on Pass at k measures. The method offers a scalable way to teach agents to navigate uncertainty step by step.

Catalog record

CREATORIlze Amanda Auzina, Joschka Strüber, Sergio Hernández-Gutiérrez, Shashwat Goel, Ameya Prabhu, Matthias Bethge
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE124 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-12342

Browse the full library · About the Tower of Babel