Stochastic Decision Horizons for Constrained Reinforcement Learning

Nikola Milosevic, Leonard Franz, Daniel Haeufle, Georg Martius, Nico Scherf, Pavel Kolev · 2026

Read Stochastic Decision Horizons for Constrained Reinforcement Learning by Nikola Milosevic, Leonard Franz, Daniel Haeufle, Georg Martius, Nico Scherf, Pavel Kolev (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04599.txt.

Description

Nikola Milosevic and 5 co-authors rethink safety limits in reinforcement learning in a 2026 paper on stochastic decision horizons. Instead of treating each rule violation as spending from a fixed budget, their framework shortens the agent's effective planning horizon when violations occur.

That change cuts both present reward credit and reliance on future estimates. The authors show it represents a survival-style constraint and derive two algorithms compatible with replayed experience. One ends the episode after violations; the other stops reward credit while play continues. Tests included a highly muscled simulated humanoid and standard safety tasks. One algorithm reached strong gait quality far earlier than its reference and trained more stably.

Catalog record

CREATORNikola Milosevic, Leonard Franz, Daniel Haeufle, Georg Martius, Nico Scherf, Pavel Kolev
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE118 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04599

Browse the full library · About the Tower of Babel