Intentional Updates for Streaming Reinforcement Learning

Arsalan Sharifnassab, Mohamed Elsayed, Kris De Asis, A. Rupam Mahmood, Richard S. Sutton · 2026

Read Intentional Updates for Streaming Reinforcement Learning by Arsalan Sharifnassab, Mohamed Elsayed, Kris De Asis, A. Rupam Mahmood, Richard S. Sutton (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19033.txt.

Description

Sharifnassab and four colleagues propose intentional updates for streaming learning. A step size in parameter units gives no predictable output change, destabilizing streaming learning at batch size one. Instead, they specify the intended update outcome first, then solve for the step size that nearly achieves it. Intentional TD targets a fixed fractional TD error cut; Intentional Policy Gradient bounds per step policy change and local KL divergence. Practical versions combine eligibility traces with diagonal scaling. Empirically, the methods match batch approaches with state of the art streaming performance.

Catalog record

CREATORArsalan Sharifnassab, Mohamed Elsayed, Kris De Asis, A. Rupam Mahmood, Richard S. Sutton
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49385
LICENSEhttp://creativecommons.org/publicdomain/zero/1.0/
RIGHTSCC0
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19033

Browse the full library · About the Tower of Babel