Intentional Updates for Streaming Reinforcement Learning
Arsalan Sharifnassab, Mohamed Elsayed, Kris De Asis, A. Rupam Mahmood, Richard S. Sutton · 2026
Read Intentional Updates for Streaming Reinforcement Learning by Arsalan Sharifnassab, Mohamed Elsayed, Kris De Asis, A. Rupam Mahmood, Richard S. Sutton (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19033.txt.
Description
Sharifnassab and four colleagues propose intentional updates for streaming learning. A step size in parameter units gives no predictable output change, destabilizing streaming learning at batch size one. Instead, they specify the intended update outcome first, then solve for the step size that nearly achieves it. Intentional TD targets a fixed fractional TD error cut; Intentional Policy Gradient bounds per step policy change and local KL divergence. Practical versions combine eligibility traces with diagonal scaling. Empirically, the methods match batch approaches with state of the art streaming performance.
Catalog record
| CREATOR | Arsalan Sharifnassab, Mohamed Elsayed, Kris De Asis, A. Rupam Mahmood, Richard S. Sutton |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49385 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.19033