Behavior-Induced Mirror-Prox Temporal-Difference Learning for Faster Off-Policy Prediction Journal: Neurocomputing
Xingguo Chen, Yuchen Shen, Shangdong Yang, Chao Li, Guang Yang, Wenhao Wang · 2026
Read Behavior-Induced Mirror-Prox Temporal-Difference Learning for Faster Off-Policy Prediction Journal: Neurocomputing by Xingguo Chen, Yuchen Shen, Shangdong Yang, Chao Li, Guang Yang, Wenhao Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28849.txt.
Description
Xingguo Chen and five colleagues propose STHTD-MP, a Mirror-Prox TD method for off-policy prediction. Gradient TD methods give stable off-policy guesses. Existing Mirror-Prox methods use the feature spread metric. Hybrid methods suggest behavior-policy moves give a better update shape. STHTD-MP swaps the spread metric in the saddle-point setup for the even part of the Bellman matrix. It keeps one learning rate and a guess-correction step. Math shows this metric is sound and the method shrinks faster than GTD2-MP.
Catalog record
| CREATOR | Xingguo Chen, Yuchen Shen, Shangdong Yang, Chao Li, Guang Yang, Wenhao Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56058 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28849