Behavior-Induced Mirror-Prox Temporal-Difference Learning for Faster Off-Policy Prediction Journal: Neurocomputing

Xingguo Chen, Yuchen Shen, Shangdong Yang, Chao Li, Guang Yang, Wenhao Wang · 2026

Read Behavior-Induced Mirror-Prox Temporal-Difference Learning for Faster Off-Policy Prediction Journal: Neurocomputing by Xingguo Chen, Yuchen Shen, Shangdong Yang, Chao Li, Guang Yang, Wenhao Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28849.txt.

Description

Xingguo Chen and five colleagues propose STHTD-MP, a Mirror-Prox TD method for off-policy prediction. Gradient TD methods give stable off-policy guesses. Existing Mirror-Prox methods use the feature spread metric. Hybrid methods suggest behavior-policy moves give a better update shape. STHTD-MP swaps the spread metric in the saddle-point setup for the even part of the Bellman matrix. It keeps one learning rate and a guess-correction step. Math shows this metric is sound and the method shrinks faster than GTD2-MP.

Catalog record

CREATORXingguo Chen, Yuchen Shen, Shangdong Yang, Chao Li, Guang Yang, Wenhao Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56058
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28849

Browse the full library · About the Tower of Babel