Dual-Robust Cross-Domain Offline Reinforcement Learning Against Dynamics Shifts

Zhongjian Qiao, Rui Yang, Jiafei Lyu, Xiu Li, Zhongxiang Dai, Zhuoran Yang, Siyang Gao, Shuang Qiu · 2025

Read Dual-Robust Cross-Domain Offline Reinforcement Learning Against Dynamics Shifts by Zhongjian Qiao, Rui Yang, Jiafei Lyu, Xiu Li, Zhongxiang Dai, Zhuoran Yang, Siyang Gao, Shuang Qiu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02486.txt.

Description

Zhongjian Qiao and seven co-authors return to offline reinforcement learning, where agents learn from stored logs. One dataset rarely covers every case an agent will meet. Borrowing logs from a related setting helps, but that setting may obey different dynamics.

Past work mostly guards against shifts in the training data itself. Deployment brings a second risk: the live setting may drift again after training ends. The team's dual robust method defends against both kinds of shift at once. Agents that stay steady under change are safer for real tasks like driving, robotics, and operations. Tests in the wild, not just in the lab, will show how far this dual guard holds.

Catalog record

CREATORZhongjian Qiao, Rui Yang, Jiafei Lyu, Xiu Li, Zhongxiang Dai, Zhuoran Yang, Siyang Gao, Shuang Qiu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE110 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-02486

Browse the full library · About the Tower of Babel