Cross-Domain Offline Policy Adaptation with Dynamics- and Value-Aligned Data Filtering

Zhongjian Qiao, Rui Yang, Jiafei Lyu, Chenjia Bai, Xiu Li, Zhuoran Yang, Siyang Gao, Shuang Qiu · 2025

Read Cross-Domain Offline Policy Adaptation with Dynamics- and Value-Aligned Data Filtering by Zhongjian Qiao, Rui Yang, Jiafei Lyu, Chenjia Bai, Xiu Li, Zhuoran Yang, Siyang Gao, Shuang Qiu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02435.txt.

Description

Zhongjian Qiao and seven co-authors work on teaching agents from logged data when the world changes. An agent trained for one setting may be deployed in another that moves in different ways. Logs from the new setting may be scarce, while logs from the old one are plentiful.

Mixing both datasets naively can hurt, since the old data follows different dynamics. The team's method filters the data, keeping samples that align in both dynamics and value. Cleaner training data should help agents adapt to a new setting without fresh trial and error in the real world. The filter keeps what helps and drops what would pull the agent off its course.

Catalog record

CREATORZhongjian Qiao, Rui Yang, Jiafei Lyu, Chenjia Bai, Xiu Li, Zhuoran Yang, Siyang Gao, Shuang Qiu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-02435

Browse the full library · About the Tower of Babel