GPU-Parallel Multi-Task Reinforcement Learning with Demonstration Guided Policy Optimization

Rui Zhang, Qiwei Wu, Zhengyu Zhang, Tao Li, Yunrong Guo, Junjie Lai, Renjing Xu, Weihua Zhang · 2026

Read GPU-Parallel Multi-Task Reinforcement Learning with Demonstration Guided Policy Optimization by Rui Zhang, Qiwei Wu, Zhengyu Zhang, Tao Li, Yunrong Guo, Junjie Lai, Renjing Xu, Weihua Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03335.txt.

Description

Zhang and a large team build a GPU-parallel benchmark for robot learning across many tasks. GPU simulation gives rich robot interaction, but past benchmarks rarely mix that scale with varied manipulation tasks and standard multi-task scoring. Their benchmark, Hebero, runs in Isaac Lab. One policy can train and be scored on all 40 tasks at once.

To learn from sparse rewards and few demos, the team adds a method that reuses demos for dense tracking rewards and asymmetric value learning. A signal of per-task progress steers it. Demo guidance fades as a task improves, and lagging tasks get more weight in updates. With 50 demos per task, the method hit about 90 percent mean success on state input. Its visual form reached about 93.5 percent. A single policy trained in simulation then did four tasks on a real Piper robot.

Catalog record

CREATORRui Zhang, Qiwei Wu, Zhengyu Zhang, Tao Li, Yunrong Guo, Junjie Lai, Renjing Xu, Weihua Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03335

Browse the full library · About the Tower of Babel