Beyond Shallow Behavior: Task-Efficient Value-Based Multi-Task Offline MARL via Skill Discovery

Xun Wang ∗, Zhuoran Li ∗, Hai Zhong, Longbo Huang † · 2025

Read Beyond Shallow Behavior: Task-Efficient Value-Based Multi-Task Offline MARL via Skill Discovery by Xun Wang ∗, Zhuoran Li ∗, Hai Zhong, Longbo Huang † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08985.txt.

Description

Xun Wang and co-authors teach game agents many tasks at once from logged play, in a 2025 paper. Offline learning from past records suits fields where live trials are costly, but most methods train one task at a time. Their method, SD-CQL, instead finds reusable skills hidden in the records.

Skills are learned by rebuilding what the next scene should look like, not by copying moves. The method scores set and flexible actions apart, then picks the best action per skill with a cautious value method. Tests on StarCraft II gave the best score on 13 of 14 task sets, with gains up to 68.9 percent on single sets. Small training sets still spread to new tasks well.

Catalog record

CREATORXun Wang ∗, Zhuoran Li ∗, Hai Zhong, Longbo Huang †
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08985

Browse the full library · About the Tower of Babel