Learning with Expert Abstractions for Efficient Multi-Task Continuous Control
Jeff Jewett, Sandhya Saisubramanian · 2025
Read Learning with Expert Abstractions for Efficient Multi-Task Continuous Control by Jeff Jewett, Sandhya Saisubramanian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14809.txt.
Description
Jeff Jewett and Sandhya Saisubramanian teach control policies, in a 2025 preprint, by planning over sketches drawn by human experts. In complex continuous tasks, exact models are hard to write and trial-and-error learning is slow. Experts often can sketch the task's broad shape, though, even when details escape them. Older layered methods lean on such sketches mostly in discrete settings. They fail to carry learning across tasks too. The authors build a hierarchy that plans dynamically over the expert's sketch.
The planner sets subgoals, and a goal-conditioned policy learns to reach them. Sparse rewards are padded using the sketch's value estimates. Tests ran on suites of machine-generated continuous control tasks. The method beat rival hierarchical learners on learning speed and task completion. It also scaled to harder tasks. Policies from some tasks handled new ones with no extra training, a zero-shot transfer the authors stress.
Catalog record
| CREATOR | Jeff Jewett, Sandhya Saisubramanian |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14809