TD-MPC-Opt: Distilling Model-Based Multi-Task Reinforcement Learning Agents

Dmytro Kuzmenko, Nadiya Shvai · 2025

Read TD-MPC-Opt: Distilling Model-Based Multi-Task Reinforcement Learning Agents by Dmytro Kuzmenko, Nadiya Shvai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01823.txt.

Description

Dmytro Kuzmenko and Nadiya Shvai show in 2025 how a large multi task learning agent can be distilled into a model more than three hundred times smaller. Big world model agents learn many tasks well but are too heavy for small devices. Their method transfers the skill of a 317 million parameter agent into a one million parameter model.

On a thirty task test suite, the small model beat the score of a like sized model trained directly, by a wide margin. That shows the transfer kept much of the big agent's joint knowledge. A further step that stores the weights at half precision cut the file size by about half again. Compact agents that keep their skill could run on robots and edge devices where big models cannot fit.

Catalog record

CREATORDmytro Kuzmenko, Nadiya Shvai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-01823

Browse the full library · About the Tower of Babel