Accelerating Model-Based Reinforcement Learning with State-Space World Models

Maria Krinner 1 , Elie Aljalbout 1 , Angel Romero, Davide Scaramuzza · 2025

Read Accelerating Model-Based Reinforcement Learning with State-Space World Models by Maria Krinner 1 , Elie Aljalbout 1 , Angel Romero, Davide Scaramuzza (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20168.txt.

Description

Maria Krinner, Elie Aljalbout, Angel Romero, and Davide Scaramuzza published this robotics paper in 2025. Model-based reinforcement learning teaches a robot both a control policy and a world model, a simulator of its own environment learned from experience. The world model makes learning far more sample-efficient, but training it is slow, and that cost blocks use on complex real machines.

The team's fix uses state-space models, a sequence architecture that allows the dynamics training to run in parallel. Their design also feeds the world model extra privileged information during training, which helps when the robot cannot see the full state. Tests on agile quadrotor flight tasks showed world model training up to ten times faster and total training up to four times faster. Performance and sample efficiency matched leading methods, so the speedup came at no cost in quality.

Catalog record

CREATORMaria Krinner 1 , Elie Aljalbout 1 , Angel Romero, Davide Scaramuzza
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-20168

Browse the full library · About the Tower of Babel