Accelerating Model-Based Reinforcement Learning with State-Space World Models
Maria Krinner 1 , Elie Aljalbout 1 , Angel Romero, Davide Scaramuzza · 2025
Read Accelerating Model-Based Reinforcement Learning with State-Space World Models by Maria Krinner 1 , Elie Aljalbout 1 , Angel Romero, Davide Scaramuzza (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20168.txt.
Description
Maria Krinner, Elie Aljalbout, Angel Romero, and Davide Scaramuzza published this robotics paper in 2025. Model-based reinforcement learning teaches a robot both a control policy and a world model, a simulator of its own environment learned from experience. The world model makes learning far more sample-efficient, but training it is slow, and that cost blocks use on complex real machines.
The team's fix uses state-space models, a sequence architecture that allows the dynamics training to run in parallel. Their design also feeds the world model extra privileged information during training, which helps when the robot cannot see the full state. Tests on agile quadrotor flight tasks showed world model training up to ten times faster and total training up to four times faster. Performance and sample efficiency matched leading methods, so the speedup came at no cost in quality.
Catalog record
| CREATOR | Maria Krinner 1 , Elie Aljalbout 1 , Angel Romero, Davide Scaramuzza |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-20168