Safe Planning and Policy Optimization via World Model Learning
Artem Latyshev, Gregory Gorbov, Aleksandr I. Panov · 2025
Read Safe Planning and Policy Optimization via World Model Learning by Artem Latyshev, Gregory Gorbov, Aleksandr I. Panov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04828.txt.
Description
Artem Latyshev, Gregory Gorbov, and Aleksandr Panov present a learning framework for control tasks where a wrong move can cause real harm, in a 2025 paper. Model-based reinforcement learning plans ahead with a learned model of the world, but model errors can turn plans dangerous. The team aims to gain the speed of planning without trusting the model blindly.
Their method switches on the fly between acting on the plan and acting on a direct policy, based on how reliable the model looks. Safety limits also shift as the agent grows more capable, rather than staying fixed. The goal at each step is to beat the safe fallback choice on both safety and performance, not merely to clear a bar. On a range of hard continuous control tasks with safety rules, the method beat non-adaptive rivals.
Catalog record
| CREATOR | Artem Latyshev, Gregory Gorbov, Aleksandr I. Panov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-04828