Safe Planning and Policy Optimization via World Model Learning

Artem Latyshev, Gregory Gorbov, Aleksandr I. Panov · 2025

Read Safe Planning and Policy Optimization via World Model Learning by Artem Latyshev, Gregory Gorbov, Aleksandr I. Panov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04828.txt.

Description

Artem Latyshev, Gregory Gorbov, and Aleksandr Panov present a learning framework for control tasks where a wrong move can cause real harm, in a 2025 paper. Model-based reinforcement learning plans ahead with a learned model of the world, but model errors can turn plans dangerous. The team aims to gain the speed of planning without trusting the model blindly.

Their method switches on the fly between acting on the plan and acting on a direct policy, based on how reliable the model looks. Safety limits also shift as the agent grows more capable, rather than staying fixed. The goal at each step is to beat the safe fallback choice on both safety and performance, not merely to clear a bar. On a range of hard continuous control tasks with safety rules, the method beat non-adaptive rivals.

Catalog record

CREATORArtem Latyshev, Gregory Gorbov, Aleksandr I. Panov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-04828

Browse the full library · About the Tower of Babel