Safe Online Learning via Smooth Safety-Structured Policy Composition

Hongpeng Cao [email protected] of Engineering and DesignTechnical University of MunichGarching, Munich 85748, Germany, Liqun Zhao [email protected] of Engineering ScienceUniversity of OxfordOxford OX1 3PJ, United Kingdom, Yuliang Gu [email protected] of Mechanical Science and EngineeringUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Naira Hovakimyan [email protected] of Mechanical Science and EngineeringUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Lui Sha [email protected] of Computer ScienceUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Marco Caccamo [email protected] of Engineering and DesignTechnical University of MunichGarching, Munich 85748, Germany · 2026

Read Safe Online Learning via Smooth Safety-Structured Policy Composition by Hongpeng Cao [email protected] of Engineering and DesignTechnical University of MunichGarching, Munich 85748, Germany, Liqun Zhao [email protected] of Engineering ScienceUniversity of OxfordOxford OX1 3PJ, United Kingdom, Yuliang Gu [email protected] of Mechanical Science and EngineeringUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Naira Hovakimyan [email protected] of Mechanical Science and EngineeringUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Lui Sha [email protected] of Computer ScienceUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Marco Caccamo [email protected] of Engineering and DesignTechnical University of MunichGarching, Munich 85748, Germany (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31320.txt.

Description

Cao and five colleagues present AutoSafe, an architecture for reinforcement learning that must stay safe while it learns online. Hard action blocking keeps a system safe but jerks the interaction and the learning signal. Soft penalty terms keep learning smooth yet give weak safety promises, and neither extreme suits live control.

AutoSafe builds safety monitoring and intervention into the action generator itself. The policy then slides smoothly between performance-driven and safety-preserving behaviour as risk changes, instead of switching with a jolt. Learning and interaction stay continuous, which helps both training stability and real behaviour. Tests across continuous control suites back the design, and the authors frame structured composition, not after-the-fact filtering, as the way to join safety with steady online learning.

Catalog record

CREATORHongpeng Cao [email protected] of Engineering and DesignTechnical University of MunichGarching, Munich 85748, Germany, Liqun Zhao [email protected] of Engineering ScienceUniversity of OxfordOxford OX1 3PJ, United Kingdom, Yuliang Gu [email protected] of Mechanical Science and EngineeringUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Naira Hovakimyan [email protected] of Mechanical Science and EngineeringUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Lui Sha [email protected] of Computer ScienceUniversity of Illinois Urbana-ChampaignUrbana, IL 61801, USA Marco Caccamo [email protected] of Engineering and DesignTechnical University of MunichGarching, Munich 85748, Germany
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.31320

Browse the full library · About the Tower of Babel