Reinforcement Learning Goal-Reaching Control with Guaranteed Lyapunov-Like Stabilizer for Mobile Robots
Mehdi Heydari Shahna, Seyed Adel Alizadeh Kolagar, Jouni Mattila · 2026
Read Reinforcement Learning Goal-Reaching Control with Guaranteed Lyapunov-Like Stabilizer for Mobile Robots by Mehdi Heydari Shahna, Seyed Adel Alizadeh Kolagar, Jouni Mattila (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19499.txt.
Introduction
Mehdi Heydari Shahna, Seyed Adel Alizadeh Kolagar, and Jouni Mattila work on control systems for mobile robots. They use reinforcement learning, where a robot learns a task by trial and error. Learned policies can perform very well, yet they rarely come with a formal promise that the robot will reach its goal. Safety rules in industry are strict, and unproven behavior is hard to certify.
The authors add a stabilizer with a Lyapunov-like guarantee to the learned controller. In plain terms, the added part keeps the robot's motion pointed toward the goal in a provable way. Trial-and-error learning still shapes the fine details of the motion. The mix aims to keep the skill of learning while adding the proof that factories and standards demand. It is a step toward robots that learn and can still be trusted.
Catalog record
| CREATOR | Mehdi Heydari Shahna, Seyed Adel Alizadeh Kolagar, Jouni Mattila |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19499
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reinforcement Learning Goal-Reaching Control with Guaranteed Lyapunov-Like Stabilizer for Mobile Robots Mehdi Heydari Shahna, Seyed Adel Alizadeh Kolagar, Jouni Mattila Abstract Reinforcement learning (RL) can be highly effective at learning goal-reaching policies, but it typically does not provide formal guarantees that the goal will always be reached. Without formal guarantees, despite RL’s potential to gain performance and autonomy, international standards limit their adoption in operational industries, where exploratory interactions with state action pairs can be hazardous, especially when operating in challenging environments. A common approach to provide formal goal-reaching guarantees is to introduce a shielding mechanism that restricts the agent to actions that satisfy predefined safety constraints. The main challenge here is integrating this mechanism with RL so that learning and exploration remain effective without becoming overly conservative. Hence, this paper proposes an RL-based control framework that provides formal goal-reaching guarantees for wheeled mobile robots operating in unstructured environments. To achieve this, we first design a real-time RL policy with a set of 15 carefully defined reward terms. These rewards encourage the robot to reach both static and dynamic goals while generating sufficiently smooth command signals that comply with predefined safety specifications, which is critical in practice. Second, a Lyapunov-like stabilizer layer is integrated into the benchmark RL framework as a policy supervisor to formally strengthen the goal-reaching control while preserving meaningful exploration of the state action space. The proposed framework is suitable for real-time deployment in challenging environments, as it provides a formal guarantee of convergence to the intended goal states and compensates for uncertainties by generating real-time control signals based on the current state, while respecting real-world motion constraints. The proposed control framework is validated on a 6,000 kg robot operating in a slip-prone terrain. The results show that the proposed Lyapunov-like stabilizer consistently improves the benchmark RL policies, boosting the goal-reaching rate from 84.6 84.6 % to 99.0 99.0 %, sharply reducing failures, and improving efficiency by lowering episode lengths and steps-to-goal while maintaining safe, conservative fallback behavior. Comparative results also showed high performance in the proposed strategy in terms of accuracy and control effort. Nomenclature 1 Introduction Reinforcement learning (RL) involves an agent repeatedly interacting with an environment to learn a control or decision policy that maximizes cumulative reward. It has shown strong performance across many domains, but key challenges remain, including reproducibility, convergence guarantees, and the large amounts of data and training iterations often required [ 8 ] . RL methods are commonly categorized as model-based or model-free. Model-based approaches use known or estimated system dynamics to compute a policy, whereas model-free approaches learn directly from experience without an explicit model, using methods such as value-function learning, policy gradients, and actor-critic algorithms [ 10 ] . In mobile robotics, model-free RL is particularly attractive when accurate dynamics are unavailable or prohibitively expensive to model. However, ensuring that learned policies are safe and satisfy state constraints during real-world operation remains a major challenge [ 7 ] . Hence, international standards limit the adoption of RLs in many operational industries, where exploratory interactions with state action pairs can be hazardous, especially when operating in challenging environments [ 3 ] . For instance, it is rare to find studies that have deployed RL strategies on large-scale robots operating in challenging environments, such as off-road terrain, under significant uncertainty and disturbances, despite RL’s potential to gain performance and autonomy [ 18 ] . Most safety-assured RL methods rely on Lyapunov and barrier certificates, including Control Lyapunov Functions (CLFs), Barrier Lyapunov Functions (BLFs), and Control Barrier Functions (CBFs), to guarantee closed-loop goal reaching and enforce safety constraints. These tools integrate naturally with RL because their conditions can be expressed as constraints involving learnable function approximators [ 10 , 12 ] . In brief, a CLF is used to synthesize control inputs that drive the state toward a desired equilibrium, a BLF enforces state constraints by becoming unbounded at the constraint boundary so trajectories remain within the admissible set, and a CBF guarantees safety by imposing inequality constraints that render a specified safe set forward invariant. Several representative approaches follow this paradigm. Emam et al. [ 6 ] combine RL with a robust CBF-based safety layer that solves a small optimization problem at each time step to minimally modify the policy action while ensuring safety, even under model uncertainty. Because the layer is differentiable, the policy can be trained through it, enabling safe exploration and improved learning in robotic tasks. Zhang et al. [ 22 ] embed BLFs within a backstepping actor-critic design, where the barrier function (BF) term grows rapidly near constraint limits, and Lyapunov analysis maintains boundedness, keeping trajectories within the safe set during learning under uncertainty. Jabari et al. [ 9 ] treat CBF and BLF approaches as safety baselines and propose a monotone tube boundary to enforce tracking-error constraints with less design complexity than CBFs and less conservatism than BLFs. They then use an actor-critic scheme to learn an approximately optimal prescribed-time controller that trades off tracking accuracy and control effort, with the added benefit of reducing power consumption and actuator heating. Chow et al. [ 5 ] cast safe RL as maximizing return subject to a constraint on cumulative safety cost (for example, reaching a goal while limiting collisions). They construct a Lyapunov function from a feasible baseline policy and restrict policy updates to remain within the Lyapunov-feasible set, so safety is maintained during both training and deployment. Zhao et al. [ 23 ] enforce stepwise CBF constraints to keep the state inside a forward-invariant safe set and add a Lyapunov decrease condition using a learned Lyapunov value function (Lyapunov network) to promote stability in control-affine Markov decision process (MDP) settings. When safety and stability cannot be simultaneously satisfied, a backup controller is used. Li et al. [ 11 ] build a CLF from reference tracking error and incorporate both the CLF value and its decay condition into the training reward, shaping learning toward faster convergence and improved robustness while reducing reliance on hand-tuned reward terms (used during training only). Similarly, Anand et al. [ 2 ] discuss CLF-based stability certification in RL, either by interpreting the value function as a Lyapunov function or by enforcing Lyapunov decrease conditions to estimate and expand a safe region of attraction, thereby keeping exploration and the learned policy stable and safe. A key contribution of the mentioned CBFs and BLFs for RLs is that they can preserve safety guarantees based on barrier functions (BFs) throughout exploration while still allowing effective learning. This helps the resulting policy trade off constraint satisfaction with task success, although for general systems, constructing an appropriate BF is often a nontrivial, highly problem-dependent design task within RLs. CLF-based methods for RLs have also demonstrated strong results in both simulation and on small physical robots, supporting safe and efficient exploration in changing environments, but they generally assume a Lyapunov function is available in advance or other hand-crafted safety ingredients (or ad hoc formal derivations, post hoc verification, or extra assumptions that often restrict applicability). Moreover, there is no demonstrated deployment of these ideas on large, multi-ton robotic systems on a challenging environment, where uncertainty and disturbances are often much more severe and destructive. To tackle the