RoboRAN: A Unified Robotics Framework for Reinforcement Learning-Based Autonomous Navigation
Matteo El-Hariry [email protected], Antoine Richard * [email protected], Ricard M. Castan * [email protected], Luis F. W. Batista * [email protected], Cedric Pradalier [email protected], Matthieu Geist [email protected], Miguel Olivares-Mendez miguel.oli · 2025
Read RoboRAN: A Unified Robotics Framework for Reinforcement Learning-Based Autonomous Navigation by Matteo El-Hariry [email protected], Antoine Richard * [email protected], Ricard M. Castan * [email protected], Luis F. W. Batista * [email protected], Cedric Pradalier [email protected], Matthieu Geist [email protected], Miguel Olivares-Mendez miguel.oli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14526.txt.
Introduction
Matteo El-Hariry and six co-authors build one training ground for navigation robots of every kind. Their 2025 paper presents RoboRAN for reinforcement learning. Robots roam land, water, air, and space, yet training tools usually fit one platform. Fair comparison across machines has been nearly impossible.
The framework swaps robots and tasks freely in shared pipelines. Policies trained in simulation moved onto real machines: a satellite simulator, a surface boat, and a wheeled rover. An open API deploys policies from a popular training library to hardware. Shared tasks and metrics score all domains alike. The testbed spans water, land, and space settings. One yardstick now serves the whole navigation field.
Catalog record
| CREATOR | Matteo El-Hariry [email protected], Antoine Richard * [email protected], Ricard M. Castan * [email protected], Luis F. W. Batista * [email protected], Cedric Pradalier [email protected], Matthieu Geist [email protected], Miguel Olivares-Mendez miguel.oli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-14526
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RoboRAN: A Unified Robotics Framework for Reinforcement Learning-Based Autonomous Navigation Matteo El-Hariry [email protected], Antoine Richard * [email protected], Ricard M. Castan * [email protected], Luis F. W. Batista * [email protected], Cedric Pradalier [email protected], Matthieu Geist [email protected], Miguel Olivares-Mendez [email protected] Abstract Autonomous robots must navigate and operate in diverse environments, from terrestrial and aquatic settings to aerial and space domains. While Reinforcement Learning (RL) has shown promise in training policies for specific autonomous robots, existing frameworks and benchmarks are often constrained to unique platforms, limiting generalization and fair comparisons across different mobility systems. In this paper, we present a multi-domain framework for training, evaluating and deploying RL-based navigation policies across diverse robotic platforms and operational environments. Our work presents four key contributions: (1) a scalable and modular framework, facilitating seamless robot-task interchangeability and reproducible training pipelines; (2) sim-to-real transfer demonstrated through real-world experiments with multiple robots, including a satellite robotic simulator, an unmanned surface vessel, and a wheeled ground vehicle; (3) the release of the first open-source API for deploying Isaac Lab-trained policies to real robots, enabling lightweight inference and rapid field validation; and (4) uniform tasks and metrics for cross-medium evaluation, through a unified evaluation testbed to assess performance of navigation tasks in diverse operational conditions (aquatic, terrestrial and space). By ensuring consistency between simulation and real-world deployment, RoboRAN lowers the barrier to developing adaptable RL-based navigation strategies. Its modular design enables straightforward integration of new robots and tasks through predefined templates, fostering reproducibility and extension to diverse domains. To support the community, we release RoboRAN as open-source 1 1 1 https://github.com/snt-spacer/RoboRAN-Code . Reviewed on OpenReview: https://openreview.net/forum?id=0wDbhLeMj9 1 Introduction One of the main goals of robotics research is to develop autonomous agents capable of navigating and executing tasks in any environment and medium, from terrestrial rovers and aquatic vessels to aerial drones and spacecraft. While Reinforcement Learning (RL) has shown promise in training such agents ( Taheri et al., 2024 ; Wisniewski et al., 2024 ; Tezerjani et al., 2024 ; Surmann et al., 2020 ) , more often than not, the capabilities of these agents are only illustrated on a single robot and on a single task. Existing benchmarks are often restricted to specific robot types and environment settings, limiting generalization and cross-domain comparisons. Although this approach is well suited to grow domain-specific knowledge, it makes it hard to see how one method would transfer to a different system. Hence, to scale RL for robotics, this paradigm must evolve toward more generalizable frameworks, enabling the development of universal solutions and their efficient adaptation to specific systems. Figure 1: RoboRAN supports easy development of RL-based navigation tasks across a diverse set of robots. The five robots shown are Kingfisher, Floating Platform, Turtlebot2, Leatherback, and Jetbot. All have been implemented in simulation, while the first three have also been evaluated and demonstrated in real-world environments. In the literature, we can find many specialized RL frameworks, be it used to control boats ( Batista et al., 2024 ) , satellites ( El-Hariry et al., 2024 ; El-Hariry et al., 2023 ) , or ground rovers ( Perille et al., 2020 ) , but there has been little effort to evaluate these systems under a common structure. With this paper, we introduce RoboRAN, a multi-domain navigation framework focused on robot-task decoupling for simplifying the development and evaluation of RL-based policies across different robots and operational mediums. Our framework enhances Isaac Lab ( Mittal et al., 2023 ) , providing unified tasks and robots definition, and allowing to train one policy per robot-task pair using a shared and extensible training infrastructure. While supporting all the robots shown in Figure 1 , RoboRAN offers the following four contributions: 1. Modular design enabling task-robot interchangeability. Our framework separates robot and task definitions using standardized APIs, minimizing integration overhead and enabling new robot–task pairings without altering existing modules. We demonstrate this interchangeability by training multiple navigation tasks across robots with distinct mobility systems (e.g., thrusters, wheels, water-based propulsion). 2. Sim-to-real transfer across diverse platforms with a single training and deployment pipeline. In contrast to previous work that primarily validates policies on a single robot type, we conduct real-world experiments on three distinct platforms: a Floating Platform, a Boat, and a Turtlebot2. We demonstrate how our simulation platform, with domain randomization and physically grounded disturbances, enables sim-to-real transfer, and report the corresponding performance results across robot-task pairs. 3. Open-source deployment API for Isaac Lab-trained policies. We release the first deployment stack that enables policies trained with skrl or rl_games in Isaac Lab to run directly on real robots. The stack removes dependencies on the Gym wrapper, supports lightweight execution on edge devices, and provides ROS 2 integration and Dockerized workflows for reproducibility, lowering the barrier from training to real-world validation. 4. Unified tasks and metrics for cross-medium evaluation. We provide a common testbed for evaluating navigation strategies in a diverse set of operational conditions (e.g., terrestrial, aquatic, or microgravity environments). This is enabled by a reusable and extensible performance metric layer, applicable across navigation tasks and robot configurations. 2 Related Work Reinforcement Learning (RL) has emerged as a powerful paradigm for control tasks, demonstrating its ability to learn complex policies directly from sensorimotor data. This has led to significant advancements across various domains, including robotic manipulation ( Levine et al., 2015 ) , humanoid locomotion ( Peng et al., 2018 ) , and the control of legged robots ( Lee et al., 2020 ) . While benchmark development has primarily centered on manipulation ( Lee et al., 2019 ; James et al., 2019 ; Zhu et al., 2020 ; Heo et al., 2023 ) , navigation remains a fundamental aspect of embodied intelligence that has gained increasing attention ( Zhu and Zhang, 2021 ; El-Hariry et al., 2023 ) . To facilitate learning-based navigation, numerous simulation environments and physics engines have been developed. Frameworks such as MuJoCo ( Todorov et al., 2012 ) , PyBullet ( Coumans and Bai, 2016 ) , Webots ( Michel, 2004 ) , and Isaac Gym ( Makoviychuk et al., 2021 ) provide efficient and scalable platforms for RL training, but are often constrained to single-domain settings or specific robot morphologies. Isaac Lab ( Mittal et al., 2023 ) extends Isaac Gym by supporting diverse robotic platforms, though it lacks both a structured evaluation suite for benchmarking RL policies across tasks and domains and the flexibility for interchangeable training of multiple tasks across multiple robots. Several recent benchmarks have addressed learning-based navigation under specific environmental and sensory constraints. Habitat ( Savva et al., 2019 ; Szot et al., 2021 ) targets high-level planning and mobile manipulation in photorealistic indoor environments. The BARN challenge ( Perille et al., 2020 ) focuses on low-level control in cluttered scenes, while FlightBench ( Yu et al., 2024 ) benchmarks ego-vision-based navigation for agile quadrotors. Aquatic navigation tasks are considered in ( Corsi et al., 2024 ) , and iGibson 0.5 ( Xia et al., 2019 ) provides an interactive benchmark in household environments. These efforts, however, are typically domain-specific and lack support for robot–task interchangeability or sim-to-real evaluation. Table 1 : Comparison of RoboRAN with existing RL frameworks. Benchmark Domain Diversity Task Types Sim-to-Real Robustness Sensor / Env. Realism