RL-AVIST: Reinforcement Learning for Autonomous Visual Inspection of Space Targets
2025
Read RL-AVIST: Reinforcement Learning for Autonomous Visual Inspection of Space Targets (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22699.txt.
Introduction
Spacecraft that inspect large orbital targets must maneuver precisely while models of their motion stay imperfect. Matteo El-Hariry, Andrej Orsula, Matthieu Geist, and Miguel Olivares-Mendez introduce RL-AVIST in 2025, a reinforcement learning framework for autonomous visual inspection of space targets.
Using a high fidelity robotics simulator, they train agents with a model based method called DreamerV3 and compare two model free baselines. Tasks involve three dimensional proximity flight around targets such as the Lunar Gateway. Both general agents trained on varied velocities and specialist agents following fixed inspection paths are tested. Model based learning shows promise in path accuracy and sample efficiency across spacecraft shapes.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22699
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RL-AVIST: Reinforcement Learning for Autonomous Visual Inspection of Space Targets Abstract The growing need for autonomous on-orbit services such as inspection, maintenance, and situational awareness calls for intelligent spacecraft capable of complex maneuvers around large orbital targets. Traditional control systems often fall short in adaptability, especially under model uncertainties, multi-spacecraft configurations, or dynamically evolving mission contexts. This paper introduces RL-AVIST, a Reinforcement Learning framework for Autonomous Visual Inspection of Space Targets. Leveraging the Space Robotics Bench (SRB), we simulate high-fidelity 6-DOF spacecraft dynamics and train agents using DreamerV3, a state-of-the-art model-based RL algorithm, with PPO and TD3 as model-free baselines. Our investigation focuses on 3D proximity maneuvering tasks around targets such as the Lunar Gateway and other space assets. We evaluate task performance under two complementary regimes: generalized agents trained on randomized velocity vectors, and specialized agents trained to follow fixed trajectories emulating known inspection orbits. Furthermore, we assess the robustness and generalization of policies across multiple spacecraft morphologies and mission domains. Results demonstrate that model-based RL offers promising capabilities in trajectory fidelity, and sample efficiency, paving the way for scalable, retrainable control solutions for future space operations. \IACaffiliation Space Robotics Research Group, SnT, University of [email protected] \IACaffiliation Earth Species Project \IACauthor Matteo El Hariry1 \IACauthor Andrej Orsula1 \IACauthor Matthieu Geist2 \IACauthor Miguel Olivares Mendez1 1 Introduction The next generation of space exploration missions will require increased levels of autonomy for spacecraft operating in complex orbital environments [ 1 ] . Key mission capabilities, such as structural inspection, proximity operations, and situational awareness, are often constrained by communication delays, model uncertainties, and dynamically changing conditions in the space environment [ 2 ] . To meet these challenges, intelligent control architectures capable of real-time adaptation and generalization are a promising solution. Traditional controllers, based on analytical models and hand-tuned parameters, struggle to scale with such demands. Recent advances in reinforcement learning (RL) offer a promising alternative: instead of relying on explicit modeling, an agent learns to infer effective control policies through interaction with its environment. This is especially beneficial in proximity operations, where unmodeled disturbances or fuel constraints require a high degree of flexibility. Model-free RL has already demonstrated viability in tasks such as waypoint tracking on rough terrain [ 3 ] , but remains sample-inefficient and brittle when generalization across multiple vehicle configurations is required. Figure 1: Training of multiple CubeSat morphologies to follow randomized velocity vectors in the vicinity of the Lunar Gateway. The target structure is shown for visual context only, while the agents learn generalist control policies through diverse randomized conditions. In this work, we present RL-AVIST, Reinforcement Learning for Autonomous Visual Inspection of Space Targets. The framework is built on the Space Robotics Bench (SRB) [ 4 ] , enabling high-fidelity simulation of spacecraft dynamics with support for multiple morphologies and inspection targets. Fig. 1 , displays different cubesats spawned closeby the Lunar Gateway target during a training episode. Unlike prior work focused on ground rovers or 2D proximity operations, RL-AVIST operates in 3D and models continuous-thrust dynamics suited for spacecraft maneuvering. Our approach leverages Dreamer, a model-based RL algorithm [ 5 ] , to learn compact latent-space models of system dynamics, enabling efficient trajectory planning and control. We compare DreamerV3 with strong model-free baselines such as Proximal Policy Optimization (PPO) [ 6 ] and Twin Delayed DDPG (TD3) [ 7 ] across multiple inspection tasks. Agents are trained under two main regimes: one that exposes them to randomized velocity commands to test general adaptability, and another that trains them on specific orbital patterns for structured inspection missions. To evaluate generalization, we further test policies on unseen spacecraft models and orbital assets such as the Lunar Gateway [ 8 ] . Through a series of ablation studies and evaluations, we demonstrate that model-based RL significantly improves sample efficiency and while maintaining trajectory accuracy. These results represent a step forward in scalable autonomy for on-orbit operations and contribute to the vision of future space infrastructure managed by intelligent agents. 2 Related Work Autonomous spacecraft inspection is an increasingly active research area, driven by the need for in-orbit servicing, structural monitoring, and future on-orbit assembly. Early inspection strategies often relied on pre-programmed motion plans and highly specialized control architectures [ 9 ] , with systems such as NASA’s Seeker demonstrating short-range free-flyer navigation capabilities. These approaches, while effective for specific mission profiles, remain rigid in the face of evolving operational contexts or varying satellite geometries. More recent efforts explore the deployment of compact, autonomous platforms for inspection missions. [ 10 ] investigate the use of multi-purpose CubeSats to inspect the Lunar Gateway, analyzing system trade-offs across power, sensing, and propulsion. Similarly, [ 11 ] propose an information-based guidance and control architecture enabling multi-spacecraft collaborative inspection of large assets. These approaches begin to address the generalization and scalability needed for long-duration autonomous operations in orbit. Reinforcement learning (RL) has emerged as a promising technique to equip spacecraft with adaptable control strategies that do not require precise analytical models. Model-free RL methods such as PPO have shown success in robotic navigation and waypoint tracking, including demonstration of terrain-adaptive policies for rovers navigating deformable surfaces [ 3 ] . This work was built on the Space Robotics Bench (SRB) [ 4 ] , a simulation platform for benchmarking learning-based control across diverse planetary and orbital scenarios. In the orbital domain, the "SmallSat Steward" system [ 12 ] was introduced using a reinforcement learning architecture for reactive close-proximity operations. By combining direct RL with online model learning, their method achieves adaptability to changing thruster dynamics and system uncertainties, though their work is limited to two-dimensional scenarios. Complementary efforts have demonstrated RL in increasingly realistic docking and inspection contexts: [ 13 ] combined deep RL with conventional control for transferable proximity guidance; [ 14 ] applied PPO to enable 6-DOF docking with rotating targets; and [ 15 ] proposed a hierarchical model-based RL approach for multiphase docking under complex constraints. In parallel, autonomy frameworks such as the TumbleDock flight experiment [ 16 ] and microgravity free-flyer inspection architectures [ 17 ] showcase the importance of safety, replanning, and real-world validation. In a 3 degrees-of-freedom environment, DRIFT [ 18 ] provides a sim-to-real DRL demonstration for floating platforms control, comparing DRL and optimal control under different levels of uncertainty. [ 19 ] further highlight adaptability with a robust replanning strategy for multi-agent inspection. To address sample inefficiency and enhance planning capabilities, model-based RL methods such as DreamerV3 [ 5 ] have been proposed. These methods learn compact latent models of the environment to support imagination-based policy learning, enabling sample-efficient planning in complex dynamics. While DreamerV3 has been widely studied in terrestrial tasks, its use in spacecraft control, particularly for visual inspection in 6-DOF orbital dynamics, remains largely unexplored. This work builds upon these foundations by extending model-based reinforcement learning to the domain of orbital inspection. We propose a learning framework that supports continuous-thrust dynamics, varying spacecraft morphologies, and multiple mission targets such as the Lunar Gateway [ 8 ] . By leveraging the SRB platform, we aim to systematically evaluate policy generalization, robustness, and performance across diverse orbital scenarios, contributing toward scalable and retrainable control strategies for future autonomous space infrastructure. 3 RL-AVIST Framework