Learning Underwater Active Perception in Simulation
Alexandre Cardaillac and Donald G. Dansereau · 2025
Read Learning Underwater Active Perception in Simulation by Alexandre Cardaillac and Donald G. Dansereau (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17817.txt.
Introduction
Underwater robots inspect ships and pipelines with cameras, but murky water can blind them mid-mission. Alexandre Cardaillac and Donald Dansereau teach the robot to judge the water before it shoots. Their active perception system predicts image quality from two inputs: distance to the target, and the brightness of the robot's own lights. A small neural network makes the call.
Training happens entirely in simulation. The team modified a graphics program to model how light truly travels underwater, across ten water types with different murk and backscatter. In virtual trials, the system chose viewpoints and light levels that raised coverage and image quality over fixed routines. The lesson is simple but powerful: a camera that understands its medium takes better pictures.
Catalog record
| CREATOR | Alexandre Cardaillac and Donald G. Dansereau |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-17817
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Underwater Active Perception in Simulation Alexandre Cardaillac and Donald G. Dansereau Abstract When employing underwater vehicles for the autonomous inspection of assets, it is crucial to consider and assess the water conditions. These conditions significantly impact visibility and directly affect robotic operations. Turbidity can jeopardise the mission by preventing accurate visual documentation of inspected structures. Previous works have introduced methods to adapt to turbidity and backscattering, however, they also include manoeuvring and setup constraints. We propose a simple yet efficient approach to enable high-quality image acquisition of assets in a broad range of water conditions. This active perception framework includes a multi-layer perceptron (MLP) trained to predict image quality given a distance to a target and artificial light intensity. We generate a large synthetic dataset that includes ten water types with varying levels of turbidity and backscattering. For this, we modified the modelling software Blender to better account for the underwater light propagation properties. We validated the approach in simulation and demonstrate significant improvements in visual coverage and image quality compared to traditional methods. I Introduction The growing demand for inspection and monitoring of underwater assets, both natural and man-made, requires the development of cost- and risk-efficient technologies [ 1 ] . Underwater vehicles are often deployed to perform these tasks, reducing operational constraints and human risks. However, the performance of the mission depends on the skill of the operator in the loop in the case of a remotely operated vehicle (ROV), and depends on the quality of the mission plan in the case of an autonomous underwater vehicle (AUV). Because underwater visibility varies significantly with location, time of day, and weather, operators and autonomous systems fail to consistently report high-quality documentation of the underwater asset. Therefore, there is an important need to be able to understand and adapt to local water conditions. Underwater imagery is often degraded due to several light effects caused by the underwater environment. They include absorption, scattering, and marine snow [ 2 ] : Absorption Attenuates the light over distance, resulting in colour distortions and loss of contrast. Scattering Caused by the change in direction by the light, either backward or forward scattering depending on the reflection angle. This leads to haziness and blurriness in the image. Marine snow Suspended particulate matter, also referred to as non-algal particles. These macroscopic floating particles can appear in images and intensify the aforementioned effects. These effects directly affect the underwater robotic operations. When an AUV is employed, it is difficult to know if the data collected will be usable, and typical inspection and monitoring operations can last up to several hours. If the collected data is of poor quality, the operation was a waste of time and money. Additionally, if the vehicle is relying on visual features, it could become a hazard when it is unable to properly observe the environment. Methods are emerging to overcome these issues, including active perception, which is about maximising information gain according to the current perception of the environment [ 3 ] . This is done by dynamically updating the control plan of the vehicle. Such methods can enable underwater vehicles to always remain in visual range, and ensure the collection of high-quality data throughout the operation. Previous related work in underwater active perception aims to minimise the distance between the vehicle and targets, ensuring the vehicle is always in sight [ 4 ] . Although the method can consider multiple targets, visual coverage is also minimised, resulting in longer operations in the context of inspections. Image quality is considered in [ 5 ] , as information gain is optimised, however, the camera and the light source must be independently movable, which is a major constraint. When training a model based on synthetic data and considering image quality, realistic rendering must be done. Major rendering software such as Blender [ 6 ] or Unreal Engine [ 7 ] works best at above-water rendering, as they include numerous simplifications for underwater rendering. In this work, we propose to improve the autonomy of AUVs with high manoeuvring capabilities that possess an adjustable-intensity illumination source. For this, we develop a learning-based approach to active underwater perception leveraging realistic synthetic data generation for training. The approach aims at ensuring the collection of high-quality data while maximising the visual coverage at the same time. This is done by providing online guidance suggestions such as distance to target and manipulating the artificial light intensity. Additionally, we propose a calibration step to obtain relevant optical information about the water column, which is then used to tune the model’s output. The contributions can be summarised as follows: • An upgrade to Blender to improve simulation of underwater imagery, including more accurate light behaviour in water and models of the oceans. • A method for in-situ water column property estimation using a monocular camera and adjustable illumination. • A framework providing online guidance suggestions to maintain high-quality data collection and maximise visual coverage in a broad range of water conditions. These contributions can lead to more consistent and faster-paced inspections and monitoring of underwater assets with more valuable visual documentation. The project code and resources are available on our project page at https://roboticimaging.org/Projects/ActiveUW/ . II Related Work II-A Underwater Imagery Simulation The oceans are challenging environments that can be hard to access and control. Additionally, there is a large diversity of water properties and conditions that affect both how water behaves and how water looks. This makes it difficult to collect a large and representative set of images. For these reasons, simulation plays a key role in underwater robotics. It prevents unnecessary deployments and enables experimental evaluation and validation of methods in a safe and controlled environment. Furthermore, simulators can be used to generate datasets for downstream tasks such as the training and validation of models. Numerous underwater robotics simulators exist [ 8 , 9 , 10 ] , however, most of them focus on robotic functionalities such as odometry sensors and environmental effects such as wind and current, and do not provide a realistic visual representation of the underwater scene as captured by an imaging device. The others are often tailor-made for specific applications, not adaptable, are private, or only release publicly datasets [ 11 , 12 , 13 ] . There are two main approaches to generating underwater images: learning-based [ 14 , 15 , 16 ] , and model-based [ 17 , 18 , 19 ] . Although the results may appear realistic, they are not always physically correct, as they are often based on a single image without contextual information, or generated using approximated models. Modelling software such as Blender or Unreal Engine attempt to render realistic and physically accurate images of the environments through advanced lighting simulation. However, since they are mostly used for above-water applications, the physics of underwater light are neglected. Indeed, the simulated light transport in participating media is not appropriate for underwater environments. Firstly, because the volume scattering phase functions employed significantly deviate from reality. These functions describe the light behaviour in a volume, more precisely, the probability distribution of light scattered in specific directions, indicating how light bounces in a medium [ 20 ] . Blender uses the Henyey-Greenstein function