Towards Generating Realistic Underwater Images

Abdul-Kazeem Shamba · 2025

Read Towards Generating Realistic Underwater Images by Abdul-Kazeem Shamba (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14296.txt.

Introduction

Abdul-Kazeem Shamba explores how to turn flat synthetic scenes into believable underwater images, in this 2025 paper. Underwater photos have muted color and haze that plain computer images lack. Image translation models can learn that look. Shamba tests several of them on the VAROS data set, which pairs synthetic and real underwater views.

Two scores guide the comparison: one for realism and one for how well structure survives. For paired training, one model won on realism while a plain autoencoder kept structure best but looked blurry. Among unpaired methods, a cycle-based model scored well on realism. A contrast-based rival kept structure better. Adding depth data gave the best realism overall, at a small structural cost.

Catalog record

CREATORAbdul-Kazeem Shamba
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14296

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Generating Realistic Underwater Images Abdul-Kazeem Shamba Abstract This paper explores the use of contrastive learning and generative adversarial networks for generating realistic underwater images from synthetic images with uniform lighting. We investigate the performance of image translation models for generating realistic underwater images using the VAROS dataset. Two key evaluation metrics, Fréchet Inception Distance (FID) and Structural Similarity Index Measure (SSIM), provide insights into the trade-offs between perceptual quality and structural preservation. For paired image translation, pix2pix achieves the best FID scores due to its paired supervision and PatchGAN discriminator, while the autoencoder model attains the highest SSIM, suggesting better structural fidelity despite producing blurrier outputs. Among unpaired methods, CycleGAN achieves a competitive FID score by leveraging cycle-consistency loss, whereas CUT, which replaces cycle-consistency with contrastive learning, attains higher SSIM, indicating improved spatial similarity retention. Notably, incorporating depth information into CUT results in the lowest overall FID score, demonstrating that depth cues enhance realism. However, the slight decrease in SSIM suggests that depth-aware learning may introduce structural variations. 1 Introduction The creation of realistic synthetic underwater images provides numerous advantages for marine robotics practitioners and researchers [ 26 , 24 ] . These images enable practitioners to test and optimize their specialized equipment in a controlled environment, ensuring accurate performance and functionality before deployment in real-world underwater settings. Additionally, practitioners in fields like underwater archaeology, marine biology, and oceanography can utilize these images for visualization and planning purposes, facilitating data interpretation and decision-making while ensuring safety and mitigating risks. Currently, the generation of realistic underwater images relies on complex physics-based models and extensive parameter adjustments, requiring domain knowledge of the underwater environment [ 1 ] . Figure 1 : Realistic underwater image generation. Given a synthetic image X with uniform lighting and real underwater images Y , the unpaired image translation method learns to transform the synthetic input into a realistic underwater image. This work explores state-of-the-art methods in contrastive learning and generative adversarial networks to generate realistic underwater images. This problem can be generalized as an image-to-image translation, converting an image of a scene from one representation X to another Y . In this case, given a set of synthetic images with uniform lighting and another one of real underwater images, we aim to learn a model to map the appearance of the real underwater images to the content of the uniform lighting synthetic inputs (Figure 1 ). Previous work such as the use of ray tracing and physical models of the underwater environment [ 2 ] , autoencoder-based image generation [ 9 , 36 ] , neural style transfer non-photorealistic renderings [ 7 ] and paired image-to-image translation [ 12 ] have proposed robust translation systems in the physics-based and supervised setting. However, paired training data can be expensive, particularly in controlled tank experiments, or impossible in some realistic underwater scenarios such as natural scenes and deep sea environments. Advancement in the domain of generative adversarial networks (GANs) [ 8 , 16 , 38 ] , contrastive representation learning [ 32 , 3 ] , and underwater image synthesis [ 39 ] form the foundation for the contrastive architecture in [ 28 ] , which is an unpaired image-to-image translation. CycleGAN [ 38 ] proposes the cycle-consistent loss to preserve the content across the two domains and tackle the issue of mode collapse in unpaired image translation using GANs. However, this approach requires two generators and discriminators, significantly slowing the training process. [ 28 ] replaces the cycle-consistent loss in CycleGAN with a contrastive objective to enforce similarities of nearby patches and improve training time. With the emergence of well-performing monocular depth estimation techniques and alternative methods for acquiring depth data, such as stereo vision, time of flight, and structured light, the process of incorporating depth into underwater scenes has become more feasible than ever before [ 6 , 19 , 14 ] . In addition to exploring the underwater image generation using paired and unpaired image translation techniques from state-of-the-art, this research aims to investigate the effectiveness of introducing depth information in the contrastive objective, specifically the CUT [ 28 ] . We train the models on over 2000 synthetic images. We measure the performance on 190 uniform lighting images from the vision autonomous robots for ocean sustainability (VAROS) [ 39 ] synthetic underwater dataset using Fréchet inception distance (FID) [ 11 ] and (SSIM) [ 34 ] evaluation metrics. Our findings suggest that contrastive representation learning with depth information and GAN generates realistic underwater images that can rival the physics-based methods while using significantly lesser training time and memory than other unpaired image translation methods such as CycleGAN [ 38 ] . This research makes two main contributions. Specifically: • Conduct experiments to investigate state-of-the-art paired and unpaired image translation using contrastive and GAN objectives in underwater image generation. • Introducing depth information in the contrastive learning objective of CUT [ 28 ] in underwater image generation that requires reflectance and lighting understanding produces high-fidelity images (Figure 7 ). 2 Related Works Physics-based image synthesis. Underwater image formation is a complex process influenced by reflectance, backscatter, light propagation, and refraction. Understanding the underwater image formation model (IFM) is critical to creating realistic underwater renderings. The key difference with in-air image formation is the strong wavelength-dependent attenuation and scattering. In waters beyond a few meters deep, nearby artificial lighting is needed, which can make backscatter effects worse. Prior works have made progress in creating realistic-looking underwater renderings, as in deep sea underwater simulators [ 30 ] . [ 1 ] proposed a framework that effectively combines post-processing by an unmanned underwater vehicles simulator [ 27 ] with the linearized formula suggested in [ 13 ] and style transfer technique to create realistic underwater images. More recent work by [ 33 ] presents a physical model-based solution that combines in-air texture and depth information to generate deep sea underwater image sequences. The authors acknowledge the effect of artificial illumination in the deep sea IFM to account for both attenuation and backscattering effects. Other works [ 39 , 2 ] aim to create a highly realistic scene rendering using the ray tracing method while integrating direct light and indirect volumetric scattering. All the methods mentioned above require domain knowledge of the underwater properties and parameters present in the IFM. Autoencoder image generation. The limitations of the previous physics-based method have spurred researchers to develop end-to-end networks that automatically learn to generate underwater images. Autoencoder-based image reconstruction forms the backbone for some of the early works in this area. [ 9 , 5 ] use the U-Net denoising autoencoder for underwater color restoration. [ 36 ] also proposed an end-to-end underwater image enhancement framework that combines fractional integral-based retinex using an unsupervised autoencoder network that integrates an advanced attention mechanism. Recently, [ 17 ] introduced a dehazing approach using the Wasserstein autoencoder. Compared to a conventional autoencoder with low dimensional latent vectors, their approach learns a 2-dimensional latent tensor and matches the haze inputs with the dehazed output pixel-wise. Autoencoder sometimes produces ambiguous reconstructions that occupy different distributions from the input, hence the reason for the development of variational autoencoder [ 18 ] to impose structure on the latent

Read the complete text