Reference-Free Enhancement of Forward-Looking Sonar Images: Bridging Cross-Modal Degradation Gaps Through Deformable Wavelet Scattering Transform and Multi-Frame Fusion

Zhisheng Zhang † , Peng Zhang † , Fengxiang Wang, Liangli Ma ∗ , Fuchun Sun ∗ · 2025

Read Reference-Free Enhancement of Forward-Looking Sonar Images: Bridging Cross-Modal Degradation Gaps Through Deformable Wavelet Scattering Transform and Multi-Frame Fusion by Zhisheng Zhang † , Peng Zhang † , Fengxiang Wang, Liangli Ma ∗ , Fuchun Sun ∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10974.txt.

Introduction

Zhisheng Zhang and co-authors present a self-supervised way to sharpen forward-looking sonar images for finding targets under water, in a 2025 paper. Deep learning methods often need paired real data, which is hard to get for sonar. Borrowing from remote sensing helps only partly, because sonar degrades in unlike ways.

Their method maps sonar images into a feature space that is less prone to those flaws, bridging the gap to remote sensing images. A multi-frame fusion step then joins several views without paired training data. The authors aim to avoid the over-smoothing, lost detail, and low brightness that direct transfer of trained weights can cause. The work targets real use in underwater detection.

Catalog record

CREATORZhisheng Zhang † , Peng Zhang † , Fengxiang Wang, Liangli Ma ∗ , Fuchun Sun ∗
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-10974

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reference-Free Enhancement of Forward-Looking Sonar Images: Bridging Cross-Modal Degradation Gaps Through Deformable Wavelet Scattering Transform and Multi-Frame Fusion Thanks: Zhisheng Zhang is with the College of Electronic Engineering, Naval University of Engineering, Wuhan 430033, China. E-mail: [email protected]. Thanks: Peng Zhang is with the College of Meteorology and Oceanography, National University of Defense Technology, Changsha 410073, China. E-mail: [email protected]. Thanks: Fengxiang Wang is with the College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China. E-mail: [email protected]. Thanks: Liangli Ma is with the College of Electronic Engineering, Naval University of Engineering, Wuhan 430033, China. E-mail: [email protected]. Thanks: Fuchun Sun is with the Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China. E-mail: [email protected]. Thanks: *Corresponding authors: Fuchun Sun ([email protected]) and Liangli Ma ([email protected]). Thanks: † Equal contribution Zhisheng Zhang † , Peng Zhang † , Fengxiang Wang, Liangli Ma ∗ , Fuchun Sun ∗ Abstract Enhancing forward-looking sonar images is crucial for effective underwater target detection. Existing deep learning approaches typically depend on supervised training using simulated data, but their performance and generalization are limited by the scarcity of real-world paired datasets. Although recent reference-free methods have mitigated reliance on paired data, they overlook the inherent cross-modal degradation gap between sonar and remote sensing images. Direct application of pretrained remote-sensing models to sonar data frequently yields overly smoothed images with lost details and inadequate brightness. To overcome this challenge, we propose a novel Deformable Wavelet Scattering Transform (WST) Feature Bridge, which adaptively projects sonar images into a multi-scale, translation-invariant feature domain, effectively narrowing the cross-modal degradation gap. Additionally, we develop a reference-free multi-frame fusion strategy that exploits complementary inter-frame information to suppress speckle noise and enhance target visibility without external ground-truth. Experiments conducted on three sonar datasets demonstrate that the proposed framework substantially surpasses existing reference-free methods in terms of noise suppression, edge preservation, and brightness enhancement, highlighting its practical effectiveness for underwater detection scenarios. I Introduction Forward-looking sonar (FLS) provides unique underwater imaging capabilities, becoming essential in underwater target detection, environmental perception, and autonomous navigation tasks [ 1 , 2 , 3 , 4 , 5 ] . However, complex underwater environments significantly degrade sonar images due to multipath scattering, acoustic absorption by target materials, and reflections from environmental boundaries. Such effects typically introduce severe speckle noise, brightness inconsistency, and various imaging artifacts [ 6 , 7 , 8 ] , hindering accurate target detection and reliable 3D reconstruction, thereby limiting practical deployment of FLS in real-world scenarios [ 9 , 10 , 11 ] . Fig. 1: (a) Bridging the Cross-Modal Gap. The degradation gap between multispectral remote sensing (RS) and forward-looking sonar (FLS) images is effectively narrowed by mapping both modalities into a unified feature space via our Deformable WST Feature Bridge; (b) Enhanced Results with Our Method. Compared to the overly smoothed baseline, our method preserves clear target contours and distinct foreground-background boundaries. Current sonar image enhancement methods generally fall into two categories [ 12 , 13 , 14 ] : traditional filtering-based techniques and supervised deep-learning approaches. Traditional methods, including filtering, contrast adjustment, and grayscale transformations [ 15 , 16 , 17 ] , often struggle to restore severely degraded sonar images effectively. Supervised deep-learning approaches [ 18 , 19 , 20 , 21 ] , while capable of achieving better enhancement, heavily depend on large-scale, high-quality paired datasets. Collecting such datasets in realistic underwater environments is notoriously challenging, which severely restricts their generalizability [ 22 , 23 ] . Recent reference-free enhancement methods [ 24 , 25 ] circumvent this dependence but have yet to address the intrinsic cross-modal degradation differences between forward-looking sonar and multispectral remote sensing images [ 26 , 27 , 28 ] . Although both modalities exhibit speckle noise, remote sensing images suffer from blur and low contrast due to uneven illumination and atmospheric attenuation under a pinhole camera model [ 29 , 30 ] , whereas sonar imaging is fundamentally distance-based, resulting in multipath scattering-induced brightness variations and weaker contrast [ 1 , 2 ] . Consequently, directly applying pretrained remote-sensing models to sonar enhancement frequently produces overly smoothed outputs with loss of essential details (Fig. 1(a), (b)). To address these limitations, we propose a novel reference-free sonar enhancement pipeline that integrates a Deformable Wavelet Scattering Transform (WST) Feature Bridge and a multi-frame fusion network into an end-to-end framework. Specifically, our Deformable WST Feature Bridge employs learnable perturbations on wavelet scales and orientations—carefully selected via ablation among multiple handcrafted features [ 31 , 32 , 33 , 15 , 34 ] —to adaptively map sonar images into a robust, translation-invariant feature domain, significantly narrowing the cross-modal degradation gap. Subsequently, our multi-frame fusion network leverages complementary information from consecutive sonar frames, naturally suppressing speckle noise and enhancing target-region brightness without relying on external high-quality ground truth. Unlike previous methods, our unified approach simultaneously optimizes adaptive feature extraction and multi-frame fusion, resulting in sharper contours, richer details, and enhanced brightness in sonar imagery. The main contributions of this paper can be summarized as follows: • We propose a Deformable WST Feature Bridge that adaptively aligns sonar image features with pretrained remote-sensing distributions by embedding learnable offsets into wavelet scales and orientations, effectively reducing the cross-modal degradation gap. • We develop a reference-free multi-frame fusion framework for sonar image enhancement, utilizing inter-frame complementary information to suppress speckle noise and enhance target contrast without external reference data. • We construct a carefully annotated sonar image dataset featuring three material-diverse targets (rubber tire, metal torpedo, GRP frustum) captured along circular and linear trajectories, exhibiting distinct degradation patterns (multipath scattering, acoustic absorption). Precise pose annotations eliminate the need for image registration and enable rigorous benchmarking. Experiments demonstrate superior performance of our method over state-of-the-art baselines both visually and quantitatively. Code and Dataset Release. The source code and the collected sonar dataset will be publicly released upon publication. Fig. 2: Overview of the proposed method. The model combines a Deformable WST Feature Bridge—with learnable wavelet scale and orientation offsets—and a multi-frame fusion network into one end-to-end pipeline, replacing the fixed WST extractor plus simple concat-and- 1\times 1 convolution. This unified design closes the cross-modal degradation gap, reduces speckle noise, and boosts target brightness, producing images with crisper contours and richer edge detail. II Related Work II-A Quality Degradation of Forward-Looking Sonar Images and Traditional Enhancement Methods Forward-looking sonar images often experience quality degradation in complex underwater environments [ 35 , 36 , 37 , 38 ] , characterized by speckle noise, uneven illumination, and brightness artifacts due to multipath effects and acoustic absorption by target materials [ 39 , 40 ] . Among these, speckle noise is multiplicative interference from multiple acoustic paths [ 6 , 7 ] , greatly reducing target-background contrast. Traditional enhancement methods primarily aim at suppressing speckle noise [ 8 , 9 ] . These traditional methods are generally categorized into spatial-domain and transform-domain approaches. Spatial-domain methods, such as Gaussian smoothing and median filtering, reduce speckle noise but often lead to over-smoothing, causing blurred details and decreased brightness [ 17 ] . Transform-domain methods, including wavelet and Fourier transforms [ 15 , 16 ] , suppress noise and enhance details within the transformed space. However, while effectively

Read the complete text