SSH-Net: A Self-Supervised and Hybrid Network for Noisy Image Watermark Removal

Wenyang Liu, Jianjun Gao, Kim-Hui Yap · 2025

Read SSH-Net: A Self-Supervised and Hybrid Network for Noisy Image Watermark Removal by Wenyang Liu, Jianjun Gao, Kim-Hui Yap (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05088.txt.

Introduction

Wenyang Liu, Jianjun Gao and Kim-Hui Yap remove visible watermarks from noisy photos without paired training data, in work from 2025. Clean and marked versions of the same image rarely exist in the wild, which starves supervised methods. Their SSH-Net instead synthesizes its own clean references from the watermark's distribution, then splits the job across two networks.

A light convolutional network handles the easy half, plain noise. A second network with transformer blocks takes the harder joint task of watermark plus noise, since it must reason over long distances. A shared encoder feeds both, so low-level features are learned once and reused.

Catalog record

CREATORWenyang Liu, Jianjun Gao, Kim-Hui Yap
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-05088

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SSH-Net: A Self-Supervised and Hybrid Network for Noisy Image Watermark Removal Wenyang Liu, Jianjun Gao, Kim-Hui Yap Abstract Visible watermark removal is challenging due to its inherent complexities and the noise carried within images. Existing methods primarily rely on supervised learning approaches that require paired datasets of watermarked and watermark-free images, which are often impractical to obtain in real-world scenarios. To address this challenge, we propose SSH-Net, a Self-Supervised and Hybrid Network specifically designed for noisy image watermark removal. SSH-Net synthesizes reference watermark-free images using the watermark distribution in a self-supervised manner and adopts a dual-network design to address the task. The upper network, focused on the simpler task of noise removal, employs a lightweight CNN-based architecture, while the lower network, designed to handle the more complex task of simultaneously removing watermarks and noise, incorporates Transformer blocks to model long-range dependencies and capture intricate image features. To enhance the model’s effectiveness, a shared CNN-based feature encoder is introduced before dual networks to extract common features that both networks can leverage. Comprehensive experiments show that our proposed method surpasses state-of-the-art approaches in both performance and efficiency, demonstrating its effectiveness in noisy image watermark removal. Our code will be available at https://github.com/wenyang001/SSH-Net. keywords Self-supervised Learning ,Noisy Image Watermark Remover ,Vision Transformer † † corresponding: Corresponding author. 1 Introduction Social media platforms have become essential channels for sharing and distributing multimedia content, such as images and videos, making the security and robustness of digital media critical areas of research. Among various protection strategies, watermarking Singh and Chadha (2013) ; Dekel et al. (2017) ; Hu et al. (2005) remains a widely used technique for copyright enforcement. These watermarks, typically in the form of text, numbers, or logos, are embedded into images to assert ownership and prevent unauthorized use. However, while watermarks provide effective copyright protection under certain conditions, they face challenges regarding robustness and resilience against unauthorized removal, especially as adversarial techniques advance. With the rise of AI-Generated Content (AIGC), these challenges have become more difficult, as automated tools can effortlessly manipulate or add watermarks, introducing new complexities in protecting and authenticating digital content. In parallel with the development of watermarking, researchers have focused on watermark removal methods as an adversarial approach to evaluate and enhance these techniques. Early watermark removal methods typically relied on a composition model, where the watermarked image is decomposed into a watermark-free image and the watermark itself. For example, the Independent Component Analysis (ICA) algorithm proposed in Pei and Zeng (2006) attempts to separate these components to recover the original image. Building on this, a probabilistic method Hsu et al. (2011) models the relationships among the energies of the original image, the watermark, and the watermarked image to improve watermark removal performance. However, accurately estimating the watermark-free image is non-trivial and typically faces several challenges, such as separating overlapping patterns between the watermark and the original content without degrading image quality. To address these challenges, many studies have treated the watermark removal task as an image-to-image translation problem. Advanced deep learning frameworks, including convolutional neural networks (CNNs) and generative adversarial networks (GANs), have been applied to improve watermark removal performance Dekel et al. (2017) ; Cheng et al. (2018) ; Huang and Wu (2004) . While these methods have achieved notable results, they typically rely on ground truth watermark-free images for training, limiting their applicability in real-world scenarios where such data may be scarce or unavailable. Inspired by recent advances in self-supervised learning for image restoration, researchers have begun to explore these techniques for the task of watermark removal, which similarly suffers from the lack of paired clean data in real-world settings. Self-supervised learning has shown remarkable success in tasks such as denoising Lehtinen et al. (2018) ; Krull et al. (2019) and dehazing Liang et al. (2022) by learning directly from the corrupted image itself. by learning directly from the corrupted image itself. For instance, Noise2Noise Lehtinen et al. (2018) demonstrated that networks can be trained using pairs of independently corrupted images without requiring clean targets, under the assumption of zero-mean noise. In contrast, Noise2Void Krull et al. (2019) introduced masking-based strategies that predict missing pixels from their spatial context, thereby eliminating the need for paired training data altogether. Inspired by such masking-based strategies, Liang et al. Liang et al. (2022) applied a self-supervised approach to single image dehazing, incorporating haziness-guided masking to enable network training without relying on ground truth supervision. These methods demonstrate the potential of self-supervised frameworks to generalize across restoration problems where clean data is difficult to obtain. Recently, this line of work has been extended to the watermark removal domain, where degradations are often more structured and localized. For example, Tian et al. Tian et al. (2024b) proposed PSLNet, a state-of-the-art self-supervised learning network for watermark removal in noisy images. PSLNet adopts a parallel network architecture, where the upper network sequentially removes noise and watermarks, while the lower network handles both tasks simultaneously. Although this dual-network design demonstrates strong performance, its reliance on four identical CNN-based U-Net structures results in high computational costs and increased parameter complexity. Furthermore, using the same architecture for sub-tasks with varying levels of complexity leads to inefficiencies, as the model lacks the flexibility to adapt to the specific needs of each task. To address these challenges, we propose a Self-Supervised and Hybrid Network (SSH-Net) for noisy image watermark removal. SSH-Net adopts a dual-network design similar to Tian et al. (2024b) . However, rather than using identical architectures for both paths, the upper network employs a more efficient CNN architecture optimized for noise reduction, enabling it to operate with reduced computational cost. In contrast, the lower network, focused on the more complex task of simultaneously removing watermarks and noise, utilizes a deeper architecture that incorporates a sparse Transformer-based U-Net. This design allows the model to capture intricate features and model complex relationships more effectively, resulting in superior performance in challenging scenarios. Furthermore, to ensure the model effectively leverages the complementary strengths of both networks, a shared feature encoder based on CNNs is introduced before the dual paths. The outputs from these paths are then fused using a gate mechanism, which dynamically balances their contributions. A mixed loss function is applied to each path, ensuring that both networks are optimally trained for their respective tasks, resulting in a final output with enhanced texture reconstruction. Experimental results demonstrate that our approach outperforms state-of-the-art methods in noisy image watermark removal while maintaining lower computational costs. The contribution of this paper can be summarized as: • A self-supervised, hybrid dual-network approach combining CNNs and Transformers is proposed for noisy image watermark removal, eliminating the need for reference watermark-free images. • The proposed method decomposes the task into two sub-tasks, each utilizing specially designed networks with varying depths and architectures to optimize the learning process. Additionally, a sparse Transformer U-Net is introduced into the network, enabling it to achieve state-of-the-art performance. • A shared feature encoder is introduced before the dual networks to extract common features that both networks can leverage, and a gate mechanism is applied afterward to dynamically balance their contributions, thereby improving the overall performance. The remainder of this paper is organized as follows: Section 2 reviews related works, Section

Read the complete text