IConMark: Robust Interpretable Concept-Based Watermark For AI Images

Vinu Sankar Sadasivan, Mehrdad Saberi, Soheil Feizi · 2025

Read IConMark: Robust Interpretable Concept-Based Watermark For AI Images by Vinu Sankar Sadasivan, Mehrdad Saberi, Soheil Feizi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13407.txt.

Introduction

Vinu Sankar Sadasivan, Mehrdad Saberi, and Soheil Feizi proposed IConMark in twenty twenty-five, a watermark for AI-generated images that a human can read. Provenance marks usually hide in noise-like perturbations and crumble under attack. IConMark instead embeds meaningful semantic concepts into the image itself — attributes a person can see and verify with their own eyes.

The watermark survives common image augmentations while leaving quality intact. In detection tests it beat the best baseline by about eleven points of area under the curve. Hybrid versions grafting it onto two existing watermarking systems gained roughly fifteen points each. The authors present interpretable watermarking as a first step toward marks that stay meaningful — and checkable — without special software, a property pure signal-processing schemes cannot offer.

Catalog record

CREATORVinu Sankar Sadasivan, Mehrdad Saberi, Soheil Feizi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-13407

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

IConMark: Robust Interpretable Concept-Based Watermark For AI Images Vinu Sankar Sadasivan, Mehrdad Saberi, Soheil Feizi Abstract With the rapid rise of generative AI and synthetic media, distinguishing AI-generated images from real ones has become crucial in safeguarding against misinformation and ensuring digital authenticity. Traditional watermarking techniques have shown vulnerabilities to adversarial attacks, undermining their effectiveness in the presence of attackers. We propose IConMark, a novel in-generation robust semantic watermarking method that embeds interpretable concepts into AI-generated images, as a first step toward interpretable watermarking. Unlike traditional methods, which rely on adding noise or perturbations to AI-generated images, IConMark incorporates meaningful semantic attributes, making it interpretable to humans and hence, resilient to adversarial manipulation. This method is not only robust against various image augmentations but also human-readable, enabling manual verification of watermarks. We demonstrate a detailed evaluation of IConMark’s effectiveness, demonstrating its superiority in terms of detection accuracy and maintaining image quality. Moreover, IConMark can be combined with existing watermarking techniques to further enhance and complement its robustness. We introduce IConMark+SS and IConMark+TM, hybrid approaches combining IConMark with StegaStamp and TrustMark, respectively, to further bolster robustness against multiple types of image manipulations. Our base watermarking technique (IConMark) and its variants (+TM and +SS) achieve 10.8%, 14.5%, and 15.9% higher mean area under the receiver operating characteristic curve (AUROC) scores for watermark detection, respectively, compared to the best baseline on various datasets. Figure 1 : Watermark generation (top) and detection (bottom) pipeline for IConMark (and variants). Various concepts are generated and stored in a concept database (Section 3.1 ). User prompts are augmented with sampled concepts to generate watermarked images with interpretable concepts (Section 3.2 . A visual language model is used to query for the presence of database concepts in a candidate image for watermark detection (Section 3.3 ). Additional watermarking can be combined with IConMark to further bolster its robustness (Section 4 ). 1 Introduction With the rapid advancements in generative AI, distinguishing between AI-generated and real images has become a critical challenge. The proliferation of deepfake technologies and synthetic media has raised concerns about misinformation, copyright infringement, and digital authentication [ 10 , 5 ] . Traditional watermarking techniques, which add imperceptible noise or frequency domain modifications to images, have been widely used to establish provenance and protect intellectual property [ 6 , 23 , 4 , 24 , 21 , 8 , 19 ] . However, recent research has demonstrated the vulnerability of existing watermarking methods to adversarial attacks, including diffusion purification and model substitution adversarial attacks, which can remove or spoof watermarks with minimal image alterations [ 18 ] . Watermarking methods can broadly be categorized into post-hoc and in-generation approaches. Post-hoc watermarks modify an image after the generation, embedding signals through additive noise or frequency-space perturbations [ 23 , 8 , 6 , 4 ] . In contrast, in-generation watermarks embed information during the image generation process, modifying the distribution of generated samples rather than making explicit post-hoc changes [ 24 , 9 , 27 ] . While in-generation watermarking methods tend to be theoretically more robust, they are still susceptible to attacks, particularly adversarial strategies that attempt to remove or obfuscate the watermark [ 18 ] . In this work, we introduce a robust I nterpretable Con cept-based Water mark (IConMark), a novel in-generation semantic watermarking approach that embeds interpretable concepts into AI-generated images, as a first step toward interpretable AI watermarking. Unlike traditional watermarks, which primarily rely on additive noise, our method integrates meaningful semantic attributes, making it robust against various image perturbations and adversarial purification attacks. Since these concepts are interpretable to humans, we can also manually check if an image generated with IConMark is watermarked. This novelty makes IConMark interpretable and robust to adversarial attacks, potentially making it a strong technique for manual image forensics with the help of human experts. IConMark can also automate detection using a visual language model, which queries the presence of these embedded concepts. This ensures both machine verifiability and human interpretability. Furthermore, we demonstrate that IConMark can be effectively combined with any existing watermarking approach since it only perturbs the input prompt given to the image generation model. We demonstrate that this ability of our IConMark to complement existing watermarking approaches can result in strong robust image watermarking techniques. Our contributions are as follows: • We propose IConMark (Section 3 ), a novel semantic watermarking method that embeds interpretable concepts rather than additive noise, improving the robustness and making AI image watermark interpretable for the first time. • IConMark by design can be effectively combined with any existing watermarking technique to further enhance robustness against image augmentations or attacks (Section 4 ). • We show that our method is resistant to various image augmentation attacks, including diffusion purification attacks (Section 5 ). IConMark being interpretable makes it easier to be detected by human experts, hence making our method resilient to adversarial attacks. • We evaluate the quality of generation with IConMark, showing that it maintains high visual and generation quality while ensuring watermark detection integrity. 2 Related Works Traditional and deep learning-based watermarking has long been a crucial tool for copyright protection, content authenticity, and AI-generated media detection [ 12 , 22 ] . Classical techniques embed signals in the spatial or frequency domain, leveraging transformations such as Discrete Cosine Transform (DCT) and Discrete Wavelet Transform (DWT) [ 1 , 6 ] . Deep learning-based watermarking methods, such as StegaStamp [ 23 ] , StableSignature [ 8 ] , TrustMark [ 4 ] , and Watermark Anything Model [ 21 ] have further improved robustness by training neural networks to encode and extract watermarks from images. However, these methods remain susceptible to sophisticated removal techniques, including adversarial attacks and diffusion purification [ 18 ] . [ 18 ] demonstrated that diffusion purification attacks, which leverage denoising diffusion models, can effectively remove low-perturbation watermarks by reconstructing images with minimal modifications. Similarly, WAVES [ 2 ] , a benchmarking framework, revealed that watermark detection accuracy significantly degrades under adversarial and regeneration attacks, highlighting the need for more robust watermarking solutions. Additionally, high-perturbation watermarking methods, such as TreeRing [ 24 ] , have been shown to be more resistant to removal but are still vulnerable to adversarial model substitution attacks [ 18 ] and simple image averaging attacks [ 26 ] . Furthermore, [ 18 , 20 ] show that watermarking systems are not only vulnerable to removal but also to spoofing attacks, where real images are falsely classified as watermarked, leading to false attributions and reputational risks [ 18 ] . Adversarial perturbations designed to mimic the statistical properties of watermarked images have been shown to effectively fool detection systems, raising questions about the reliability of current watermarking schemes. Our work builds on these findings by introducing an approach that is inherently more interpretable and robust to such attacks. The concept of semantic watermarking, which embeds meaningful and interpretable information into images, has been unexplored. Existing methods primarily focus on imperceptibility and robustness but often lack interpretability. Our work builds on these foundations by integrating interpretable concepts into AI-generated images, ensuring both human and machine verifiability while maintaining robustness against adversarial attacks for the first time. Our approach

Read the complete text