Only-Style: Stylistic Consistency in Image Generation without Content Leakage
Tilemachos Aravanis, Panagiotis Filntisis, Petros Maragos, George Retsinas · 2025
Read Only-Style: Stylistic Consistency in Image Generation without Content Leakage by Tilemachos Aravanis, Panagiotis Filntisis, Petros Maragos, George Retsinas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-09916.txt.
Introduction
Tilemachos Aravanis, Panagiotis Filntisis, Petros Maragos, and George Retsinas keep the style of an AI image maker true while barring its theft of content. Give a tool a style image and it tends to copy the subject of the image too. That leak spoils the point of a pure style loan. Their 2025 method spots where the leak sits in the new image as it forms.
A dial that steers style weight is then tuned just in those patches, and left alone in the rest. The result holds the look while the stray subject fades. The leak spotter also works as a free part: bolted to other tools, it can tune their own style dials. A new scoring frame weighs style hold against leak loss. Tests across many cases show clear gains over top past tools.
Catalog record
| CREATOR | Tilemachos Aravanis, Panagiotis Filntisis, Petros Maragos, George Retsinas |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-09916
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Only-Style: Stylistic Consistency in Image Generation without Content Leakage Tilemachos Aravanis, Panagiotis Filntisis, Petros Maragos, George Retsinas Abstract Generating images in a consistent reference visual style remains a challenging computer vision task. State-of-the-art methods aiming for style-consistent generation struggle to effectively separate semantic content from stylistic elements, leading to content leakage from the image provided as a reference to the targets. To address this challenge, we propose Only-Style: a method designed to mitigate content leakage in a semantically coherent manner while preserving stylistic consistency. Only-Style works by localizing content leakage during inference, allowing the adaptive tuning of a parameter that controls the style alignment process, specifically within the image patches containing the subject in the reference image. This adaptive process best balances stylistic consistency with leakage elimination. Moreover, the localization of content leakage can function as a standalone component, given a reference-target image pair, allowing the adaptive tuning of any method-specific parameter that provides control over the impact of the stylistic reference. In addition, we propose a novel evaluation framework to quantify the success of style-consistent generations in avoiding undesired content leakage. Our approach demonstrates a significant improvement over state-of-the-art methods through extensive evaluation across diverse instances, consistently achieving robust stylistic consistency without undesired content leakage. Project-Page 1 Introduction “A car…” “A bear…” “A circus tent…” “A tiger…” Initial stylistic alignment Content leakage Only-Style Figure 1 : Only-Style : The top row shows images independently generated by a text-to-image model using the style descriptor “in vintage poster style” . Applying a state-of-the-art method (here StyleAligned [ 13 ] ) to align these images stylistically with the first image (the car) leads to unintended content leakage, causing visual elements of the car to infiltrate the other images. Only-Style addresses this by first localizing the semantic content of the reference subject in the target images (third row) and then guiding the alignment process to eliminate this undesired effect (fourth row). State-of-the-art text-to-image (T2I) models [ 36 , 3 , 34 , 40 , 7 ] demonstrate impressive results in transforming text into compelling visual outputs. However, such models do not hand the user control over specific visual stylistic results, often producing widely varying interpretations of the same textual descriptor, as shown in the first row of Fig. 1 . For this reason, several works aim to provide visual thematic consistency across different generated concepts, as they were created or performed in the same manner or technique (e.g., from the same artist). Even though these methods achieve the desired stylistic alignment of a reference image with a target one, they frequently exhibit content leakage. In other words, unintended semantic elements from the reference image subject, appear in the target image. Such cases are evident in the second row of Fig. 1 . The main motivation of this work is to find a semantically meaningful way to remove this content leakage while preserving consistency in style. To achieve this, we introduce a method to control the transfer of the reference subject patches in the target image, through a simple scaling of their representations. This scaling operation is adaptively tuned via the localization of the reference subject in the target image to determine whether the transfer of the reference subject features should be further restrained (see third row of Fig. 1 ). The final stylistic alignment is illustrated in the bottom row of Fig. 1 . As it can be observed, the resulting target images exhibit no content leakage - thus we dubbed our method Only-Style . Additionally, we present two novel evaluation methods to measure the impact of content leakage in style consistent image generation, both coarsely via an encoder-based metric (CL) and fine-grained via Large Vision-Language Models (LVLMs). The former quantifies the semantic correlation between the target image and the reference subject, thereby assessing content leakage, while the latter detects even subtle leakage cases by prompting LVLMs. We benchmark many state-of-the-art methods, showing that content leakage is a main challenge shared across all of them. To our knowledge, although content leakage has been recognized as an issue in stylistic consistency, no prior work has proposed a way to measure the appearance of content leakage cases — a very useful tool to understand the efficacy of methods that promote stylistic consistency. Our main contributions are: \bullet We introduce fine-grained control over the leakage of reference semantic elements to the target image, tailored for attention sharing approaches [ 13 ] . \bullet We propose a novel method for subtle leakage localization, applicable to any style consistent generation approach. \bullet We design an end-to-end method that achieves style-consistent image generation by adaptively scaling down the contribution of the reference subject, addressing the problem of content leakage. \bullet We propose an evaluation framework that quantifies content leakage using two distinct metrics (coarse and fine-grained version). We release this benchmark to serve as a standardized baseline, addressing a notable gap in the community and facilitating more consistent comparisons of style alignment methods. 2 Related Work Text-to-Image diffusion models. Diffusion models [ 44 , 43 , 41 , 15 ] have transformed the field of image generation, producing highly diverse and visually striking outputs. Further, text-conditioned diffusion models [ 30 , 37 ] enable the generation process to be guided by natural language prompts, leveraging these powerful generative capabilities. Controlling the attention in T2I diffusion models. The attention mechanism is the common underlying ingredient within neural network backbones in T2I diffusion models. Recent works have explored how the self-attention and cross-attention layers can be harnessed to define both the layout and semantic content of text-generated images [ 12 , 4 , 32 , 45 ] . Additionally, attention mechanisms have been widely applied for editing text-generated images [ 1 , 29 , 6 , 46 , 33 ] . Building on insights from these methods, we utilize the attention layers to disentangle content and style, addressing the challenge of style-consistent generation. Style Transfer. Style transfer is a long-standing challenge in computer vision [ 14 , 5 ] that refers to the process of transforming the visual style of an input image while preserving its content. Neural Style Transfer leverages deep features from pretrained networks to alter the style of a target image based on a reference [ 20 , 10 ] . Moreover, GAN-based techniques have been developed to transfer images across different stylistic domains [ 18 , 31 , 21 , 52 ] . Consistent style Generation. With the advent of diffusion models stylization research has focused on generating target text-specified concepts using either real or synthesized stylistic reference images. Different approaches have emerged to tackle this task: \bullet One family of approaches involves training diffusion models to incorporate conditioning from the output representation of a pretrained image encoder [ 51 , 49 , 48 , 50 ] , such as CLIP [ 35 ] . However these methods require significant computational resources to train this conditioning and tend to drive the model away from its training distribution. Following this paradigm and conceptually close to our work, InstantStyle [ 48 ] , in a coarse attempt to reduce content leakage, injects the CLIP image embedding of the stylistic reference, subtracted by the CLIP text embedding of the reference