Personalized Image Filter: Mastering Your Photographic Style
Chengxuan Zhu, Shuchen Weng, Jiacong Fang, Peixuan Zhang, Si Li · 2025
Read Personalized Image Filter: Mastering Your Photographic Style by Chengxuan Zhu, Shuchen Weng, Jiacong Fang, Peixuan Zhang, Si Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16791.txt.
Introduction
Chengxuan Zhu and six co-authors teach a system to copy the photographic style of reference images and apply it to new photos. Style here means the bundle of choices behind a photographer's look, from color to contrast. Earlier tools either failed to learn clear style concepts or damaged the content of the photo being restyled.
Their Personalized Image Filter builds on a pre-trained text-to-image diffusion model. The model first learns the average look of named photographic concepts and how text prompts adjust them. Textual inversion then fits prompts to a set of reference photos. Tests show strong extraction and transfer of many styles while keeping the subject of each photo intact.
Catalog record
| CREATOR | Chengxuan Zhu, Shuchen Weng, Jiacong Fang, Peixuan Zhang, Si Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16791
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Personalized Image Filter: Mastering Your Photographic Style Thanks: Chengxuan Zhu and Chao Xu are with State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University, Beijing 100871, China. Shuchen Weng is with Beijing Academy of Artificial Intelligence, Beijing 100083, China. Jiacong Fang and Boxin Shi (corresponding author: [email protected] ) are with the State Key Laboratory of Multimedia Information Processing and National Engineering Research Center of Visual Technology, School of Computer Science, Peking University, Beijing 100871, China. Peixuan Zhang and Si Li are with School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China. This work was supported by National Natural Science Foundation of China (Grant No. 62136001 and 62276007), Beijing Municipal Science & Technology Commission, Administrative Commission of Zhongguancun Science Park (Grant No. Z241100003524012), and Beijing Natural Science Foundation (Grant No. QY24037). Chengxuan Zhu, Shuchen Weng, Jiacong Fang, Peixuan Zhang, Si Li Abstract Photographic style, as a composition of certain photographic concepts, is the charm behind renowned photographers. But learning and transferring photographic style need a profound understanding of how the photo is edited from the unknown original appearance. Previous works either fail to learn meaningful photographic concepts from reference images, or cannot preserve the content of the content image. To tackle these issues, we proposed a Personalized Image Filter (PIF). Based on a pretrained text-to-image diffusion model, the generative prior enables PIF to learn the average appearance of photographic concepts, as well as how to adjust them according to text prompts. PIF then learns the photographic style of reference images with the textual inversion technique, by optimizing the prompts for the photographic concepts. PIF shows outstanding performance in extracting and transferring various kinds of photographic style. Project page: https://pif.pages.dev/ Fig. 1: Given several (a) reference images, PIF learns a set of (b) photographic (Photo.) concepts, and can render any (c) content image with the learned photographic style from (a), as shown in (d). In comparison, the text-based image editing method, SDEdit [ 42 ] , and personalization method, DreamStyler [ 1 ] , change the content completely. The reference-based image retouching method PhotoWCT 2 [ 9 ] only transfers the color distribution instead of the photographic concepts. I Introduction “A picture is the expression of an impression.” — Ernst Haas The words of esteemed photojournalist Ernst Haas convey a fundamental principle of photography: Photography is not only about the contents, but the embedded photographic style, such as those listed in Fig. 1 (b). Composed of a combination of photographic concepts ( e.g . , exposure, contrast and tint, as illustrated in Fig. 2 ), photographic style distinguishes the photos from the content, namely the objects’ color and shape. For a given photo, the photographic style is a specific combination of photographic concepts that deviate from the average ones, and conveys the photographer’s preferences and aesthetic ideology. In this paper, we propose the new task of learning the photographic style from images. It is realized by the design of a Personalized Image Filter (PIF), to endow non-professional users with the photographic styles of any professional. Given a set of reference images ( Fig. 1 (a)), PIF aims to learn the photographic style by optimizing the photographic concepts, such as the concepts in Fig. 1 (b). After that, it should be able to apply the learned photographic style to any given content image ( Fig. 1 (c)), for a result with the photographic style similar to reference images, and keep the content the same as in the content image, as shown in Fig. 1 (d). Though the objective sounds familiar, it needs a fine-grained understanding about each photographic concept to know the personalized photographic style. To render the photographic style while keeping the content intact poses another challenge. Related methods can only address a fraction of the issue: (i) Text-based image editing [ 34 , 42 , 5 , 33 ] , though having more control capability thanks to text conditioning, the content is prone to be changed [ 42 , 5 ] , as observed Fig. 1 (e). The photographic concepts may also be misinterpreted or insufficiently described [ 34 , 33 ] . (ii) Text-to-image personalization [ 19 , 2 ] can optimize a word embedding denoting the concept presented in the image without explicit text description [ 1 , 19 ] , but the diffusion prior tends to modify the content, as shown in Fig. 1 (f). (iii) Image retouching with reference is another closely related field, which aims at transferring the style of a reference image to a content image. However, as Fig. 1 (g) suggests, they tend to overfit the color and lightness distribution, which is caused by missing an anchor on the average appearance of the content. In our design, to preserve the content while transferring the professional photographic style, we tailor a brand new diffusion-based framework, consisting of a residual one-step diffusion and a photographic concept perturbation, to replace the diffusion and denoising process of diffusion models. To learn the photographic style, PIF first finetunes an off-the-shelf text-to-image model to learn the average style and the binding between text instructions and professional photographic concepts from the diffusion priors. It is designed to inverse the process of a photographic concept perturbation similar to denoising, and the denoising process is also modified to a residual denoising scheme, to retain the original structure and content. Based on the average style, PIF optimizes multiple tokens for the various professional photographic concepts a random combination training strategy to bind the photographic concepts and the pseudo words together, to master the photographic concepts separately. In brief, the contributions of this work are: • a white-box photographic style transfer framework, based on diffusion prior to understand and render the photographic style the editing instructions about photographic concepts given by the text prompts, • a novel detail-preserving denoising paradigm that predicts the residual from the content image, bypassing the problem of fidelity caused by diffusion models, and • a photographic style transfer method that accurately renders the photographic concepts from several reference images, utilizing a random combination training strategy and the textual inversion technique. (a) Sharpness (strong/weak) (b) Vignetting (dark/none) (c) Saturation (high/low) (d) Tint (cyan/purple) (e) Exposure (high/low) (f) Contrast (high/low) (g) Highlight (gray/cyan) (h) Shadow (gray/blue) Fig. 2: The eight types of photographic concepts employed in this paper, which are used to decompose the photographic style. The left and right halves of each image correspond to different appearances of the concepts, as described in the captions below. II Related Work We discuss three aspects of related work: (A) text-based image editing, where text description is used to guide the editing of images; (B) text-to-image personalization, which aims to adapt models to recognize and generate [ 45 ] or discriminate [ 10 ] concepts from a limited set of unique category images; (C) image retouching with reference that renders the content image in the style of the reference images. II-A Text-Based Image Editing Text-based image editing methods have developed in various directions. Conditional generation [ 60 , 46 , 38 , 68 , 40 , 42 , 5 ] encodes text as an additional condition, but the generated contents tend to differ from