AD-Relight: Training-Free Banner Relighting via Illumination Translation with Diffusion Priors

Rameshwar Mishra A. V. Subramanyam · 2026

Read AD-Relight: Training-Free Banner Relighting via Illumination Translation with Diffusion Priors by Rameshwar Mishra A. V. Subramanyam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24407.txt.

Introduction

Mishra and three colleagues present AD-Relight, a training-free method relighting Photoshop-generated ad banners in video frames. Existing ad pipelines warp banners by shape while missing scene lighting, and diffusion-based insertion and relighting models, untrained on banner data, also struggle to relight new banners. AD-Relight adapts a diffusion relighting model at test time across multiple stages, needing no banner training data. Tests show it beats relighting baselines and warping-based ad placement, and user studies show participants consistently prefer its outputs over prior approaches.

Catalog record

CREATORRameshwar Mishra A. V. Subramanyam
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24810
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.24407

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AD-Relight: Training-Free Banner Relighting via Illumination Translation with Diffusion Priors Rameshwar Mishra A. V. Subramanyam Abstract The recent surge in content consumption through streaming services has driven a growing demand for personalized content. Personalized advertisements (ads) play a crucial role in enhancing both user engagement and ad effectiveness. A key aspect of ad personalization involves replacing existing regions in a frame with custom, Photoshop-generated banners. However, existing ad-placement pipelines typically rely on simple geometric warping, ignoring the scene’s underlying lighting conditions. Similarly, state-of-the-art diffusion-based object insertion and relighting models struggle to accurately relight these newly inserted banners, as they are not trained on ad-banner data, and training such a model for ad banners will require millions of images. This highlights the need for an effective relighting framework, which results in a seamless integration of custom banners into the original scene. Motivated by this, we present AD-Relight, a novel, multi-stage training-free framework that adapts a diffusion-based relighting model at test time to relight newly added Photoshop-generated ad banners. Through extensive evaluation, we demonstrate that AD-Relight outperforms both relighting baselines and existing ad-placement methods based on simple warping. User studies further show that participants consistently prefer the outputs of AD-Relight over those of prior approaches. I Introduction With the rapid growth of streaming platforms, there has been a significant shift toward delivering personalized content to viewers. Among various personalization strategies, tailored advertisements have emerged as a key factor in boosting both user engagement and ad performance. Several key components contribute to personalized advertising, including the introduction of new ads, the replacement of existing banners, the selection of optimal ad placements, and the integration of photorealism into added advertisements. In the case of placing a Photoshop-generated custom ad banner in a scene, there exists a key challenge of lighting. As shown in Fig. 1 (a), we inserted a variety of ad banners using existing relighting methods [ 1 , 2 ] and a training-free object insertion method [ 3 ] . Across all examples, the inserted banners exhibit lighting inconsistent with the scene. For instance, the original region is more strongly illuminated on the left and far right, creating a gradient that these methods fail to reproduce, leading to unrealistic results. However, as shown in Fig. 1 (b), AD-Relight produces outputs with banners exhibiting lighting consistent with the original scene. Several methods have been developed to address ad placement in content. The approach in [ 4 ] automates banner placement in video frames using a machine learning model that detects banners in the original frames and then inpaints the new ad using a homography matrix. Meanwhile, [ 5 , 6 ] present end-to-end frameworks for inserting ads into videos. Notably, [ 5 ] introduces a cloud-based approach that places ads based on prior analytics, optimizing system design for faster inference. Fig. 1: Visual comparison highlighting the limitations of existing methods for banner relighting. In (a), columns 1, 2, and 3 correspond to results from IC-Light [ 2 ] , SpotLight [ 1 ] , and TF-ICON [ 3 ] , respectively. All methods fail to reproduce the spatial lighting variations of the scene, leading to inconsistent shading and poor integration of the inserted banner. Although the previously mentioned methods address ad placement and are closely related to our work, they primarily focus on region estimation and the design of the overall server-side framework. These methods assume that the input ad is already in its final form and only needs to be placed within the scene. However, we found that when banners are placed on the floor, lighting becomes a critical factor in maintaining the realism of the newly introduced ad banners. With advancements in generative models, such as diffusion models, it is now possible to generate photorealistic content. Several methods have been developed to introduce new objects into images using diffusion models [ 3 , 7 ] . While these diffusion-based methods enhance photorealism, they often struggle to preserve the identity of the added object, a crucial factor for ad banners. Additionally, methods such as [ 7 ] and [ 8 ] require extensive training on millions of images, making them computationally expensive. [ 2 ] , [ 9 ] , and [ 10 ] propose diffusion-based object relighting frameworks. These models require extensive training on approximately 3 to 5 million images paired with their corresponding light environment maps. While they achieve impressive results in relighting portrait images, they often struggle with banners placed on the floor, as such cases fall outside their training distribution. Fig. 1 illustrates how direct use of diffusion-based relighting and object insertion methods can lead to inconsistent and unrealistic outputs. Training these models specifically for ad banners would require collecting millions of relevant images, a labor-intensive, challenging, and time-consuming task. The following are our observations based on our analysis of current methods. All the previously mentioned ad placement methods focus on region estimation, cloud-based solutions, and server-side frameworks. Diffusion-based object insertion methods suffer from identity loss and distortion. Diffusion-based relighting models often struggle with banner relighting, particularly for floor-level placements outside their training distribution. To the best of our knowledge, no prior work explicitly tackles the relighting of Photoshop-generated ad banners. We formulate banner relighting as a conditional image-to-image illumination translation problem, where the goal is to transfer the lighting characteristics of the target region onto the inserted banner. In this work, we propose AD-Relight, a framework to relight newly added ad banners in a scene, ensuring they appear consistent with the original scene. Our main contributions are as follows. • We identify a key limitation in existing ad-placement, diffusion-based relighting, and object-insertion methods: their inability to maintain lighting consistency for inserted ad banners. • We introduce AD-Relight, a novel three-stage, training-free framework for relighting Photoshop-generated ad banners. Our method first aligns the banner’s shading with the target region, then employs a differential probing strategy to extract region-specific illumination priors from a pre-trained lighting-aware diffusion model, and finally uses this prior to relight the banner. We provide a principled formulation and analysis of this differential illumination feature. • We perform an extensive evaluation across diverse indoor lighting conditions and banners to ensure robustness. We conduct a user study to capture human perception of AD-Relight’s outputs. II Related Work II-A End-to-End Ad Placement Methods [ 5 ] proposes a server-side dynamic ad insertion platform tailored for live streaming. [ 4 ] presents a technique for replacing advertisements in videos using scene recognition and pattern matching. [ 11 ] introduces an automatic editing framework for sports videos. The framework leverages computer vision techniques to detect key game events and camera transitions. [ 12 ] proposes an emotion-aware ad placement method using multi-modal analysis. End-to-end methods effectively predict the optimal regions and timestamps for ad placement to maximize user attention. However, they primarily focus on vertically aligned, portrait-style ads and often overlook the lighting information in the original scene. The original region exhibits shading and light gradients influenced by multiple light sources in the scene, whereas a newly inserted ad banner lacks these details. Ensuring seamless integration therefore requires a framework that relights the new banner to match the original lighting. II-B Diffusion-based Object Insertion in Natural Scenes Several works extend

Read the complete text