PI-Light: Physics-Inspired Diffusion for Full-Image Relighting
Zhexin Liang, Zhaoxi Chen, Yongwei Chen, Tianyi Wei, Tengfei Wang, Xingang Pan · 2026
Read PI-Light: Physics-Inspired Diffusion for Full-Image Relighting by Zhexin Liang, Zhaoxi Chen, Yongwei Chen, Tianyi Wei, Tengfei Wang, Xingang Pan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22135.txt.
Introduction
Zhexin Liang and co-authors relight whole photographs with a diffusion model guided by physics. Full-image relighting, changing a scene's light after the photo is taken, is hard for three reasons the authors name. Paired training data are scarce, physical plausibility is difficult to maintain, and data-driven priors generalize poorly.
Earlier attempts to bridge the gap between synthetic training scenes and real photos stayed suboptimal. The team's 2026 preprint, PI-Light, builds physics-inspired structure into the diffusion process for full-image relighting. Believable relighting serves film, e-commerce, and design, where reshooting under new light is costly. Physics guidance helps the model respect shadows and reflections instead of painting light on freely.
Catalog record
| CREATOR | Zhexin Liang, Zhaoxi Chen, Yongwei Chen, Tianyi Wei, Tengfei Wang, Xingang Pan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22135
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PI-Light: Physics-Inspired Diffusion for Full-Image Relighting Zhexin Liang, Zhaoxi Chen, Yongwei Chen, Tianyi Wei, Tengfei Wang, Xingang Pan Abstract Full-image relighting remains a challenging problem due to the difficulty of collecting large-scale structured paired data, the difficulty of maintaining physical plausibility, and the limited generalizability imposed by data-driven priors. Existing attempts to bridge the synthetic-to-real gap for full-scene relighting remain suboptimal. To tackle these challenges, we introduce P hysics- I nspired diffusion for full-image re Light ing ( π \pi -Light, or PI-Light), a two-stage framework that leverages physics-inspired diffusion models. Our design incorporates (i) batch-aware attention, which improves the consistency of intrinsic predictions across a collection of images, (ii) a physics-guided neural rendering module that enforces physically plausible light transport, (iii) physics-inspired losses that regularize training dynamics toward a physically meaningful landscape, thereby enhancing generalizability to real-world image editing, and (iv) a carefully curated dataset of diverse objects and scenes captured under controlled lighting conditions. Together, these components enable efficient finetuning of pretrained diffusion models while also providing a solid benchmark for downstream evaluation. Experiments demonstrate that π \pi -Light synthesizes specular highlights and diffuse reflections across a wide variety of materials, achieving superior generalization to real-world scenes compared with prior approaches. Code will be available at https://github.com/ZhexinLiang/PI-Light. Figure 1: \pi -Light enables full-image relighting through physics-inspired diffusion models. It achieves favorable results in both a) inverse rendering and b) neural forward rendering stages, enabling precise control over lighting. 1 Introduction Figure 2: Comparisons between IC-Light ( Zhang et al. 2025 ) and Ours. The state-of-the-art foreground relighting method still suffers from inconsistencies in maintaining albedo uniformity and lacks physically plausible control over lighting direction. Recent advances in computer graphics and vision have highlighted image relighting as a critical task for film production, augmented reality, and digital content creation. Existing works can be grouped into object-centric approaches ( Zeng et al. 2024a ; Mei et al. 2023 ; Zhang et al. 2025 ; Ponglertnapakorn et al. 2023 ; He et al. 2024 ; Futschik et al. 2023 ) , which often ignore or replace the background, and scene-level methods ( Choi et al. 2024 ; Kocsis et al. 2024a ) , which attempt full-image relighting but remain largely data-driven and struggle to generalize beyond the training distribution without extensive diverse data, and cannot maintain self-luminous objects’ lighting. While state-of-the-art foreground relighting methods ( Zhang et al. 2025 ) have shown impressive results, they still suffer from albedo inconsistency and imprecise lighting control. For example, as shown in Fig. 2 , carpet colors are altered ( 1^{st} row) and the intended leftward light appears to come from the left rear in the absence of an internal light source ( 2^{nd} row). These limitations highlight the lack of a decomposed scene interpretation and the inherent limitations of data-driven priors, which are essential for controllable and physically plausible full-image relighting. While prior methods have advanced the field, their limitations highlight three major challenges for full-image relighting. First, the main challenge lies in the difficulty of acquiring datasets with diverse and complex scene illuminations: obtaining high-quality images under diverse and controlled lighting conditions across full scenes is both resource-intensive and technically challenging. In particular, it is infeasible to obtain real-world datasets that capture the same scene under multiple lighting conditions. Second, ensuring physical plausibility remains challenging, as purely data-driven approaches often generate results that violate basic light transport principles. Finally, limited data-driven priors restrict generalizability, leading to poor robustness when facing more unseen materials, lighting conditions, or realistic scene compositions. To alleviate these challenges, we propose \pi -Light, a novel diffusion-based neural relighting pipeline designed to tackle the full-image relighting problem. Similar to the previous PBR approach ( Zeng et al. 2024b ; Liang et al. 2025 ) , our approach also adopts a two-stage framework of inverse neural rendering followed by neural forward rendering, but differs from prior works in the following key aspects. First, inspired by Wonder3D ( Long et al. 2024 ) , during both inverse neural rendering and neural forward rendering stages, we extend standard self-attention layers to be global-aware, enabling communication across batches. This design improves both efficiency and consistency among predicted intrinsics. Second, we design a physics-inspired neural forward rendering module, where the physics-based loss serves as an efficient learning mechanism. Note that, our physics-inspired loss function is non-trivial. It regularizes the training dynamics into a physically plausible landscape, enabling easier convergence and allowing the model to learn more correct light transport with less data and computation. As a result, our method achieves competitive performance and generalizes well to real-world scenes, even with fewer training samples than previous works ( Zeng et al. 2024b ; Liang et al. 2025 ) and without access to fully realistic datasets. We further propose a simple yet effective lighting representation that uses only the front hemisphere of the environment map. This design avoids interference from self-luminous objects and built-in scene lighting, enabling effective control of light direction and intensity while preserving background consistency. To address the data scarcity that hinders full-image relighting research, we constructed a new dataset featuring diverse objects and scenes, all captured under controlled lighting conditions. This dataset not only supports supervised learning but also enables comprehensive downstream benchmarking. By training on this dataset, combined with the image prior from pretraining, \pi -Light demonstrates strong generalization across diverse objects and scenes, as extensively validated in our experiments. Our contributions can be summarized as follows: • We propose \pi -Light, a diffusion-based neural relighting framework that achieves physically-aware full-image relighting. • We impose physics-inspired light transport priors onto the neural forward rendering module as a regulation to help the model converge toward physical principles and enhance generalizability. • We contribute a new, high-quality dataset of diverse objects and scenes rendered under controlled lighting conditions, providing a valuable resource for advancing full-image relighting research. • Extensive experiments demonstrate the superiority of our method over previous models. 2 Related Work Neural Rendering. PBR simulation has recently emerged as a research focus, encompassing both inverse rendering and forward rendering processes. Many recent works ( Zhu et al. 2022 ; Zhang et al. 2024 ; Zeng et al. 2024a ; Kocsis et al. 2024b ; Li et al. 2020 ) have concentrated on the inverse rendering process, also referred to as image intrinsic decomposition. However, due to the difficulty of acquiring large-scale training data, these methods have limited applicability and are primarily designed for specific scenarios, such as indoor scenes ( Zhu et al. 2022 ; Kocsis et al. 2024b ; Li et al. 2020 ) or object-level inverse rendering ( Zhang et al. 2024 ; Zeng et al. 2024a ; Jin et al. 2024 ) . MAIR ( Choi et al. 2023 ) improves inverse rendering with multi-view attention and spatially-varying lighting estimation but is sensitive to viewpoint inconsistencies. Other approaches focus on the inverse rendering of illumination maps ( Enyo & Nishino 2024 ; Lyu et al. 2023 ) , aiming to infer scene lighting properties directly from images. Additionally, some methods ( Bae & Davison 2024 ; Bae et al. 2021 ; Fu et al. 2024 ) specialize in geometry estimation, particularly in normal and depth estimation. Furthermore, unsupervised approaches