LuxRemix: Lighting Decomposition and Remixing for Indoor Scenes

Ruofan Liang, Norman Müller, Ethan Weber, Duncan Zauss, [0.25em] Nandita Vijaykumar, Peter Kontschieder, Christian Richardt, [0.5em] Meta Reality Labs · 2026

Read LuxRemix: Lighting Decomposition and Remixing for Indoor Scenes by Ruofan Liang, Norman Müller, Ethan Weber, Duncan Zauss, [0.25em] Nandita Vijaykumar, Peter Kontschieder, Christian Richardt, [0.5em] Meta Reality Labs (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15283.txt.

Introduction

Ruofan Liang, Norman Müller, and co-authors take indoor lighting apart so it can be remixed. Their 2026 arXiv paper deals with light editing in indoor scenes. The input is a single multi-view capture of a room.

Their method uses a generative model to split the scene's light into its sources. Each lamp or window becomes a separate factor. Once split, each source can be edited on its own. Users can switch it off or on, shift its color, or change its brightness, and then rebuild the newly lit indoor scene at will.

Catalog record

CREATORRuofan Liang, Norman Müller, Ethan Weber, Duncan Zauss, [0.25em] Nandita Vijaykumar, Peter Kontschieder, Christian Richardt, [0.5em] Meta Reality Labs
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-15283

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LuxRemix: Lighting Decomposition and Remixing for Indoor Scenes Ruofan Liang, Norman Müller, Ethan Weber, Duncan Zauss, [0.25em] Nandita Vijaykumar, Peter Kontschieder, Christian Richardt, [0.5em] Meta Reality Labs Abstract We present a novel approach for interactive light editing in indoor scenes from a single multi-view scene capture. Our method leverages a generative image-based light decomposition model that factorizes complex indoor scene illumination into its constituent light sources. This factorization enables independent manipulation of individual light sources, specifically allowing control over their state (on/off), chromaticity, and intensity. We further introduce multi-view lighting harmonization to ensure consistent propagation of the lighting decomposition across all scene views. This is integrated into a relightable 3D Gaussian splatting representation, providing real-time interactive control over the individual light sources. Our results demonstrate highly photorealistic lighting decomposition and relighting outcomes across diverse indoor scenes. We evaluate our method on both synthetic and real-world datasets and provide a quantitative and qualitative comparison to state-of-the-art techniques. For video results and interactive demos, see luxremix.github.io . Figure 1 : LuxRemix enables interactive light editing of indoor scenes. Our method decomposes complex scene lighting into one-light-at-a-time (OLAT) sources and ambient lighting, which can be remixed for relighting effects. In the top right, we apply our method to single images, where we can change lights and their colors. LuxRemix also enables multi-view-consistent harmonization of the decomposed lighting across multi-view images. By combining these capabilities, we enable real-time relighting of indoor scenes using 3D Gaussian splatting. † † footnotetext: * Joint advising 1 Introduction Controlling lighting in indoor scenes is fundamental to photography, cinematography, and virtual production workflows. Professional photographers carefully adjust individual light sources to achieve desired aesthetic and functional lighting conditions. However, this fine-grained control is typically lost after capture: images and 3D reconstructions bake lighting into the recorded appearance, making post-capture lighting adjustments difficult or impossible. Enabling flexible post-capture editing of individual light sources in multi-view captured scenes dramatically expands creative possibilities for photographers, filmmakers, and digital artists, allowing them to refine lighting decisions after the fact or explore alternative lighting configurations without physical recapture. Existing approaches to scene relighting face significant limitations. Data-driven methods require dense multi-lighting captures under controlled conditions, which is impractical for real-world indoor scenes and offers limited generalization Bi et al. 2020 ; Boss et al. 2021 . Optimization-based inverse rendering can decompose scenes into geometry, materials, and lighting, but remains computationally intensive and often fails to produce plausible results when lighting conditions change significantly Nimier-David et al. 2021 ; Wu et al. 2023 . Recent prior-driven approaches leverage pretrained diffusion models for relighting, but focus primarily on objects Zeng et al. 2024a ; Jin et al. 2024 , portraits Chaturvedi et al. 2025 , or simple scenes under distant illumination Liang et al. 2025a . Indoor scenes present unique challenges: spatially varying illumination from multiple near-field sources creates complex lighting interactions that are difficult to decompose and edit, especially when selectively switching individual lights on or off. Moreover, existing single-image methods Magar et al. 2025 cannot maintain 3D consistency across multiple viewpoints, limiting their applicability to multi-view reconstructions. We present LuxRemix, a novel approach for interactive light editing in indoor scenes from a single multi-view capture. Our method decomposes the complex lighting of an indoor scene into individually controllable light sources, enabling users to interactively adjust the intensity and color of each light or switch it on or off entirely. The approach operates in three stages: first, we leverage our proposed generative image-based light decomposition model to separate the contribution of each light source; second, we propagate these decompositions consistently across all views using our multi-view lighting harmonization; third, we train a relightable 3D Gaussian splatting representation that enables real-time interactive manipulation of individual light sources from any viewpoint. Unlike existing methods that treat lighting as a global property or focus on distant illumination, our approach models spatially varying global illumination from multiple near-field sources in complex indoor environments. While prior work on single-image lighting decomposition Magar et al. 2025 provides individual light control, it cannot ensure consistency across multiple views. Conversely, multi-view relighting methods Philip et al. 2019 ; Alzayer et al. 2025 achieve 3D consistency but require controlled multi-lighting captures or produce only global relighting effects without per-light control. Our method bridges this gap by combining the fine-grained control of single-image decomposition with the 3D consistency of multi-view methods. The key insight enabling our approach is that modern diffusion models encode rich priors about indoor lighting that can be leveraged for decomposition, while multi-view geometric constraints provide the necessary consistency to propagate these decompositions across views. By formulating lighting decomposition as a multi-view harmonization problem and encoding the results in a fast, differentiable 3D representation (3D Gaussians), we achieve both high-quality per-light control and real-time interactive performance. Our main contributions are: 1. A single-image lighting decomposition model to factorize complex indoor scene lighting into individually controllable light sources. 2. A multi-view lighting harmonization method to ensure 3D consistency of the individual light source decompositions across all captured viewpoints. 3. Encoding the decomposed, consistent lighting in a relightable 3D Gaussian splatting representation, enabling real-time interactive manipulation of individual near-field light sources from novel viewpoints. 4. A large-scale synthetic dataset of 12,000 generated indoor scenes with ground-truth per-light decompositions. 2 Related Work There are three major approaches for editing scene lighting: (1) data-driven methods that require dense multi-lighting capture with limited generalization; (2) optimization-based inverse rendering that can be fragile for complex scenes; and (3) prior-driven methods that fine-tune pretrained models on task-specific data. We focus on prior-driven approaches for robustness and generalization. This research direction has gained momentum over the last year, with most relighting work focusing on humans Zhang et al. 2025 ; Chaturvedi et al. 2025 , objects Zeng et al. 2024a ; Jin et al. 2024 , or simple scenes Liang et al. 2025a ; Litman et al. 2025 under distant illumination. Scene relighting is more complex due to spatially varying illumination that is challenging to edit, e.g., to selectively switch lights on or off after the fact. 2.1 Inverse Rendering and Image Decompositions Inverse rendering recovers scene geometry, materials, and lighting from images, enabling relighting and image editing. Traditional optimization-based approaches Nimier-David et al. 2021 ; Wu et al. 2023 ; Lin et al. 2025 leverage differentiable rendering but are computationally intensive and may lack plausibility when lighting changes. Recent neural and diffusion-based approaches have shown promising results, particularly for single images. Single-image inverse rendering Early work on intrinsic decomposition Garces et al. 2022 ; Careaga and Aksoy 2023 separated images into shading and albedo components, which was later extended by diffusion-based approaches Luo et al. 2024 ; Zeng et al. 2024b ; Sun et al. 2025 that jointly estimate intrinsic layers and enable material-aware synthesis. For complex indoor scenes, methods have progressively improved from recovering shape, lighting, and SVBRDF Li et al. 2020 ; Li et al. 2022 ; Munkberg et al. 2022 to using vision transformers Zhu et al. 2022 and diffusion models Kocsis et al. 2024b ; Liang et al. 2025a for more robust decomposition. Multi-view inverse rendering Multi-view methods can reconstruct more accurate geometry and appearance than single-view inverse rendering, but require multi-view input. Early approaches

Read the complete text