DANTE-W: Diffuse Albedo Neural Texturing in the Wild
Guangyu Wang ⋆ \star, Tianheng Lu ⋆ \star, Ruqi Huang 🖂, Lu Fang 🖂 · 2026
Read DANTE-W: Diffuse Albedo Neural Texturing in the Wild by Guangyu Wang ⋆ \star, Tianheng Lu ⋆ \star, Ruqi Huang 🖂, Lu Fang 🖂 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30677.txt.
Introduction
Guangyu Wang, Tianheng Lu, Ruqi Huang and Lu Fang present Dante-w, a neural texturing method for 3D scenes captured in the wild. Mesh texturing usually blends photos taken from many views straight onto a surface. Lighting gets baked in: shading and cast shadows become part of the texture, which ruins relighting later. Recovering diffuse albedo, the surface's true colour without lighting, is the real goal.
Dante-w fuses generative albedo priors, learned guesses of true surface colour, from many views into one coherent texture through a neural representation. Physically principled neural rendering then sharpens fine detail. The method plugs into standard reconstruction pipelines, needing only a finished mesh and its surface layout. The team curated a benchmark of real scenes and synthetic objects with rich, fine textures. Experiments showed Dante-w recovered accurate albedo textures and improved relighting fidelity over standard texturing.
Catalog record
| CREATOR | Guangyu Wang ⋆ \star, Tianheng Lu ⋆ \star, Ruqi Huang 🖂, Lu Fang 🖂 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30677
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DANTE-W: Diffuse Albedo Neural Texturing in the Wild Guangyu Wang ⋆ \star, Tianheng Lu ⋆ \star, Ruqi Huang 🖂, Lu Fang 🖂 Abstract Classical mesh texturing techniques blend captured multi-view images directly, which inevitably suffer from baked-in shading and casted shadows that compromise visual fidelity during relighting. To circumvent this issue, we present a neural texturing framework, namely Dante-w , to enable high-fidelity diffuse albedo texture recovery from unstructured image collections for large-scale, in-the-wild scenes, which integrates seamlessly with traditional 3D reconstruction pipelines. Given a reconstructed mesh and its surface parameterization, our method fuses view-space generative albedo priors into a coherent texture space via an expressive neural representation, while substantially enhancing fine-grained textural details through physically principled neural rendering. To comprehensively evaluate our method, we curate a benchmark dataset featuring diverse, fine-grained textures, comprising both real-world in-the-wild scenes and synthetic objects. Extensive experiments verify the effectiveness of our approach in reconstructing accurate albedo textures and boosting relighting fidelity. Project page: dante-wild.github.io . Figure 1 : We present Dante-w , a neural texturing framework for high-fidelity diffuse albedo recovery in the wild. Compared to vanilla mesh texturing with baked-in lighting effects (e.g., noon-time shading and strong roof-edge shadowing on this pavilion), our method effectively disentangles a 3D-consistent diffuse albedo texture with exceptional photorealism. Leveraging physically principled neural rendering, Dante-w faithfully reconstructs fine-grained albedo details, enabling hyper-realistic free-view relighting. 1 1 footnotetext: 🖂 Correspondence to: Lu Fang ([email protected], luvision.net ), Ruqi Huang ([email protected], rqhuang88.github.io ). 2 2 footnotetext: \star Authors contributed equally to this work. 1 Introduction Reconstructing high-quality textured assets of real-world large-scale scenes plays a crucial role in domains of virtual reality, filmmaking, and gaming. However, delivering lifelike experiences with these in-the-wild digitizations remains challenging, as it necessitates high-fidelity and 3D-consistent rendering of fine-grained details under arbitrary lighting conditions. In particular, we identify and address the critical limitations of existing methods as follows. First of all, existing 3D reconstruction paradigms lack generalizable intrinsic decomposition capability. While traditional image-based 3D reconstruction techniques [ 21 , 57 , 61 , 41 , 45 ] scale well to hundreds of unstructured input images and large-scale scenes, they fail to reason about intrinsic material properties beyond raw pixel observations – specifically, to disentangle surface reflectance (e.g., diffuse albedo) from illumination effects (i.e., irradiance) – leading to baked-in shading and shadows that compromise the visual fidelity when varying the illumination. In pursuit of intrinsic decomposition, a wealth of neural inverse rendering approaches [ 67 , 10 , 50 , 25 , 29 , 37 , 39 , 31 ] integrate physically-based rendering [ 32 , 12 ] with neural representations [ 47 , 63 , 48 , 33 ] , which jointly reconstruct shape, illumination, and material by imposing learned priors [ 68 , 11 , 43 , 42 ] or empirical regularizations [ 65 , 22 , 44 , 56 , 59 , 15 , 23 , 5 , 19 , 40 ] . However, they fall short in generalizing to challenging in-the-wild scenarios featuring complex illumination and highly detailed texture, due to oversimplified rendering formulations and the inherent lighting-material ambiguity. On the other end of the spectrum, recent 2D generation-based methods [ 66 , 38 ] demonstrate emergent generalizable albedo reasoning capabilities, by inheriting strong priors from pretrained diffusion models [ 55 , 9 , 1 , 2 ] and finetuning on high-quality, task-specific synthetic datasets [ 18 , 70 , 54 ] . However, these methods operate on a per-image or per-video-clip basis, leading to unstable predictions under drastic viewpoint variations while struggling to accurately represent fine details – primarily due to the lack of spatial awareness, the probabilistic nature of generative modelling, and the information loss within VAE. Moreover, these diffusion-based renderers remain incompatible with modern graphics pipelines and are inefficient for rendering. These limitations underscore the need to bridge these coarse diffusion clues with expressive 3D representations for robust, in-the-wild intrinsic decomposition. In light of the above observations, we present Dante-w , a neural texturing framework seamlessly integrating with traditional 3D mesh reconstruction pipelines [ 21 , 57 , 45 ] for high-fidelity diffuse albedo recovery, with an emphasis on challenging in-the-wild scenarios characterized by: 1) large-scale, near-Lambertian scenes with intricate, fine-grained textural details; 2) strong lighting variations involving complex shading and shadowing; 3) highly unstructured viewpoints spanning diverse observation distances. To combine the best of both worlds, we fuse generalizable, view-space albedo priors – obtained from state-of-the-art diffusion models [ 66 , 38 ] – into an expressive, 3D-consistent neural texture, thereby aggregating the view-dependent diffusion outputs to suppress flickering hallucinations. It is worth noting that, though, naively lifting per-view prior is prone to over-smoothed results, due to the inaccurate and view-inconsistent diffusion predictions at fine details. To address this issue, we propose to learn accurate details from the original images and resolve the ambiguity through the lens of frequency. Our observation is that in-the-wild lighting effects tend to be smoother than fine-grained albedo variations, which is also supported by prior findings [ 53 ] that irradiance can be accurately approximated within 1% error using only nine spherical harmonic coefficients corresponding to the lowest-frequency modes. To this end, we disentangle high-frequency albedo components from irradiance by explicitly differentiating the frequency bands of their respective neural representations, thereby encouraging high-frequency information to flow into the albedo representation when neural rendering the raw imagery. Given a mesh reconstructed and parameterized using off-the-shelf tools [ 45 ] , our neural texturing framework operates efficiently – requiring only a few minutes for large-scale scenes with thousands of unconstrained multi-view images. The resulting neural texture can be directly baked into a standard UV-map and readily imported into any modern graphics engine (e.g., Blender [ 20 ] ) for physically-based relighting, real-time rendering, and flexible editing. To comprehensively benchmark our method, we curate a dataset namely GigaLit , containing both in-the-wild scenes and synthetic objects, each characterized by complex, high-resolution textures under diverse lighting conditions. Extensive evaluations demonstrate the state-of-the-art performance of Dante-w – our method outperforms diffusion-based renderers [ 66 , 38 ] by +2.63/3.85 dB in PSNR and achieves \sim 25\% lower LPIPS for diffuse albedo recovery, and by +6.13/7.15 dB in PSNR and over 40\% reduction in LPIPS for relighting, underscoring a substantial advancement towards unprecedented robustness and fidelity for in-the-wild relighting applications. To summarize, our main contributions are as follows: • We present Dante-w to recover high-fidelity diffuse albedo for in-the-wild scenes, by lifting view-space diffusion priors to a consistent neural texture representation. • We propose a physically principled neural rendering framework to disentangle 3D-consistent, fine-grained albedo details from the original imagery via a frequency decomposition perspective. • We introduce GigaLit , a benchmark dataset for in-the-wild diffuse albedo recovery and relighting, featuring unprecedented textural details, complex illumination variations, and unstructured viewpoints, where our method demonstrates significant improvements over prior works. 2 Related work 2.1 Classical mesh texturing Traditional mesh texturing methods [ 61 , 8 , 26 , 41 , 45 ] take posed multi-view images and a parameterized mesh from multi-view stereo [ 21 , 57 ] as inputs, and optimize a Markov random field (MRF) energy, where the data term encodes view selection strategies [ 61 , 26