Chord: Ch ain o f R endering D ecomposition for PBR Material Estimation from Generated Texture Images Journal: TOG Conference: SIGGRAPH Asia 2025 Conference Papers; December 15–18, 2025; Hong Kong, Hong Kong SIGGRAPH Asia 2025 Conference Papers (SA Conference Papers ’25), December 15–18, 2025, Hong

Zhi Ying, Boxiang Rong, Jingyu Wang, Maoyuan Xu · 2025

Read Chord: Ch ain o f R endering D ecomposition for PBR Material Estimation from Generated Texture Images Journal: TOG Conference: SIGGRAPH Asia 2025 Conference Papers; December 15–18, 2025; Hong Kong, Hong Kong SIGGRAPH Asia 2025 Conference Papers (SA Conference Papers ’25), December 15–18, 2025, Hong by Zhi Ying, Boxiang Rong, Jingyu Wang, Maoyuan Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-09952.txt.

Introduction

Zhi Ying and 3 co-authors automate the craft of digital material design in 2025 with a two-stage system called Chord. Making believable surface materials for rendering takes artists long hours of skill, and recent generators that lean on visual foundation models often sacrifice quality, flexibility, or the user's say in the result. Chord first paints a shaded, tileable texture that follows the user's input, then reads the material back out of that picture.

The reading stage works as a chain: each physical channel of the surface description is predicted in turn, with earlier channels handed along as guidance to a fast image-conditioned diffusion model. The chain holds up on machine-made textures and on wild photographs alike. Text prompts, example images, structural guides, and editing all plug into the same frame.

Catalog record

CREATORZhi Ying, Boxiang Rong, Jingyu Wang, Maoyuan Xu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-09952

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Chord: Ch ain o f R endering D ecomposition for PBR Material Estimation from Generated Texture Images Journal: TOG Conference: SIGGRAPH Asia 2025 Conference Papers; December 15–18, 2025; Hong Kong, Hong Kong SIGGRAPH Asia 2025 Conference Papers (SA Conference Papers ’25), December 15–18, 2025, Hong Kong, Hong Kong DOI: 10.1145/3757377.3763848 ISBN: 979-8-4007-2137-3/2025/12 CCS: Computing methodologies Appearance and texture representations Zhi Ying, Boxiang Rong, Jingyu Wang, Maoyuan Xu Abstract . Material creation and reconstruction are crucial for appearance modeling but traditionally require significant time and expertise from artists. While recent methods leverage visual foundation models to synthesize PBR materials from user-provided inputs, they often fall short in quality, flexibility, and user control. We propose a novel two-stage generate-and-estimate framework for PBR material generation. In the generation stage, a fine-tuned diffusion model synthesizes shaded, tileable texture images aligned with user input. In the estimation stage, we introduce a chained decomposition scheme that sequentially predicts SVBRDF channels by passing previously extracted representation as input into a single-step image-conditional diffusion model. Our method is efficient, high quality, and enables flexible user control. We evaluate our approach against existing material generation and estimation methods, demonstrating superior performance. Our material estimation method shows strong robustness on both generated textures and in-the-wild photographs. Furthermore, we highlight the flexibility of our framework across diverse applications, including text-to-material, image-to-material, structure-guided generation, and material editing. Figure 1 . PBR materials generated by our method. Keywords in the text prompts used for generating each material (from left to right) are: fabric with flower embroidery , cobblestone , green marble , salmon fish meat , wood floor , colorful stone wall , cyberpunk iron wall , and wet mossy rock . 1. Introduction Generating materials that represent the appearance of objects has been a long-standing focus in the computer graphics communities. Early methods primarily synthesized RGB textures. With the rise of physically based rendering (PBR) workflows, materials are now commonly represented as spatially-varying bidirectional reflectance distribution functions (SVBRDFs). This advancement allows for more realistic representations of surface properties like reflectance and roughness but significantly increases complexity. The generation process now must handle multiple channels (e.g., basecolor, normal, roughness, and metalness maps) while ensuring precise spatial alignment. We treat these channels as distinct modalities due to their differing physical meanings. A visualization of their data distribution is shown in Fig. 2 . Recent work aims to simplify this process by compressing multiple channels into one latent space, and leverage specialized generative models ( Zhou et al. 2022 ; Vecchio et al. 2024b ; Vecchio et al. 2024a ) to generate materials with certain level of user control. However, the flexibility and quality remains limited due to the constraints of their coupled architectures. To address this challenge, we propose a two-stage generate-and-estimate framework that enables flexible user control. The first stage leverages a generative model, guided by various control techniques, to generate texture RGB images aligned with user inputs. The second stage employs our novel chain-of-rendering-decomposition (Chord) pipeline to predict SVBRDF channels through sequential steps. Texture Generation involves creating tileable texture RGB images that represent top-down views of materials. Traditional example-based methods generate textures that are visually similar to user-provided exemplars ( Wei et al. 2009 ) . While effective, they are often limited by the quality of input examples and can produce only a narrow range of variations. More recently, text-to-image generative models have been applied to texture generation ( Chen et al. 2023 ) , showing greater flexibility and promising results. Additionally, the controllability of these models can be enhanced through additional input conditions, such as line art and depth maps ( Zhang et al. 2023 ) . Building on this approach, we employ a fine-tuned version of SDXL ( Podell et al. 2024 ) for generating texture RGB images. Our model is trained on texture images rendered under predefined lighting and camera conditions, with each image paired with a descriptive caption. To enable the tileability of the generated images, we use circular padding for all the convolutional layers. Material estimation focuses on inverse rendering, where shaded images of certain materials are used to estimate its SVBRDF channels. This task is inherently challenging due to its under-constrained nature. Recent intrinsic decomposition approaches ( Kocsis et al. 2024 ; Zeng et al. 2024 ) attempt to address this challenge by leveraging visual foundation models fine-tuned on modality-specific data, and use their strong prior knowledge to reduce the uncertainties. These data-driven methods require large amounts of training data and significant time to generalize effectively to novel materials. Moreover, they ignore the intrinsic relationships between different channels, often failing to accurately recover the expected material appearance. Therefore, to preserve the intrinsic relationships among SVBRDF channels, we propose a novel chained scheme for image-conditional dense prediction diffusion models, where channels are predicted sequentially by conditioning on previously extracted representation. Our specific chain design named Chord is derived from the rendering equation of PBR materials, which predicts basecolor first, followed by normals with height, and finally roughness and metalness. The decomposition task is simplified by leveraging the implicitly predefined lighting and camera conditions between the two stages. To mitigate interference between different combinations of input and output modalities, we replace several U-Net blocks with a modular conditioning mechanism, termed LEGO-conditioning . During training, our chained scheme relies on clean intermediate representations, differing from standard diffusion training, which uses noisy samples. To address this, we adopt the single-step approach from ( He et al. 2024 ; Garcia et al. 2024 ) , which not only ensures deterministic outputs but also improves inference efficiency by eliminating the need for multi-step denoising. Representative examples of generated PBR materials are shown in Fig. 1 . In summary, our main contributions are: • A two-stage generate-and-estimate framework that enables flexible user control and simplifies material estimation via implicitly shared lighting and camera conditions. • A chained scheme for multi-modal dense prediction using image-conditional diffusion model to capture inter-modal dependencies. • The proposed Chord pipeline, which explicitly models the intrinsic relationships among SVBRDF modalities, combining LEGO-conditioning and single-step fine-tuning for efficient, high-quality material estimation. Figure 2 . 2D t-SNE visualization of latent vectors. Texture RGB and basecolor modalities exhibit significant overlap, suggesting a strong bijective relationship. The normal modality forms a distinct cluster. Metalness vectors are concentrated near binary values (0 and 1), while roughness vectors are more evenly distributed across the (0,1) range. 2. Related Work Material Estimation The methods introduced by Aittala et al. ( Aittala et al. 2015 ; Miika Aittala 2016 ) aim to reduce the number of input images required for material estimation by assuming a fixed, centrally positioned point light source for illumination. These are the first optimization-based methods for few-shot material estimation. However, they rely heavily on hand-crafted heuristics and empirical priors. Deschaintre et al. ( Deschaintre et al. 2018 ) introduce the first large synthetic dataset for material estimation and use a variation of U-Net ( Ronneberger et al. 2015 ) to predict SVBRDF channels. Subsequent works ( Li et al. 2017 ; Gao et al. 2019 ; Li et al. 2018 ; Zhou and Kalantari 2022 ; Martin et al. 2022 ; Sartor and Peers 2023 ) follow similar data-driven approaches to estimate materials

Read the complete text