Neural Path Guiding with Distribution Factorization Volume: 44 Issue: 4

Pedro Figueiredo, Qihao He and Nima Khademi Kalantari Texas A&M University · 2025

Read Neural Path Guiding with Distribution Factorization Volume: 44 Issue: 4 by Pedro Figueiredo, Qihao He and Nima Khademi Kalantari Texas A&M University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00839.txt.

Introduction

Pedro Figueiredo, Qihao He, and Nima Khademi Kalantari teach rendering software where to aim its light rays. Their paper appeared in two thousand twenty-five. Monte Carlo rendering traces random paths to build an image. Guiding those paths toward bright directions cuts noise. Neural guides learn such direction maps. Old maps were either fast or expressive, never both.

Their trick splits the two-dimensional directional map into two one-dimensional ones. A network estimates each at fixed points, with interpolation between. Training maximizes how well the learned map matches the true one. A second network caches incoming light to steady the learning. Experiments show cleaner images for the same effort. Movie and game rendering gain efficiency.

Catalog record

CREATORPedro Figueiredo, Qihao He and Nima Khademi Kalantari Texas A&M University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00839

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neural Path Guiding with Distribution Factorization Volume: 44 Issue: 4 Pedro Figueiredo, Qihao He and Nima Khademi Kalantari Texas A&M University Abstract In this paper, we present a neural path guiding method to aid with Monte Carlo (MC) integration in rendering. Existing neural methods utilize distribution representations that are either fast or expressive, but not both. We propose a simple, but effective, representation that is sufficiently expressive and reasonably fast. Specifically, we break down the 2D distribution over the directional domain into two 1D probability distribution functions (PDF). We propose to model each 1D PDF using a neural network that estimates the distribution at a set of discrete coordinates. The PDF at an arbitrary location can then be evaluated and sampled through interpolation. To train the network, we maximize the similarity of the learned and target distributions. To reduce the variance of the gradient during optimizations and estimate the normalization factor, we propose to cache the incoming radiance using an additional network. Through extensive experiments, we demonstrate that our approach is better than the existing methods, particularly in challenging scenes with complex light transport. \ConferencePaper \WsPaper \CGFccby † † year: 2025 † † year: 2025 † † editors: B. Wang and A. Wilkie † † subject: Eurographics Symposium on Rendering CGF Vol No † † orcid: 0000-0002-3807-1512 † † orcid: 0009-0000-3011-3135 † † orcid: 0000-0002-2588-9219 1 Introduction Accurate simulation of light transport necessitates computing a complex multidimensional integral. Monte Carlo (MC) rendering, a common approach for physically-based light transport simulation, estimates this integral by averaging samples of the integrand. While this approach can produce compelling effects, the variance of the estimator decreases linearly with the number of samples. Therefore, accurate estimation of the integral requires evaluating a large number of expensive samples (paths), making the approach slow. An effective way of reducing the variance of MC rendering is through importance sampling. Specifically, the goal of importance sampling is to sample the paths with higher contribution to the integral more frequently. A large number of methods [ GBBE18 , VKv∗14 , MGN17 ] focus on devising strategies to approximate sampling distributions, typically in an online fashion, that are proportional to the integrand. Particularly, the path guiding approaches adopt a local view and perform the guided sampling at every intersection point along a path. These methods use efficient data structures, such as k-d tree [ DPÖM22 ] , octree [ BB17 ] , and quadtree [ MGN17 ] , as well as parametric models like Gaussian mixture model (GMM) [ HEV∗16 , VKv∗14 ] , and von Mises-Fisher (vMF) mixture models [ RHL20 ] , to estimate the distributions in a data-driven manner. Most of these methods learn a marginalized distribution within each subdivision, thus failing to capture the spatial variations in each subarea. More recently, a few techniques [ MMR∗19 , DWL23 , HIT∗24 ] overcome the limitations in explicit representations by utilizing neural networks. The network in these methods takes a continuous coordinate (spatial as well as directional in case of product sampling) as the input, and estimates the distribution at that particular location. The key difference between these methods is in how they model the probability distribution function (PDF). Specifically, Müller et al. \shortcite Muller_TOG_2019 use normalizing flows [ DSB17 ] , an expressive model with the ability to represent detailed distributions at the cost of being slower and more difficult to optimize. Dong et al. [ DWL23 ] and Huang et al. [ HIT∗24 ] , on the other hand, use mixture models that are relatively easy to optimize. In practice, these models are used with only a few components to ensure efficiency. Unfortunately, such models are not able to handle challenging light transport scenarios. In this paper, we propose a simple representation that is sufficiently expressive and reasonably fast. Specifically, we represent the joint PDF over the 2D directional domain in terms of the product of two 1D distributions: a marginal and a conditional PDF. We model each distribution using a separate neural network that estimates the PDF at uniformly spaced discrete locations. The PDF at an arbitrary coordinate is obtained by interpolating the estimated values. We explore two simple interpolation strategies and present approaches to evaluate and sample from our learned representation. We train our networks by minimizing the loss between the predicted and target distributions. Since the target distribution is unknown, existing methods [ DWL23 , MMR∗19 ] use its MC samples without normalization during optimization. Because of this, the gradients are highly noisy, making the training unstable. To address this issue, we identify the incoming radiance as the source of the variance, and propose to cache it using an additional network which is in turn used to estimate a better target distribution. We demonstrate that the combination of radiance caching and our simple PDF representation is highly effective and outperforms the existing techniques, particularly in challenging scenes. 2 Related Work Global Path Guiding These approaches attempt to sample a full path (from camera to light sources) at once according to the distribution of the integrand. This is typically done in the primary sample space (PSS), which provides an elegant way of parameterizing a path, while ensuring each vertex lies on the surfaces. Various approaches propose to do this using k-d trees [ GBBE18 ] or neural networks [ ZZ19 , MMR∗19 ] . However, these approaches suffer from the curse of dimensionality and their performance degrade with longer paths [ MMR∗19 ] . Specialized guiding methods have been developed to efficiently deal with glossy interactions, offering improved performance in specific scenarios [ LWT∗22 , FHG∗23 ] , which is not the primary focus of our framework. Local Path Guiding An alternative method is to perform guiding at every intersection point along the path. Early approaches represent the guiding distribution using a 2D histogram and store it through photon mapping [ Jen95 ] or a 5D tree [ LW95 ] . Follow up work refine this strategy through a combination of BRDF and photon map before sampling [ SL06 ] and improvements in caustics sampling [ BAJ08 ] . We also use a discretized representation, but factorize it to two 1D distributions and estimate them using neural networks. Moreover, we present evaluation and sampling using linear interpolation, in addition to the commonly-used used nearest neighbor strategy. A variety of other representations including hemispherical particle footprint [ HP02 ] , cosine lobes [ BRDC12 ] , B-splines [ PWP08 ] , binary and quad tree [ MGN17 , VHH∗19 , RGH∗20 , ZXS∗21a ] , double trees [ BB17 ] , and discretized hemispheres using reinforcement learning [ DK17 ] have also been proposed. Moreover, several methods use parametric models, such as Gaussian mixture [ VKv∗14 , HEV∗16 , DPÖM22 , VK16 ] and von Mises-Fisher (vMF) mixture models [ HZE∗19 , RHL20 ] . While most of these approaches fail to capture the spatial variations due to their limited spatial partitioning, a couple of methods address this issue [ RHL20 , DPÖM22 ] . Ruppert et al. [ RHL20 ] introduce a parallax compensation strategy that readjusts vMF lobes to point to a virtual light source. Unfortunately, they do not account for occlusion in such

Read the complete text