Lunar-G2R : Geometry-to-Reflectance Learning for High-Fidelity Lunar BRDF Estimation

Clémentine Grethen, Nicolas Menga, Roland Brochard, Géraldine Morin, Simone Gasparini, Jérémy Lebreton, Manuel Sanchez-Gestido · 2026

Read Lunar-G2R : Geometry-to-Reflectance Learning for High-Fidelity Lunar BRDF Estimation by Clémentine Grethen, Nicolas Menga, Roland Brochard, Géraldine Morin, Simone Gasparini, Jérémy Lebreton, Manuel Sanchez-Gestido (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10449.txt.

Introduction

Clémentine Grethen and co authors learn how the moon bounces light, from its shape. How a surface bounces light is named its BRDF. The moon's dust has a rich bounce that shifts by place. Past moon maps use a plain bounce for all spots. Their terms are hard to set and miss local shifts.

The team learn the bounce from shape facts. Shape comes from maps of the moon's heights. The learned bounce can then shade each spot as it is. That gives truer shots for craft that land by sight. It also aids maps that read the moon from its hues.

Catalog record

CREATORClémentine Grethen, Nicolas Menga, Roland Brochard, Géraldine Morin, Simone Gasparini, Jérémy Lebreton, Manuel Sanchez-Gestido
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-10449

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lunar-G2R : Geometry-to-Reflectance Learning for High-Fidelity Lunar BRDF Estimation Clémentine Grethen, Nicolas Menga, Roland Brochard, Géraldine Morin, Simone Gasparini, Jérémy Lebreton, Manuel Sanchez-Gestido Abstract We address the problem of estimating realistic, spatially varying reflectance for complex planetary surfaces such as the lunar regolith, which is critical for high-fidelity rendering and vision-based navigation. Existing lunar rendering pipelines rely on simplified or spatially uniform BRDF models whose parameters are difficult to estimate and fail to capture local reflectance variations, limiting photometric realism. We propose Lunar-G2R , a geometry-to-reflectance learning framework that predicts spatially varying BRDF parameters directly from a lunar digital elevation model (DEM), without requiring multi-view imagery, controlled illumination, or dedicated reflectance-capture hardware at inference time. The method leverages a U-Net trained with differentiable rendering to minimize photometric discrepancies between real orbital images and physically based renderings under known viewing and illumination geometry. Experiments on a geographically held-out region of the Tycho crater show that our approach reduces photometric error by 38 % 38\text{\,}\mathrm{\%} compared to a state-of-the-art baseline, while achieving higher PSNR and SSIM and improved perceptual similarity, capturing fine-scale reflectance variations absent from spatially uniform models. To our knowledge, this is the first method to infer a spatially varying reflectance model directly from terrain geometry. Figure 1: Lunar-G2R estimates a spatially-varying parameterized BRDF of the lunar surface given the geometry. This estimated appearance allows for a realistic rendering of the moon surface (a), which closely matches the ground-truth observation (b). 1 Introduction Achieving physically realistic and predictive rendering requires accurate modeling of three fundamental components: surface geometry, material reflectance properties, and illumination. Material reflectance is classically modeled by a Bidirectional Reflectance Distribution Function (BRDF), which governs how a surface scatters light and ultimately determines its appearance. Estimating BRDF parameters that enable reliable re-rendering under arbitrary viewpoints and illumination remains a central and ill-posed challenge in computer vision and computer graphics [ 12 ] . Accurate BRDF modeling is critical for space applications. The design and validation of Vision-Based Navigation (VBN) algorithms rely heavily on synthetic imagery, whose realism depends on the underlying reflectance model. The need for an accurate lunar regolith reflectance model is particularly acute for lunar missions, where precise photometric behavior is essential for robust perception and navigation. Analytical BRDF models such as Hapke [ 15 ] provide a physically grounded description of lunar reflectance; however, in practice, only a subset of their parameters can be estimated at high spatial resolution. The remaining parameters are typically fixed or assumed spatially uniform, preventing current simulations from capturing the fine-scale reflectance variations observed in real lunar imagery. This motivates the need to estimate a spatially varying BRDF (SVBRDF) at a finer and more local scale. Classical BRDF estimation methods aim to sample a wide range of illumination and viewing directions to capture surface reflectance [ 12 , 20 ] . They typically rely on specialized acquisition setups, such as gonioreflectometers, or on controlled capture protocols involving systematic and controlled variations of lighting and viewpoint. Although accurate, these approaches are costly, difficult to scale, and incompatible with planetary settings, where multi-view or multi-illumination observations of the same surface are unavailable and specialized acquisition setups cannot be deployed in Space. The lunar terrain presents a distinctive scenario where the surface geometry is well characterized and stored as Digital Elevation Models (DEMs) [ 35 , 16 ] , while reflectance is challenging to model accurately due to its spatial variability. This peculiar setting suggests the opportunity to infer reflectance properties directly from terrain geometry, provided that a physically based and differentiable image formation model is available. The main challenge lies in modeling the interaction between surface morphology, illumination, and material composition under realistic imaging conditions. Recent advances integrate differentiable rendering directly into neural pipelines, enabling reflectance estimation by minimizing photometric errors between rendered and ground-truth images [ 20 ] . In this work, we follow this paradigm and leverage SurRender [ 3 ] — a physically accurate and differentiable ray-tracing engine tailored to space applications—to supervise reflectance learning using real lunar images. We introduce Lunar-G2R , a neural framework that predicts dense, spatially varying BRDF parameter maps at each point of a lunar DEM. The framework is built around a U-Net architecture and trained using a differentiable rendering formulation, where images rendered from the predicted per-pixel BRDF parameters are compared to real orbital observations. By enabling physically based renderings at higher spatial resolution and fidelity than standard analytical models such as Hapke, our approach significantly improves the realism of simulated lunar imagery. This design allows reflectance properties to be learned directly from terrain geometry and demonstrates that estimating reflectance from geometry alone is feasible. This suggests that the same strategy could be extended to other lunar regions or planetary terrains whenever both elevation models and real images are available. To our knowledge, this is the first approach that learns a spatially varying BRDF directly from surface geometry at DEM resolution ( 5\text{\,}\mathrm{m}\text{/}\mathrm{px} ), reducing photometric rendering error by 38\text{\,}\mathrm{\%} on average compared to a Hapke-based baseline. The contributions of this work are twofold: (i) We introduce Lunar-G2R , a U-Net–based neural architecture that predicts polynomial SVBRDF parameter maps from high-resolution lunar DEM tiles. (ii) We develop a complete learning pipeline that (a) constructs a large-scale training dataset of over 80,000 DEM–image pairs (publicly released 1 1 1 Data and code: https://clementinegrethen.github.io/publications/Lunar-G2R ) by pairing real lunar images with corresponding DEMs and acquisition metadata through a dedicated sampling strategy ensuring photometric diversity and BRDF observability (over 80,000 DEM–image pairs), and (b) integrates the network into a differentiable rendering framework to provide end-to-end, physically consistent supervision. The paper is organized as follows. Section 2 reviews prior work on BRDF and SVBRDF modeling and estimation, as well as existing approaches to lunar reflectance modeling and its use in planetary image simulation. Section 3 presents the Lunar-G2R framework, including the BRDF parameterization and network architecture. Section 4 details the training pipeline, covering dataset construction and differentiable rendering–based loss. Section 5 reports the evaluation protocol and experimental results. Finally, Section 6 discusses limitations and future directions. 2 Related work This section reviews prior work on BRDF and SVBRDF representations and estimation, before focusing on reflectance modeling and simulation in the lunar context. BRDF and SVBRDF A joint representation of surface geometry and material appearance is essential for numerous vision and graphics pipelines, including view synthesis, relighting [ 17 , 12 ] , and high-fidelity synthetic data generation for perception and simulation [ 33 ] . These applications rely on accurate models describing the directional reflectance behaviour of a material. This is commonly expressed through Bidirectional Reflectance Distribution Functions (BRDFs) and their spatially varying extension (SVBRDFs) that enable reflectance parameters to change across the surface [ 36 ] . From a physical point of view, surface appearance is governed by the integration of the (SV)BRDF and the incoming illumination [ 18 ] . Popular BRDF models include empirical formulations such as Lambert [ 22 ] or Phong [ 38 ] , and physically-based models like the Torrance–Sparrow microfacet model [ 5 ] . Measured data-based BRDFs are commonly represented either as dense lookup tables, as in the MERL database [ 31 ] , or through compact parametric models

Read the complete text