Improved Stochastic Texture Filtering Through Sample Reuse

Bartlomiej Wronski, Matt Pharr, Tomas Akenine-Möller · 2025

Read Improved Stochastic Texture Filtering Through Sample Reuse by Bartlomiej Wronski, Matt Pharr, Tomas Akenine-Möller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05562.txt.

Introduction

Bartlomiej Wronski, Matt Pharr, and Tomas Akenine-Möller improve stochastic texture filtering in this 2025 paper. Graphics systems sample textures at random to cut cost, a trick revived for neural texture compression. When a texture is magnified, that random order can cause aliasing and odd looks.

Nearby pixels under magnification read nearly the same texels. Their method shares texel values across those pixels for a tiny added cost per frame. A new weighted sampling scheme guarantees error never exceeds the single-sample baseline. At high magnification, image quality beat the baseline by a wide margin in peak signal terms. Gains held with and without denoising over space and time.

Catalog record

CREATORBartlomiej Wronski, Matt Pharr, Tomas Akenine-Möller
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05562

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improved Stochastic Texture Filtering Through Sample Reuse Bartlomiej Wronski, Matt Pharr, Tomas Akenine-Möller Abstract . Stochastic texture filtering (STF) has re-emerged as a technique that can bring down the cost of texture filtering of advanced texture compression methods, e.g., neural texture compression. However, during texture magnification, the swapped order of filtering and shading with STF can result in aliasing. The inability to smoothly interpolate material properties stored in textures, such as surface normals, leads to potentially undesirable appearance changes. We present a novel method to improve the quality of stochastically-filtered magnified textures and reduce the image difference compared to traditional texture filtering. When textures are magnified, nearby pixels filter similar sets of texels and we introduce techniques for sharing texel values among pixels with only a small increase in cost (0.04–0.14 ms per frame). We propose an improvement to weighted importance sampling that guarantees that our method never increases error beyond single-sample stochastic texture filtering. Under high magnification, our method has >10 dB higher PSNR than single-sample STF. Our results show greatly improved image quality both with and without spatiotemporal denoising. Journal: PACMCGIT Volume: 8 1 14 5 DOI: 10.1145/3728292 CCS: Computing methodologies Texturing CCS: Computing methodologies Image processing CCS: Computing methodologies Image compression ground truth STF STF denoised our our denoised full image PSNR ( \uparrow )/ FLIP ( \downarrow ): 30.3 / 0.042 35.9 / 0.030 42.6 / 0.021 48.1 / 0.017 bilinear bicubic B-spline PSNR ( \uparrow )/ FLIP ( \downarrow ): 28.3 / 0.054 33.8 / 0.038 38.2 / 0.032 44.7 / 0.020 Figure 1. We present an improved stochastic texture filtering (STF) method with no additional texture lookup cost compared to standard STF. Above, the images from our method have between 9.9 and 12.3 dB higher PSNR and lower FLIP errors for both bilinear and bicubic B-spline filtering compared to standard STF. DLSS was used for denoising. figure description 1. Introduction The gap between computation and memory bandwidth in microprocessors has been increasing for nearly 50 years ( Dongarra, 2022 ) . GPUs are not immune to this trend: over the past 20 years, the computation available on GPUs (measured by FP32 GFLOPS) has increased by a factor of \sim\!2,750\times , while the peak off-chip memory bandwidth has increased by a factor of just \sim\!60\times . 1 1 1 We compare the NVIDIA GeForce FX 5800 Ultra, 30 FP32 GFLOPS, 16 GB/s bandwidth, released March 2003, to the NVIDIA 4090 RTX, 82.6 TFLOPS, 1.01 TB/s bandwidth, released October 2022; GPUs from other manufacturers share similar relative ratios. If specialized tensor operations in hardware is included, the growth in available computation is up to an order of magnitude greater, depending on the precision. This trend has motivated the development of new compression techniques that trade off increased computation to save bandwidth; examples include neural texture compression (NTC) ( Vaidyanathan et al., 2023 ) and NeuralVDB ( Kim et al., 2024 ) . However, these techniques are not compatible with current GPU texture filtering hardware and may be too expensive even for a simple bilinear filter decoding 2\times 2 texels. Building on earlier work by Hofmann et al. ( Hofmann et al., 2021 ) , Vaidyanathan et al. ( Vaidyanathan et al., 2023 ) , and others, Pharr et al. ( Pharr et al., 2024 ) thus introduced a family of Monte Carlo stochastic texture filtering (STF) techniques to approximate the effects of traditional texture filtering without increasing the texture sampling cost beyond a single sample. STF has the additional advantage that it allows efficient implementation of filtering after shading (FAS), where the antialiasing filter is applied to the final shaded value rather than the texture inputs to a shader ( Pharr et al., 2024 ) . When the shading function is linear or an affine combination of the input texture values, both filtering before shading (FBS) and FAS converge to the same result. When it is non-affine, results differ: FAS is generally more accurate than FBS when textures are minimized, but it has a number of disadvantages when textures are magnified ( Pharr et al., 2024 , Section 3.2) : • FAS can introduce aliasing under magnification. • FAS is unable to reproduce smooth interpolation of some properties (e.g., surface curvature). • FAS may produce results different than those intended by the author of the art assets. Further, spatiotemporal reconstruction techniques like TAA ( Yang et al., 2020 ; Karis, 2014 ) and DLSS ( Liu, 2022 ) may fail to converge and produce residual noise when used to integrate STF samples ( Pharr et al., 2024 , Section 6) . In this work, we address these limitations and improve the quality of stochastic texture magnification without increasing the cost beyond a single texture lookup and without affecting the favorable properties of FAS for minification. We base our approach on a simple insight: under magnification, adjacent screen pixels tend to filter the same set of texels. Thus, if each pixel continues to take a single STF texel sample and shares this sample with nearby pixels, then each pixel may be able to compute a more accurate estimate of the true filtered value. This sharing can be performed efficiently by taking advantage of the SIMT/SIMD nature of GPU execution to communicate between shader threads without any VRAM memory traffic. By averaging multiple texel values, our method performs some filtering before shading. Intuitively, it can be seen as a hybrid between filtering after shading and filtering before shading. Our contributions include: • An algorithm for efficient STF sample reuse and sharing using wave intrinsics (Section 4 ) including practical implementation details (Section 4.5 ). • An in-depth analysis of the error of the traditional STF estimator (Section 3 ) including the impact of filtering after shading of non-affine rendering functions. We further explain in the supplementary material (Section S2 ) the relationship between the estimator variance and the bias introduced by reordering filtering and shading. • A new Monte Carlo estimator based on weighted importance sampling with a lower error than previous estimators when used for stochastic texture filtering (Section 4.2 ). • An algorithm that generates optimized sharing footprints introducing variation, in which pixels share texel values with each other and distribute error as blue noise in the rendered images (Section 4.3 ). • An algorithm to generate custom blue noise patterns optimized to account for this sharing (Section 4.4 ). Under magnification, these techniques provide much better image quality than traditional STF, both visually and using error metrics; see Figure 1 . We validate our claims and analyze results with a number of Monte Carlo estimators, different pseudo-random sequences and using different spatiotemporal denoisers in Section 5 . 2. Background and Previous Work Before introducing our algorithm, we first provide relevant background on texture filtering, Monte Carlo sampling, and the GPU quad and wave intrinsics we use for efficient communication between nearby pixels. 2.1. Texture Filtering and Representations A texture t(u,v) is defined by a set of texels \mathbf{T}_{u_{i},v_{i}} defined at integer coordinates (u_{i},v_{i}) on a grid, scaled by translated Dirac delta functions: 2 2 2 Without loss of generality, we focus on filtering 2D textures and use this assumption throughout the text, but the described

Read the complete text