Neural Texture Compression using Hypernetworks
L. Belcour Intel Corporation · 2026
Read Neural Texture Compression using Hypernetworks by L. Belcour Intel Corporation (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26913.txt.
Introduction
L. Belcour of Intel Corporation compresses game textures with a hypernetwork, a network that writes other networks. Neural texture compression stores a material's surface detail as small learned features plus a tiny decoder network. At shading time the decoder rebuilds the texture in real time. Until now, each material needed its own slow optimisation run to find those features and decoder weights.
Belcour trains one hypernetwork to output both at once. Given a new material, it predicts the latent features and the decoder's weights and biases directly. The output space is huge, yet quality matches the per-material reference compressors. Extensions infer several decoders together. Others produce decoders that also perform sharpening the texture as they rebuild it. Per-material optimisation disappears from the pipeline.
Catalog record
| CREATOR | L. Belcour Intel Corporation |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26913
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural Texture Compression using Hypernetworks L. Belcour Intel Corporation Abstract Recent work on neural texture compression has demonstrated that it is possible to learn small, per-material texture representations (composed of latent textures and a small Multi-Layer Perceptron decoder) that can be decoded in real-time during shading to reproduce the input to a physically based shading model. However, existing methods require performing gradient-descent optimization per material for a given MLP and latent configuration. In this work, we train a single hypernetwork that outputs both the latent features and the MLP’s weights and biases. Though the solution space is high-dimensional, this approach produces results comparable in quality to the current reference neural texture compressors. We further extend this approach to infer multiple decoders at once or even produce decoders that learn super-resolution. \WsPaper ccs Computing methodologies Neural networks ccs Computing methodologies Machine learning ccs Computing methodologies Computer graphics † † year: 2026 † † year: 2026 † † editors: I. Gkioulekas and A. Jarabo † † subject: Eurographics Symposium on Rendering DL-only Track † † orcid: 0000-0002-1982-0717 † † teaser: input texture set Hypernetwork BCF1 Reference Reference Ours Ours We train a single hypernetwork to learn to compress any texture set into a neural compressed representation (BCF1 [ 2 ] ) and still preserve high-frequency details such as scratches or wood grain once decoded (see insets). 1 Introduction Physically based rendering (PBR) has become the standard for generating photorealistic images in computer graphics [ 25 ] . A key component of PBR is the use of material models that describe how light interacts with surfaces. These material models often require multiple texture maps (e.g., diffuse, normal, roughness, metallic) to capture the complex appearance of real-world materials (see OpenPBR specification [ 1 ] as an example). However, these texture maps can be large and require significant storage and bandwidth, especially when used in real-time applications such as video games. As an example, developers of Call of Duty could not even store the whole texture atlas on console storage [ 10 ] . To mitigate this issue, texture compression algorithms have been developed to reduce the storage and bandwidth requirements of texture maps [ 18 ] . Recently, neural material compression methods [ 28 , 29 , 8 , 2 ] have shown promising results by leveraging the correlation between different texture maps of the same material. These methods use a small neural network (e.g., a Multi-Layer Perceptron or MLP) to decode a compressed representation, achieving higher compression ratios than hardware compression methods. However, existing neural material compression methods require a separate optimization process for each material, which can be time-consuming and computationally expensive. In this work, we propose a novel approach that trains a single hypernetwork to output both the compressed representation and the decoder’s weights and biases for any given material. This allows us to achieve good compression ratios while significantly reducing the time required for optimization. Furthermore, we show that our hypernetwork can be repurposed for other tasks such as super-resolution, demonstrating the versatility of our approach. input textures Hypernetwork tokenization N\times DiT 4\times BC1 \begin{bmatrix}\boldsymbol{l}_{0}\\ \boldsymbol{l}_{1}\\ \boldsymbol{l}_{2}\\ \boldsymbol{l}_{3}\end{bmatrix} \mathbf{wb} MLP output textures Figure 1: Hypernetwork for neural texture compression. We train a neural network (denoted Hypernetwork) to output the latents, \boldsymbol{l}_{0},..,\boldsymbol{l}_{3} and the weights and biases, \mathbf{wb} of a neural model that decompresses to the target texture. Contrary to previous work that optimized \boldsymbol{l}_{0},..,\boldsymbol{l}_{3},\mathbf{wb} with gradient descent, we only regress the Hypernetwork’s weights. 2 Previous Work 2.1 Neural texture and material compression Modern real-time renderers rely on hardware block-compressed textures to reduce bandwidth and storage while preserving random access and mipmapping [ 5 , 11 , 23 ] . Using small neural networks, it is possible to further compress these textures while maintaining hardware block-compressed evaluation [ 12 ] . Neural texture compression extends this idea by learning compact, per-material representations together with lightweight decoders that can be evaluated on demand. Vaidyanathan et al. [ 28 ] introduced a random-access neural representation that jointly compresses multiple material texture maps, while supporting on-demand decoding similar to block texture formats. In parallel, Weinreich et al. [ 29 ] demonstrated that learned neural materials can be integrated into production pipelines by storing the latent features directly as block-compressed texture mip hierarchies and executing a small decoder MLP in a shader, preserving filtering behavior. Belcour and Benyoub [ 2 ] extended this idea by leveraging hardware matrix-multiplication support to accelerate the MLP evaluation, enabling fast rendering of compressed texture sets. However, this method introduces an additional pixel classification step to prevent having multiple MLPs in the same workgroup, which can impede performance. Other methods, such as using 2D Gaussian splats [ 30 ] , have been proposed, but they do not match the adaptation to graphics hardware and locality of evaluation that both NTC and NBC provide. 2.2 Hypernetworks Our work is related to the field of hypernetworks, where a model is trained to produce the weights of another network [ 15 ] . Convolutional hypernetworks have been used to learn the parameters of small MLP decoders to implicitly reproduce textures [ 21 ] . In computer graphics, hypernetworks have been used to perform style transfer [ 4 , 26 ] , to produce Neural Radiance Fields [ 27 ] , and even to fit neural BRDF models [ 14 ] . 2.3 Neural Enhancement of PBR Materials Super-Resolution We show how to retarget our work to increase the resolution of SVBRDFs while maintaining their appearance under relighting. MatUp repurposes pretrained RGB upsamplers to guide material upsampling in the radiance domain, optimizing a compact per-material MLP filter that enhances fine detail without requiring paired low/high-resolution SVBRDF datasets [ 13 ] . 3 A Hypernetwork for Material Compression 3.1 Problem Statement Texture Sets A texture set is defined as a collection of m correlated textures (e.g., diffuse, normal, roughness, metallic): \displaystyle\mathcal{T}_{i,j}=\{T_{i,j}^{0},T_{i,j}^{1},\ldots,T_{i,j}^{m}\} (1) where i,j\geq 0 are the pixel coordinates. In the following, we will assume normalized texture values T_{i,j}^{0}\in[0,1] . Neural Compression The goal of our method is to produce a small neural network \mbox{mlp}(\mathbf{x};\;\mathbf{wb}) and a set of latent textures \boldsymbol{l}_{i},i\in\left[0,...,N\right] such that: \displaystyle\mbox{mlp}(\left[\boldsymbol{l}_{0}^{(i,j)},\ldots,\boldsymbol{l}_{N}^{(i,j)}\right];\;\mathbf{wb})\simeq\mathcal{T}_{i,j} (2) where \mathbf{wb} are the weights and biases of mlp . The goal is that the cumulative size of mlp and \boldsymbol{l}_{i},i\in\left[0,...,N\right] is much smaller than the original texture set \mathcal{T} . For that, we train a hypernetwork net that takes as input a texture set \mathcal{T} and outputs both the latent features \boldsymbol{l}_{i} and the weights and biases \mathbf{wb} of the MLP: \displaystyle\left(\left[\boldsymbol{l}_{0},...\boldsymbol{l}_{N}\right],\mathbf{wb}\right)=\mbox{net}(\mathcal{T}) (3) 3.2 Neural Block Compression In this work, we use the neural block compression (NBC) of Weinreich et al. [ 29 ] as our neural compression method. Specifically, we use the BCF1 variant of Belcour and Benyoub [ 2 ] . This defines the latent features \boldsymbol{l}_{i} as a set of block-compressed textures (using BC1) and the decoder is a Multi-Layer Perceptron (MLP) with 1 hidden layer of N neurons (typically 16 , 32 , or 64 ). Hypernetwork \mathcal{T} t-Encoder \mathbf{t} Tokenizer 4\times 4 patches \boldsymbol{x} DiT Block DiT Block \times N_{B} Linear \mathbf{wb} BC1 Conv. \boldsymbol{l}_{0} \boldsymbol{l}_{1} \boldsymbol{l}_{2} \boldsymbol{l}_{3} t-Encoder \mathcal{T} \boldsymbol{t}_{0} Conv2D Cross Attention Q K V Conv2D Cross Attention Q K V