Gain-MLP: Improving HDR Gain Map Encoding via a Lightweight MLP

Trevor D. Canham SaiKiran Tedla Michael J. Murdoch Michael S. Brown · 2025

Read Gain-MLP: Improving HDR Gain Map Encoding via a Lightweight MLP by Trevor D. Canham SaiKiran Tedla Michael J. Murdoch Michael S. Brown (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11883.txt.

Introduction

Trevor Canham and colleagues encode HDR gain maps with a tiny neural network, in work from 2025. Most shared photos stay in standard range, yet many screens now show high range. Gain maps store the extra data inside standard files to rebuild the bright version on demand.

Usual tools shrink gain maps and squeeze them with photo codecs, which leaves flaws. A small multi layer perceptron instead learns the map from the base photo itself. The network needs a fixed ten kilobytes, with no size or setting changes per photo. Broad tests across encoding plans beat the best current methods on rebuild quality. One small model thus serves all photos at any scale.

Catalog record

CREATORTrevor D. Canham SaiKiran Tedla Michael J. Murdoch Michael S. Brown
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-11883

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gain-MLP: Improving HDR Gain Map Encoding via a Lightweight MLP Trevor D. Canham SaiKiran Tedla Michael J. Murdoch Michael S. Brown Abstract While most images shared on the web and social media platforms are encoded in standard dynamic range (SDR), many displays now can accommodate high dynamic range (HDR) content. Additionally, modern cameras can capture images in an HDR format but convert them to SDR to ensure maximum compatibility with existing workflows and legacy displays. To support both SDR and HDR, new encoding formats are emerging that store additional metadata in SDR images in the form of a gain map. When applied to the SDR image, the gain map recovers the HDR version of the image as needed. These gain maps, however, are typically down-sampled and encoded using standard image compression, such as JPEG and HEIC, which can result in unwanted artifacts. In this paper, we propose to use a lightweight multi-layer perceptron (MLP) network to encode the gain map. The MLP is optimized using the SDR image information as input and provides superior performance in terms of HDR reconstruction. Moreover, the MLP-based approach uses a fixed memory footprint (10 KB) and requires no additional adjustments to accommodate different image sizes or encoding parameters. We conduct extensive experiments on various MLP based HDR embedding strategies and demonstrate that our approach outperforms the current state-of-the-art. 1 Introduction Figure 1 : High-dynamic-range (HDR) reconstruction methods embed HDR metadata in a standard dynamic range (SDR) image file in the form of a per-channel gain map. Current approaches rely on 8-bit JPEG (or HEIF) to encode the gain map. We show that a lightweight MLP (10 KB) that uses the SDR image as input provides better reconstruction with minimum memory overhead. High dynamic range (HDR) and wide color gamut displays are now commonly found in smartphones and tablets. HDR displays enable contrast ratios that mimic real-world scenes with the ability to produce high-quality luminance gradations from 0.01 to 1000 cd/m 2 (nits), unlike the standard dynamic range (SDR) displays, which are limited to 1 to 100 cd/m 2 [ 34 ] . Additionally, cameras—particularly smartphone cameras—can now natively capture images in HDR format. However, to ensure compatibility with existing SDR displays, most images are still encoded in SDR formats, such as the BT.709 [ 33 ] (sRGB) standard used in 8-bit JPEG. The availability of better-quality displays has created a need for new, flexible encoding strategies that accommodate both legacy SDR devices and newer HDR displays. Major device manufacturers, software companies, and standards organizations are actively developing encoding recommendations for adaptive dynamic range formats. Examples include Apple’s Extended Dynamic Range (EDR), Android’s UltraHDR, Samsung’s SuperHDR, Adobe’s gain map specification, and the ISO 21496 recommendation for digital photography [ 19 ] , which allow for images to be appropriately adapted to varying brightness settings in real-time. These strategies all agree on storing pixel-wise gain maps that allow easy translation or interpolation between image versions intended for SDR and HDR display. Specifically, gain maps, calculated as a ratio between SDR and HDR pixel values, are quantized to 8-bits and compressed in a multiple image format (e.g., HEIF, JPEG-XL, etc.) to serve as metadata for the primary 8-bit SDR image. This gain map can be decompressed and used to reconstruct the HDR version of the image by multiplying it with the SDR image. This reliance on conventional compression, however, can lead to unwanted artifacts even at standard compression quality factors, while increasing the compression quality leads to increased memory size. Contribution To address the need for high-quality gain map encoding with minimal data overhead, we demonstrate how recent implicit neural representations can outperform traditional encoding techniques such as JPEG, HEIC, and JPEG-XL. Specifically, we introduce the novel application of multi-layer perceptron (MLP) networks utilizing color and positional coordinates (r,g,b,x,y) to achieve an exceptionally lightweight encoding of gain maps (10 KB) with minimal reconstruction artifacts. Furthermore, through extensive experimentation, we show that using an exponential residual encoding of the gain map enables the MLP network to outperform state-of-the-art methods across a wide range of bit rates. As part of this work, we extend an existing manual tone mapping dataset with alternative canonical tone mappers, allowing for a more thorough characterization of this applied problem space. Finally, we present a novel use of chromatic noise patterns, which exhibit characteristics of natural image statistics, for initializing implicit neural representation networks. 2 Related Work Related work is discussed for areas: (1) tone mapping, which is required to produce the SDR and HDR encoding; (2) inverse tone mapping; and (3) MLP-based neural implicit functions. Figure 2 : Scene radiance values must be compressed (i.e., tone-mapped) to fit a desired target range for display. This can be accomplished via tone mapping algorithms or manually by colorists. The common SDR image format, BT.709 [ 33 ] (i.e., sRGB), is a small gamut color space that can be sufficiently encoded using 8-bits per channel. The widely used HDR format, BT.2020 [ 32 ] is a wide gamut color space that recommends 10–12 bit encoding. This figure shows the relative size difference of these encodes in chromaticity space. Clipping and detail loss can occur when the encoding does not match the display’s capabilities (e.g., displaying an HDR image on an SDR display or vice versa). An effective means to properly convert between the two tone mapped encodings is needed. Note that this PDF is intended for viewing on an SDR/sRGB display. As a result, the HDR images shown in this paper will appear desaturated. 2.1 Tone Mapping An open problem since the advent of photography, tone mapping involves redistributing the luminance values of real scenes to render convincing images in the limited luminance range of printed, projected, or displayed images [ 15 ] . Fig. 2 shows an example where TM_{H} and TM_{S} represent tone mapping to HDR and SDR, respectively. Tone mapping is inherently a one-to-many problem as SDR display encoding necessitates enhancing some scene details at the expense of others. As a result, existing tone mapping methods achieve varying computational efficiency and qualitative advantages, often favoring certain scene types over others (e.g., indoor, landscape, portrait), but the ideal display rendering remains in the realm of artistic interpretation. In the traditional approaches to this problem [ 42 , 36 ] , all pixels are processed through the same non-linear mapping function, which is derived as a function of the global dynamic ranges of the source scene and target display. Later advancements included local operators [ 35 ] . Ou et al. [ 31 ] provide a recent review of tone mapping methods adapted for real-time hardware implementation, which details the dominant strategies employed in modern camera pipelines. While the gain map framework is agnostic to the tone mapping operator used to generate the SDR and HDR encoding, the choice of tone mapping algorithm directly influences the gain map, which can in turn impact compression [ 27 ] . In the experiments of Sec. 4 , we choose a representative method from three categories of tone mapping methods: exposure/filtering-based [ 35 ] , log-based [ 10 ] , histogram equalization based [ 23 ] . However, photographers and cinema colorists often prefer to accomplish the task

Read the complete text