LoC-LIC: Low Complexity Learned Image Coding Using Hierarchical Feature Transforms

Ayman A. Ameen 1 2 , Thomas Richter 1 , and André Kaup 3 · 2025

Read LoC-LIC: Low Complexity Learned Image Coding Using Hierarchical Feature Transforms by Ayman A. Ameen 1 2 , Thomas Richter 1 , and André Kaup 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21778.txt.

Introduction

Ayman Ameen, Thomas Richter, and André Kaup cut the computing cost of learned image compression. Their twenty twenty-five paper presents a design called LoC-LIC. Learned codecs can beat classic formats on file size. Their heavy maths blocks use on modest devices, though.

The design extracts features in a hierarchy across scales. Wide early maps use few channels to stay cheap. Narrow deep maps can then afford many channels. That split keeps compression strength while slashing operations. Computing per pixel fell to a fraction of the earlier level. Phones and small devices could plausibly run such codecs. The work points toward learned compression that fits everyday hardware.

Catalog record

CREATORAyman A. Ameen 1 2 , Thomas Richter 1 , and André Kaup 3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-21778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LoC-LIC: Low Complexity Learned Image Coding Using Hierarchical Feature Transforms Ayman A. Ameen 1 2 , Thomas Richter 1 , and André Kaup 3 Abstract Current learned image compression models typically exhibit high complexity, which demands significant computational resources. To overcome these challenges, we propose an innovative approach that employs hierarchical feature extraction transforms to significantly reduce complexity while preserving bit rate reduction efficiency. Our novel architecture achieves this by using fewer channels for high spatial resolution inputs/feature maps. On the other hand, feature maps with a large number of channels have reduced spatial dimensions, thereby cutting down on computational load without sacrificing performance. This strategy effectively reduces the forward pass complexity from 1256 ​ kMAC/Pixel 1256\,\text{kMAC/Pixel} to just 270 ​ kMAC/Pixel 270\,\text{kMAC/Pixel} . As a result, the reduced complexity model can open the way for learned image compression models to operate efficiently across various devices and pave the way for the development of new architectures in image compression technology. I Introduction Recently, Learned image compression models have achieved significant gains in bit rate reduction; however, traditional image and video compression methods, such as JPEG 2000, JPEG XL, HEVC [ 1 ] and VVC [ 2 ] , still largely dominate the field. Despite the potential benefits of the learned compression methods, the adaptation of these methods has been slow. One main reason is their high complexity and considerable resource requirements. Most learned image compression architectures use transform analysis and synthesis with convolutional layers, maintaining a fixed number of channels and resizing the input for each (residual) layer. However, the total multiply-accumulate operations (MACs) per pixel increase with larger input sizes. Using a fixed number of channels results in higher MACs in initial layers without providing substantial benefits. To address this, we propose a hierarchical feature extraction approach with lower complexity by employing fewer channels for larger feature maps and more channels for smaller feature maps. Our novel approach utilizes hierarchical feature extraction transforms to map images from the pixel domain to the latent domain and vice versa, reducing both memory and computational complexity. The key features of our approach include: • Low complexity autoencoder through our novel hierarchical feature extraction, which has progressively deeper feature representations with a lower number of feature maps for larger sizes and higher features for smaller sizes, allowing reduction forward pass complexity from 1256 kMAC/Pixel to only 270 kMAC/Pixel. • Hyper-autoencoder with multi-reference entropy model maintaining competitive performance to the state-of-the-art models. • A large dataset that spans the large part of the image space manifold. Fig. 1 : Overall view of the proposed architecture with hierarchical feature encoder and decoder. II Related Works Traditional image compression algorithms, such as JPEG 2000, often lack the flexibility of non-linear mapping to input data through a learning process. To address these limitations, a novel learned image compression method using autoencoders has been developed. This approach involves training an autoencoder on large datasets of images or videos [ 3 , 4 , 5 , 6 ] . The key advantage of the learned image codec lies in the autoencoder’s capacity to map images into a low-entropy, high-dimensional latent space, and subsequently reconstruct them back into the image space in a lossy manner [ 7 , 8 ] . The learned image codec network architecture is typically composed of analysis and synthesis transform functions, which can be implemented using pure convolutional layers with a fixed number of channels N , [ 9 ] . Some architectures incorporate residual connections with convolutional layers as the base model [ 10 ] , while others utilize transformer-based layers [ 11 ] or combine attention mechanisms with convolutional layers for enhanced performance [ 12 ] . The goal is for the reconstructed image \hat{x} to closely resemble the original image x while minimizing the bit-rate R used for the latent representation. Generally, higher entropy results in lower distortion and vice versa. Therefore, optimization aims to balance distortion D(x,\hat{x}) with entropy measured in bitrate R (bits per pixel). A Lagrangian multiplier is employed to manage this trade-off between distortion and target bit-rate [ 13 , 12 ] . Quantization plays a critical role in bitrate reduction but introduces non-differentiability, hindering its direct integration with gradient-based optimization. To address this, continuous relaxations of the quantization operator, such as the straight-through estimator (STE), are widely adopted to enable differentiable approximations during training. An alternative strategy involves replacing deterministic quantization with stochastic rounding, which introduces non-biased gradients and has proven effective in recent compression frameworks [ 14 , 8 ] . Both approaches circumvent the discontinuity in backpropagation while preserving quantization benefits. Stochastic rounding can be easily implemented by adding uniform noise to the unquantized values. A hybrid approach that combines both straight-through estimation and stochastic rounding also exists [ 3 ] . Utilizing context information allows for more efficient data compression by reducing the bit-rate necessary for encoding. Context-based entropy models exploit surrounding or neighboring information to better predict and compress the current data. This strategy is particularly important in neural image compression, as it enables accurate bit-rate estimation while minimizing redundancy. To enhance compression efficiency, various context-based entropy models have been proposed. An autoregressive model was introduced to condition each pixel on previously decoded pixels for more effective context modeling [ 14 ] . Another approach is the checkerboard convolution, which divides the latent representation into anchor and non-anchor parts, using the anchor part to extract context for the non-anchor part [ 12 ] . Furthermore, channel-wise context models [ 15 ] , and channel-wise models with unevenly grouped contexts [ 5 ] , have been developed to exploit redundancy between channels. Recently, an attention-based architecture has been proposed to capture a diverse range of correlations within the latent representation [ 4 , 3 ] . Another promising approach for learned image compression involves using an overfitted neural network to represent image data as a continuous neural function instead of discrete pixel values. This neural function can be evaluated to reconstruct the RGB values of image pixels. Various efforts have been made to represent entire datasets, such as MNIST, using neural functions for resolution-agnostic representations [ 16 , 17 , 18 ] . A significant advantage of modeling images as neural functions is their resolution agnosticism: images are represented continuously and can be evaluated at any desired resolution. This approach assumes that image signals are inherently continuous. The COIN framework [ 19 ] introduced the concept of using overfitted learnable functions for image compression. It utilizes a straightforward multilayer perceptron (MLP) to map pixel coordinates to their respective RGB values by effectively using periodic activation functions [ 20 ] . While COIN’s performance was on par with JPEG compression, it was constrained by its inability to take advantage of pixel locality due to the inherently non-local characteristics of MLPs. This issue was addressed by employing a multi-resolution latent representation followed by a non-linear MLP [ 21 ] . COOL-CHIC [ 22 , 23 , 24 , 25 ] introduced an advanced overfitted learned image codec with reduced decoding complexity, which significantly improved compression efficiency compared to COIN. (a) (b) Fig. 2 : The compression efficiency vs complexity of different learned image compression models. The

Read the complete text