Goal-Oriented Source Coding using LDPC Codes for Compressed-Domain Image Classification

Ahcen Aliouat, Elsa Dupraz · 2025

Read Goal-Oriented Source Coding using LDPC Codes for Compressed-Domain Image Classification by Ahcen Aliouat, Elsa Dupraz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11954.txt.

Introduction

Ahcen Aliouat and Elsa Dupraz wrote this paper in two thousand twenty-five. It uses LDPC codes, built for fixing channel errors, as the squeeze code for images that a classifier will read straight, with no decoding first.

Goal-led communication sends data for a task, not for rebuild. Classic squeeze codes such as Huffman and arithmetic scramble the data's shape, which blocks direct learning. The pair trains a recurrent model to sort images from the LDPC-coded stream. On three image sets the coded stream beats the classic codes at the sort task, with a much smaller learner. The paper also probes why the code keeps shape and how its knobs sway the score.

Catalog record

CREATORAhcen Aliouat, Elsa Dupraz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-11954

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Goal-Oriented Source Coding using LDPC Codes for Compressed-Domain Image Classification Ahcen Aliouat, Elsa Dupraz Abstract In the emerging field of goal-oriented communications, the focus has shifted from reconstructing data to directly performing specific learning tasks, such as classification, segmentation, or pattern recognition, on the received coded data. In the commonly studied scenario of classification from compressed images, a key objective is to enable learning directly on entropy-coded data, thereby bypassing the computationally intensive step of data reconstruction. Conventional entropy-coding methods, such as Huffman and Arithmetic coding, are effective for compression but disrupt the data structure, making them less suitable for direct learning without decoding. This paper investigates the use of low-density parity-check (LDPC) codes—originally designed for channel coding—as an alternative entropy-coding approach. It is hypothesized that the structured nature of LDPC codes can be leveraged more effectively by deep learning models for tasks like classification. At the receiver side, gated recurrent unit (GRU) models are trained to perform image classification directly on LDPC-coded data. Experiments on datasets like MNIST, Fashion-MNIST, and CIFAR show that LDPC codes outperform Huffman and Arithmetic coding in classification tasks, while requiring significantly smaller learning models. Furthermore, the paper analyzes why LDPC codes preserve data structure more effectively than traditional entropy-coding techniques and explores the impact of key code parameters on classification performance. These results suggest that LDPC-based entropy coding offers an optimal balance between learning efficiency and model complexity, eliminating the need for prior decoding. I Introduction The paradigm of goal-oriented and semantic communications promises to be a key technology in sixth-generation (6G) telecommunication networks [ 1 , 2 ] . Unlike in traditional communication schemes focused on data reconstruction, this paradigm considers the application of specific tasks over transmitted data [ 3 , 4 , 5 , 6 , 7 ] . Within this framework, learning over compressed data has emerged as an important area of research driven by the increasing amount of visual data, such as images and videos, that must be stored, processed, and transmitted efficiently [ 8 , 9 ] . In the field of data compression, this emerging paradigm is now referred to as Image and Video Coding for Machines (VCM) [ 10 ] . VCM aims to develop source coding methods that support machine learning tasks such as classification or segmentation over compressed data. VCM is addressed in practice in the JPEG-AI initiative [ 11 ] , which aims to introduce compressed domain representations optimized for learning tasks. A key desired feature of VCM is to enable the application of learning tasks directly on compressed data without any prior decoding. Recent advances in learning over compressed data can be grouped into two main categories. The first one relies on end-to-end learning models that integrate deep neural networks into both the encoder and the decoder [ 12 , 13 , 14 , 15 , 16 , 17 ] . With these models, often built using autoencoders, the receiver is trained to perform the task directly on a learned latent space [ 18 , 19 ] . For instance, [ 20 ] introduces a model that classifies compressed images without prior decoding, while [ 21 , 22 ] employ entropy-regularized autoencoders for tasks such as anomaly detection. However, these methods are not compatible with widely adopted image compression standards such as JPEG. In addition, they are computationally heavy, and they do not generalize well over unseen datasets [ 23 ] . Fig. 1: Goal-Oriented Communication : this setup allows for both learning and reconstruction of compressed data. The second category considers applying the learning task over conventional compression standards. Notable examples include training convolutional neural networks (CNNs) directly on block-wise JPEG discrete cosine transform (DCT) coefficients [ 24 ] . Learning accuracy can be further improved by selecting specific DCT coefficients [ 25 ] , or employing vision transformers with feature patch embeddings [ 26 ] . However, these approaches often require partial decoding, such as reconstructing DCT coefficients, which adds complexity and latency. An important step toward bypassing partial decoding is introduced in [ 27 , 28 , 29 ] . Therein, established CNN-based models for image classification, such as ResNet and VGG, are trained directly on images compressed using standard Arithmetic and Huffman entropy coding techniques. Despite eliminating the need for decoding, these methods suffer from low classification accuracy due to the disruptive nature of conventional entropy coders on image structure, notably compromising spatial closeness between pixels. In the case of video coding, studies such as [ 30 , 31 , 32 ] have explored machine vision tasks on compressed videos. However, these approaches face similar limitations, including incompatibility with conventional video coding standards ( e.g. , MPEG, HEVC), reliance on large neural network models, or the need for partial decoding. In this paper, we propose a novel approach to image classification over compressed data that eliminates the need for any form of decoding. Building upon our earlier work [ 33 ] , we explore alternative entropy-coding techniques, specifically Low-Density Parity Check (LDPC) codes, a family of channel codes which have also demonstrated strong performance in noiseless entropy coding [ 34 ] , distributed source coding [ 35 ] , and 360-degree image compression [ 36 ] . Our rationale for examining this unconventional entropy-coding approach stems from the key idea that the intrinsic structure of LDPC codes may be used more effectively when training models for image classification. We consider standard JPEG compression, with its typical steps including DCT and quantization, while substituting the final entropic coder with LDPC codes applied over bitplanes. The latter step generates distinct codewords, termed syndromes, for each bitplane. At the receiver, we employ Recurrent Neural Networks (RNNs) [ 37 ] , specifically the Gated Recurrent Unit (GRU) model, to classify images based on their LDPC-coded bitplane syndromes. Our results demonstrate that this method achieves superior classification accuracy compared to existing approaches using Huffman or Arithmetic coding [ 28 , 29 ] . Furthermore, our methodology exhibits robust performance across various LDPC code parameters such as the code length, the rate, or the degree distribution. Additionally, our GRU-based model requires significantly fewer parameters than CNN-based models like VGG or ResNet, which shows its computational efficiency. Therefore, the proposed approach has the potential to streamline the learning pipeline by eliminating the need for decoding. It also offers a new perspective on the synergy between compression techniques and deep learning models. The main contributions of this paper can be summarized as follows: 1. We investigate two setups for image classification over compressed images. In the first setup, LDPC codes are applied directly on the bitplanes of the images. In the second setup, we integrate LDPC coding into the standard JPEG pipeline by retaining the DCT and quantization steps while replacing the traditional entropy encoder with an LDPC encoder. In both setups, we employ a GRU model trained for classification directly over the resulting LDPC-coded data, eliminating the need for prior decoding. 2. We demonstrate that GRU models trained on LDPC-coded data achieve up to 15\% higher classification accuracy compared to existing methods [ 28 , 29 ] that rely on Huffman or Arithmetic coding combined with CNN models such as VGG and ResNet. Furthermore, the

Read the complete text