Fast Sign Retrieval via Sub-band Convolution: An Elementary Extension of Binary Classification
Fuma Ito, Chihiro Tsutake, Keita Takahashi, Toshiaki Fujii · 2025
Read Fast Sign Retrieval via Sub-band Convolution: An Elementary Extension of Binary Classification by Fuma Ito, Chihiro Tsutake, Keita Takahashi, Toshiaki Fujii (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21632.txt.
Introduction
Fuma Ito and co-authors tackle, in a 2025 signal processing paper, a hidden cost in image compression: recovering the plus or minus sign of each frequency value from its size alone. Their scheme treats the puzzle as many small yes-no choices. Values are sorted into blocks by frequency band, stacking the image into a three-dimensional array.
A convolutional network then reads that array and calls each sign. Networks suit the job because they pull features from the stacked sizes with ease. In tests, the method recovered signs with high accuracy at a tiny fraction of the usual computing cost. Faster sign recovery could trim the work of decoding compressed images and video.
Catalog record
| CREATOR | Fuma Ito, Chihiro Tsutake, Keita Takahashi, Toshiaki Fujii |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-21632
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fast Sign Retrieval via Sub-band Convolution: An Elementary Extension of Binary Classification Fuma Ito, Chihiro Tsutake, Keita Takahashi, Toshiaki Fujii Abstract To efficiently compress the sign information of images, we address a sign retrieval problem for the block-wise discrete cosine transformation (DCT): reconstruction of the signs of DCT coefficients from their amplitudes. To this end, we propose a fast sign retrieval method on the basis of binary classification machine learning. We first introduce 3D representations of the amplitudes and signs, where we pack amplitudes/signs belonging to the same frequency band into a 2D slice, referred to as the sub-band block. We then retrieve the signs from the 3D amplitudes via binary classification, where each sign is regarded as a binary label. We implement a binary classification algorithm using convolutional neural networks, which are advantageous for efficiently extracting features in the 3D amplitudes. Experimental results demonstrate that our method achieves accurate sign retrieval with an overwhelmingly low computation cost. Keywords. Image coding, discrete cosine transform, sign information, phase retrieval, binary classification, deep neural network. 1 Introduction Compressing sign information in data is a challenging problem, and it plays a fundamental role in a wide range of research fields. In image coding, a large number of bits, approximately 20\% of the total bits, generated by an image encoder are allocated for the signs, as reported in [ 1 ] . Against this background, many previous works [ 2 , 3 , 4 , 5 ] have developed sign compression methods within the context of image coding, specifically focusing on compressing signs of discrete cosine transform (DCT) [ 6 ] coefficients. To reduce the bits for signs, in our earlier work [ 7 , 8 ] , we slightly modified a standardized image encoder and decoder, such as JPEG, as summarized in Fig. 1 . In the encoder, DCT coefficients of an image are separated into the signs, referred to as the true signs , and amplitudes; the latter is encoded in the first place. The encoder locally reconstructs the signs using a sign retrieval method whose algorithmic procedure is shared with the decoder. Instead of encoding the true signs, we encode residuals (XORs) between the true signs and retrieved ones. In the decoder, an image is decoded by following the reverse path of the encoding process, where the XORs between the residuals and retrieved signs perfectly reconstruct the true signs. If the signs are retrieved correctly to some extent, the residuals have many zeros but few ones; the residuals can be compressed using entropy coding methods, e.g., [ 9 , 10 , 11 , 12 ] . Therefore, the accuracy of the retrieved signs is crucial for successful sign compression. Figure 1 : Encoding process in [ 7 ] . (a) Previous methods [ 7 , 8 , 13 , 14 ] (b) Proposed Figure 2 : Sign retrieval methods. Various sign retrieval methods have been proposed, as summarized in Fig. 2(a) . To the best of our knowledge, all of the previous methods, without exception, are based on iterative optimization. For example, in [ 7 , 8 ] , an image and signed DCT coefficients are alternatively retrieved, and the signs of the retrieved coefficients are extracted. In [ 14 ] , the signs are regarded as variables and are optimized in an iterative manner. Previous methods have demonstrated the ability to accurately retrieve a large portion of the signs; for example, as reported in [ 8 ] , roughly 75 % of the total signs can be retrieved. However, these methods come at an excessive computation cost, primarily due to computing the DCT and the inverse DCT (IDCT) for each iteration. For example, as reported in [ 8 ] , it takes approximately 10 s to retrieve 256\times 256 signs, making sign retrieval impractical for real-time encoding and decoding scenarios. To accelerate the speed of sign retrieval, we propose a fast method without the DCT-IDCT iteration , which is summarized in Fig. 2(b) . Unlike previous methods, our method retrieves the signs in a direct manner, where sign retrieval is regarded as a variant of a binary classification problem. We first introduce 3D representations of the amplitudes and signs, where we pack amplitudes/signs belonging to the same frequency band into a 2D slice, referred to as the sub-band block [ 2 ] . We then retrieve the signs from the 3D amplitudes via binary classification, where each sign is regarded as a binary label. We implement a binary classification algorithm using convolutional neural networks (CNNs), which are advantageous for efficiently extracting features in the 3D amplitudes. Experimental results demonstrate that our method achieves accurate sign retrieval with an overwhelmingly low computation cost: only 0.93% of the execution time taken for previous methods. Limitations: Throughout this paper, we utilize constant-size blocks, as was done in JPEG [ 15 ] , which is not compatible with the variable-size ones in state-of-the-art image coding standards such as high-efficiency video coding (HEVC) [ 16 ] and versatile video coding (VVC) [ 17 ] . However, we believe that our promising results (discussed in Section 4 ) will contribute to further advancements in the field of image coding. 2 Related work 2.1 Sign retrieval The sign-retrieval-based method [ 7 ] , illustrated in Fig. 1 , is a seminal work in sign compression. Sign retrieval is known as a special instance of phase retrieval: namely, determining the signs \pm 1 is identical to retrieving their phases, 0 and \pi , on the Gaussian plane. Therefore, sign retrieval has typically been addressed on the basis of phase retrieval approaches. Tsutake et al. [ 7 ] proposed an \ell_{1} -norm minimization method, motivated by the prior works on phase retrieval [ 18 , 19 ] . Lin et al. [ 13 ] proposed a similar method based on total variation minimization. Suzuki et al. [ 8 ] proposed a CNN-based least squares method. Sidiropoulos et al. [ 14 ] proposed a quadratic programming method. All of these methods, without exception, retrieve the signs via iterative processes, as illustrated in Fig. 2(a) . For example, an image and signed DCT coefficients are alternatively computed in [ 7 , 8 ] , similar to the Gerchberg-Saxton method [ 20 ] and Fienup method [ 21 ] . The Frank-Wolfe method [ 22 ] , utilized in [ 14 ] , is another example, which is a variant of a gradient method and computes the DCT to determine the descent direction. Due to the iterative nature, the DCT and IDCT should be conducted in each iteration, leading to significant computation costs. Figure 3 : Sub-band blocks obtained from image, \times 8 enlarged. Larger amplitudes are represented by brighter luminance. Positive and negative signs are represented by white and black, respectively. Black regions in amplitudes and gray ones in signs correspond to non-significant coefficients. 2.2 Sign compression without sign retrieval Ponomarenko et al. [ 3 ] proposed a prediction-based method similar to the sign retrieval-based method [ 7 ] , where the amplitudes are encoded before sign compression. Their method predicts the signs block-by-block by solving an amplitude-constrained combinatorial problem, where the signs that minimize an objective function are searched. To