Bridging the Training-Deployment Gap: Gated Encoding and Multi-Scale Refinement for Efficient Quantization-Aware Image Enhancement

Dat To-Thanh, Nghia Nguyen-Trong, Hoang Vo, Hieu Bui-Minh, Tinh-Anh Nguyen-Nhu · 2026

Read Bridging the Training-Deployment Gap: Gated Encoding and Multi-Scale Refinement for Efficient Quantization-Aware Image Enhancement by Dat To-Thanh, Nghia Nguyen-Trong, Hoang Vo, Hieu Bui-Minh, Tinh-Anh Nguyen-Nhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21743.txt.

Introduction

To-Thanh and four colleagues tackle a familiar mobile problem: photo enhancers that look good in training lose quality when squeezed into low-precision form for phones. Their model uses gated encoder blocks and multi-scale refinement to keep fine detail. Quantization-aware training then simulates low precision during training itself, so the network adapts instead of degrading after conversion. The result keeps high-fidelity output with low compute cost on standard phones.

Catalog record

CREATORDat To-Thanh, Nghia Nguyen-Trong, Hoang Vo, Hieu Bui-Minh, Tinh-Anh Nguyen-Nhu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36405
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21743

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging the Training-Deployment Gap: Gated Encoding and Multi-Scale Refinement for Efficient Quantization-Aware Image Enhancement Dat To-Thanh, Nghia Nguyen-Trong, Hoang Vo, Hieu Bui-Minh, Tinh-Anh Nguyen-Nhu Abstract Image enhancement models for mobile devices often struggle to balance high output quality with the fast processing speeds required by mobile hardware. While recent deep learning models can enhance low-quality mobile photos into high-quality images, their performance is often degraded when converted to lower-precision formats for actual use on mobile phones. To address this training-deployment mismatch, we propose an efficient image enhancement model designed specifically for mobile deployment. Our approach uses a hierarchical network architecture with gated encoder blocks and multiscale refinement to preserve fine-grained visual features. Moreover, we incorporate Quantization-Aware Training (QAT) to simulate the effects of low-precision representation during the training process. This allows the network to adapt and prevents the typical drop in quality seen with standard post-training quantization (PTQ). Experimental results demonstrate that the proposed method produces high-fidelity visual output while maintaining the low computational overhead needed for practical use on standard mobile devices. The code will be available at https://github.com/GenAI4E/QATIE.git . 1 Introduction Recent advances in deep learning and computer vision have led to remarkable performance across a wide range of tasks Vu et al. 2025 ; Nguyen et al. 2025a , including image retrieval Nguyen et al. 2026 ; Nguyen et al. 2025b , visual question answering Nguyen-Nhu et al. 2025 ; Nguyen et al. 2024 . Besides, smartphone photography has become the dominant imaging modality for billions of users, yet a substantial perceptual gap remains between images captured by low-end mobile devices and those produced by Digital Single-Lens Reflex (DSLR) cameras. This gap is rooted in hardware limitations, including small sensors and compact optics, which collectively degrade signal-to-noise ratio, dynamic range, color fidelity, and sharpness. To address these limitations, recent advances in deep learning have introduced Deep Image Signal Processing (Deep ISP) models that learn end-to-end mappings from low-quality mobile images to high-quality DSLR outputs, effectively replacing or augmenting traditional ISP pipelines through data-driven optimization Ignatov et al. 2017 ; Schwartz et al. 2019 . In this work, we consider the image enhancement setting, where paired images are synchronously captured using an iPhone 3GS and a Canon 70D DSLR, enabling supervised learning of a direct smartphone-to-DSLR transformation Ignatov et al. 2017 . This task requires the joint correction of noise, blur, color distortions, and tone inconsistencies in a single forward pass. Prior works Ignatov et al. 2017 ; Schwartz et al. 2019 ; Chen et al. 2018 ; Johnson et al. 2016 have demonstrated that combining pixel-wise, perceptual, and adversarial losses is critical for achieving visually plausible results in this setting. However, these approaches are typically developed and evaluated under full-precision assumptions, and existing quantization techniques do not adequately account for the distributional characteristics of Deep ISP features under real-world mobile deployment Jacob et al. 2018 ; Krishnamoorthi 2018 . Some challenge reports Ignatov et al. 2018c ; Ignatov et al. 2025 explicitly emphasize the strict runtime constraints on mobile hardware. In particular, models are required to process FullHD images on-device using mobile inference frameworks such as TensorFlow Lite Jacob et al. 2018 , while maintaining high perceptual quality and avoiding visible artifacts. This introduces a fundamental training–deployment mismatch : models are optimized in continuous full/half-precision domains (FP32/FP16), but executed under 8-bit quantized settings (i.e., INT8), where numerical precision and dynamic range are severely constrained. As a result, models that perform well during training often degrade significantly after deployment, especially when evaluated under realistic latency constraints. This mismatch is particularly critical for high-fidelity pixel-level tasks such as image enhancement and super-resolution Lim et al. 2017 . Unlike classification tasks, where feature representations are relatively robust to quantization noise, Deep ISP models exhibit highly sensitive activation distributions that are long-tailed, asymmetric, and strongly input-dependent Tu et al. 2023 ; Nagel et al. 2019 . Moreover, activation outliers are often closely tied to color and luminance information, such that improper quantization can lead to perceptually severe artifacts, including color shifts, banding, and texture distortions. These properties suggest that existing quantization pipelines, when applied after full-precision training, are insufficient to maintain perceptual fidelity in Deep ISP. Moreover, existing QAT approaches are primarily designed for high-level vision tasks and do not explicitly model the color-sensitive and heavy-tailed activation distributions that are critical for pixel-level image reconstruction. To address this challenge, we advocate a deployment-consistent optimization paradigm: optimize the model that will be deployed . Specifically, we introduce Quantization-Aware Training (QAT) into the training framework, as shown in Figure 2 , allowing the model to learn representations that are inherently robust to quantization effects. Although QAT has been widely studied in high-level vision tasks, its application to Deep ISP has been largely unexplored in previous work Ignatov et al. 2017 ; Hui et al. 2018 ; Schwartz et al. 2019 . By simulating quantization during training via fake quantization operators and gradient approximations Jacob et al. 2018 ; Krishnamoorthi 2018 ; Bengio et al. 2013a , QAT aligns the training objective with the deployment environment, mitigating the degradation introduced by 8-bit inference. Our contributions are summarized as follows: • We identify the specific challenges of model quantization in pixel-level image enhancement, highlighting the causes of performance degradation during mobile deployment. • We introduce a training framework that incorporates Quantization-Aware Training (QAT) specifically designed to minimize this degradation and ensure deployment-consistent optimization. • We demonstrate the high scalability of our proposed models, showing that they maintain an effective balance between computational efficiency and perceptual output quality. • We validate that our model exhibits low computational overhead and efficient resource management, ensuring feasibility for deployment on standard commercial mobile devices. 2 Related Works 2.1 Deep ISP and Photo Enhancement Recent advances in deep learning have enabled Deep Image Signal Processing (Deep ISP) , where end-to-end models directly learn mappings from raw or degraded inputs to high-quality sRGB outputs, effectively replacing traditional hand-crafted ISP pipelines Heide et al. 2014 ; Ignatov et al. 2017 ; Brooks et al. 2019 ; Phan-Nguyen et al. 2025 . The DPED benchmark is a seminal work in this direction, introducing paired smartphone–DSLR data and demonstrating the importance of perceptual loss formulations for realistic enhancement Ignatov et al. 2017 . Subsequent work, such as DeepISP, further explores end-to-end ISP learning from RAW inputs Schwartz et al. 2019 , while Learning to See in the Dark highlights the effectiveness of deep models under extreme low-light conditions Chen et al. 2018 . In parallel, image enhancement methods have explored diverse formulations to improve perceptual quality and robustness. Zero-DCE formulates enhancement as pixel-wise curve estimation without paired supervision Guo et al. 2020 , while MIRNet leverages multi-scale feature fusion to capture complex spatial dependencies for restoration Zamir et al. 2020 . Weakly supervised approaches such as WESPE relax alignment requirements but often introduce trade-offs in pixel-level fidelity and color consistency Ignatov et al. 2018a . However, these methods are predominantly developed and evaluated under full-precision settings, and do not explicitly consider deployment constraints or robustness under quantized inference, limiting their applicability in real-world mobile scenarios. 2.2 Efficient Mobile Vision and Quantization Quantization has emerged as a key technique for efficient inference on edge devices

Read the complete text