Input Resolution Downsizing as a Compression Technique for Vision Deep Learning Systems
1 st Jérémy Morlier, 2 nd Mathieu Léonardon, 3 rd Vincent Gripon · 2025
Read Input Resolution Downsizing as a Compression Technique for Vision Deep Learning Systems by 1 st Jérémy Morlier, 2 nd Mathieu Léonardon, 3 rd Vincent Gripon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03749.txt.
Introduction
Jeremy Morlier, Mathieu Leonardon, and Vincent Gripon tested a plain trick in 2025 to shrink vision models: feed them smaller images. Most ways to lighten a model cut its parts, round its numbers, or distill it into a small twin. Input size had been little explored as a shrink tool. The team cut image size step by step and watched the effect on two tasks, sorting and scene labeling, and on two model families.
On standard test sets, smaller inputs kept scores near the top while cutting memory and compute by a large share. The authors say the trick can sit beside the classic tools rather than swap them out. They frame it as a sound new path for teams that must run vision on tight gear.
Catalog record
| CREATOR | 1 st Jérémy Morlier, 2 nd Mathieu Léonardon, 3 rd Vincent Gripon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-03749
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Input Resolution Downsizing as a Compression Technique for Vision Deep Learning Systems 1 st Jérémy Morlier, 2 nd Mathieu Léonardon, 3 rd Vincent Gripon Abstract Model compression is a critical area of research in deep learning, in particular in vision, driven by the need to lighten models memory or computational footprints. While numerous methods for model compression have been proposed, most focus on pruning, quantization, or knowledge distillation. In this work, we delve into an under-explored avenue: reducing the resolution of the input image as a complementary approach to other types of compression. By systematically investigating the impact of input resolution reduction, on both tasks of classification and semantic segmentation, and on convnets and transformer-based architectures, we demonstrate that this strategy provides an interesting alternative for model compression. Our experimental results on standard benchmarks highlight the potential of this method, achieving competitive performance while significantly reducing computational and memory requirements. This study establishes input resolution reduction as a viable and promising direction in the broader landscape of model compression techniques for vision applications. I Introduction Reducing the size of deep learning models has become a critical area of research, particularly in computer vision, where large models often require significant memory and computational resources. As deep learning continues to find applications in resource-constrained environments, such as mobile devices and embedded systems, efficient model compression techniques are essential for maintaining model usability without compromising performance. Reducing the size of models is also beneficial in the context of data centers. Over the years, a variety of model compression methods have been proposed in the literature, including pruning [ 1 , 2 ] , quantization [ 3 , 4 ] , knowledge distillation [ 5 ] , and low-rank approximation [ 6 ] . 10 100 10 100 Required Memory (MBs) Computational Cost (GFLOPs) 1 Model Scaling MS Accuracy RS 1 \simeq 79\% 1 1 \simeq 74\% 1 1 \simeq 65\% 1 Fig. 1 : Benefits of adding resolution scaling to the more classical model scaling, when performing classification on ImageNet using a ResNet-50 with a batch size of 8. The dotted line represents the achievable trade-offs when using model scaling only. Three circle points correspond to various model scaling (MS), achieving different accuracy levels. The square points of the same colors correspond to adding input resolution scaling (RS), achieving a better trade-off without sacrificing accuracy. In this context, changing the resolution of the input images is a relatively less used model compression technique that can be used post-training. Intuitively, reducing the resolution of input images can significantly lower computational cost and memory needs, because it directly impacts the size of feature maps in convolutional-based architectures. It is also a simple way to reduce the size of the sequence of tokens in transformer-based architectures. Interestingly, the trade-offs between performance degradation and computational savings in this approach have not been thoroughly investigated, especially across diverse tasks and architectures. In this work, we delve into the potential of input resolution reduction as an additional strategy for model compression to moderately reduce the computational cost and memory needs. We investigate this method across two fundamental problems in computer vision: image classification and semantic segmentation, and consider two prominent types of architectures: convolutional neural networks (e.g., ResNets [ 7 ] ) and transformer-based architectures (e.g., Vision Transformers [ dosovitskiyImageWorth16x162021 ] ). Our problem statement centers on whether input resolution reduction can serve as a viable alternative to model scaling strategies. Specifically, we aim to evaluate its effectiveness in striking a balance between computational or memory efficiency and task performance, offering insights into whether it complements or even outperforms conventional model compression methods. We make several contributions in this study: • We propose mechanisms for modifying input resolution both before and after the embedding process in ResNets and for reducing the length of the sequence of tokens in Vision Transformers, • We systematically examine the potential of input resolution reduction as a standalone or complementary compression technique with model scaling or quantization, • We present experiments demonstrating that resolution reduction consistently provides a better trade-off between performance and computational cost than established alternatives on multiple problems and architectures. Our findings underscore the importance of considering input resolution as a practical dimension in the broader landscape of model compression for computer vision. II Related Work Several works have explored the use of resolution as a scaling factor in deep learning architectures, often distinguishing their approaches based on their application to CNNs or ViTs. For CNNs, image resolution is a critical factor influencing the design and performance of deep learning models across various tasks with sizes ranging from 224x224 for image classification to 1024x1024 for semantic segmentation. Resolution as a scaling factor for compression was introduced by the MobileNet architectures [ 8 ] as a new method for reducing the computational cost of deep learning architectures. EfficientNet [ 9 ] proposed a neural architecture search method combining width, depth and resolution on an efficient MobileNetv2 based [ 10 ] architecture. Similarly, [ 11 ] introduces compound scaling laws on EfficientNet and RegNet architectures in order to easily scale up these architectures. In [ 12 , 13 ] , the authors highlight the different impacts the resolution of the input image can have on the design, the training and the evaluation of a convolutional deep learning system. For ViTs, exploiting patch size has been applied as a scale up technique as finer patch size allows to improve performance on fine-grained tasks. Swin transformers [ 14 ] , PiT [ 15 ] employ smaller patch size of 8x8 pixels in order to catch finer-grained details at the beggining of the network and pool them at a later stage in the architecture to reduce the increased computational cost of using smaller patch size. VITAR [ 16 ] and UniVit [ 17 ] both focus on enhancing positional embeddings to improve transformer performance at varying input resolutions. VITAR introduces a fuzzy positional encoding combined with a token-merging mechanism to adapt input sequences for neural network processing. UniVit employs augmented positional embeddings to enhance generalization across resolutions and resizes image batches to random dimensions within the range \left[128,320\right] with 32-pixel increments during training. This resolution generalization strategy has also been applied in DinoV2 [ 18 ] , an image foundation model. Our work shows that resolution should not only be viewed as a training-time augmentation factor or as part of a compound scaling rule, but also as a practical and effective standalone compression dimension for both CNNs and ViTs. III Methodology III-A Motivation As mentioned in the introduction, the question of compressing – meant as reducing the number of required computations and memory – a deep learning architecture has known a large number of contributions in the past decade [ 5 , 19 , 20 , 21 , 22 ] . Popular compression techniques such as pruning, quantization, distillation or model scaling are widely studied in order to compress architectures for inference. Introduced in [ 9 ] for CNNs, model scaling was initially thought of as a combination of width, depth and input resolution. Outside the context of EfficientNets, it is common to act upon both width and depth when designing an architecture for a given