Evolutionary fine tuning of quantized convolution-based deep learning models

Marcin Pietron · 2026

Read Evolutionary fine tuning of quantized convolution-based deep learning models by Marcin Pietron (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05228.txt.

Introduction

Marcin Pietroń improves the accuracy of compressed neural networks by fine-tuning their quantisation choices with an evolution strategy. Quantisation shrinks models for phones and embedded devices by rounding weights to a few allowed values, usually the nearest ones. Pietroń argues that nearest rounding does not guarantee the best final accuracy for a pretrained network.

His method evolves the quantised model step by step, shifting a small percentage of weights to different allowed states in each round. With suitable operators and settings, accuracy improves quickly in his experiments. Results cover popular image architectures such as VGG and ResNet, for both classification and detection tasks, making the approach a practical post-compression polish.

Catalog record

CREATORMarcin Pietron
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.05228

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evolutionary fine tuning of quantized convolution-based deep learning models Marcin Pietron Abstract Deep learning models are the most efficient models in many machine learning tasks. The main disadvantage when using them in IoT, mobile devices, independent autonomous or real-time systems is their complexity and memory size. Therefore, much research has concentrated on compression techniques of deep learning architectures. One of the most popular technique is quantisation. In most of the works, the quantisation is done based on the nearest neighbour quantisation technique. This work focuses on improving the quantisation efficiency in pretrained and quantised models. This approach has the potential to improve the final accuracy of quantised models. The main postulate of the work is that final quantisation states of the network based on nearest neighbour rounding does not guarantee optimal accuracy. In the presented work, the neuroevolution strategy is used as an optimisation approach. The neuroevolution in each iteration changes the values of the small percentage of weights. It shifts theirs values to different quantisation states. The work shows that proposed neuroevolution with an appropriate set of operators and parameters can fast improve the accuracy of the quantised models. The results are presented for popular architectures such as VGG and Resnet for image classification and detection. Additionally, simulations were carried out for the autoencoder architecture. K eywords deep learning \cdot quantization \cdot neuroevolution \cdot fine tuning 1 Introduction Low bit quantisation is a process which enables the adaption of deep neural architectures in embedded systems and helps to decrease theirs computational complexity. There are many approaches to decreasing bit precision while minimising the drop in accuracy [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 ] . In [ 10 , 1 ] authors show how quantisation can decrease execution time by reducing the bit-width format of deep learning models. Many of these techniques are based on complex optimisation algorithms which are time consuming and very often difficult for parallelisation. Creating a fast and efficient quantisation method which can improve the model accuracy presents a significant challenge. The quantisation methods can be divided according to several factors. The first factor is the stage in which it is performed. It can be done during the training process or just after it. The second factor is the type of quantisation. It can be linear or nonlinear quantisation. In this work, the presented method is run on linearly quantised model. The input of the presented algorithm is the pretrained and quantised model. The main assumption of the solution is that the quantization of the input model is done by rounding to the nearest neighbour. This is the approach used in most quantization algorithms [ 1 , 2 , 11 , 3 , 9 ] . In presented approach, the novel fine tuning approach is performed. It mutates the weights by value which is multiplication of least significant bit. The small percentage of weights are mutated in each iteration. The neuroevolution process is run on each layer separately. In addition, the algorithm is equipped with a sensitivity analysis of the tested model layers. It iterates through the layers from the least to the most sensitive. This feature allows to stop the process if some user defined drop in accuracy is achieved. Another approach with a similar input assumption is the algorithm presented in the paper [ 12 ] . It also elaborates that an approximation to the nearest neighbor does not guarantee optimal performance of the model. The main goal of the work was to create a methodology that is scalable and able to quickly improve accuracy of quantised models. 2 Related work Quantisation is one of the most efficient techniques for the compression of deep learning models [ 1 , 2 ] . Common strategies include the quantisation of all coefficients in a single layer with a specified number of bits to represent the integer and fractional components [ 4 , 3 ] based on the range of values of the coefficients set. Another strategy is to represent coefficients and data by integer numbers with an appropriate scaling factor. Many quantisation approaches in the literature adopt linear [ 1 , 2 , 3 ] or non-linear approaches including clustering [ 5 ] . Quantisation can be performed during model training [ 2 ] or can be run on a pre-trained model [ 1 , 5 ] . Recently, several methods for low-bit representation have been designed [ 9 , 13 , 14 , 15 , 6 ] . Many of these can not be run without some significant degradation in accuracy. One known advantage of quantisation is the fact that it facilitates the adoption of deep neural networks in specialised hardware accelerators with limited arithmetic bit-width and memory space [ 16 , 10 ] . The authors in [ 17 ] show that a two-level neuroevolution strategy scheme can outperform human-designed models in some specific tasks, for example, language modelling and image classification. In [ 18 ] , a novel neuroevolutionary method for the optimisation of the architecture and hyperparameters of convolutional autoencoders is presented. In [ 19 ] , it is shown that a genetic algorithm could evolve autoencoders that can reproduce the data better than manually created autoencoders with more hidden units. The first approach of co-evolutionary neuroevolution-based multivariate anomaly detection system is presented in [ 20 ] . The authors show that proposed neuroevolutionary-based solution can outperform other human designed models on a well known benchmarks. These works show that neuroevolution can be very efficient method in deep learning architecture exploration. Fine-tuning is quite a popular technique for improving the accuracy of the pretrained models. The most popular technique is gradient-based fine-tuning [ 21 ] , [ 22 ] . The non-gradient approach is quite rare but can yield significant improvements as shown in [ 12 ] . In [ 12 ] the authors give the same input assumption is shown in this work. The authors in [ 12 ] try to find the near optimal state of the model which allows to have quantisation weight values which are not rounded to the nearest neighbour. In the presented work, a novel approach is proposed. The fine tuning based on neuroevolution is used for improving the accuracy of pretrained models. 3 Quantisation After network distillation by the pruning process, quantisation can be performed as the next step of reducing the complexity of the model. Quantisation is the procedure of constraining values from a continuous set or a more dense domain to a relatively discrete set. It is possible to define general mapping from a floating-point data x\in{\mathcal{S}} to a fixed-point q\in\mathcal{Q} using a function f_{\mathcal{Q}}:\mathcal{S}\rightarrow\mathcal{Q} as follows (assuming signed representation): q=f_{\mathcal{Q}}(x)=\mu+\sigma\cdot\text{round}(\sigma^{-1}\cdot(x-\mu)). (1) In our case, \mu=0 and \sigma=2^{-{\bf frac\_bits}} where: {\bf int\_bits}=\text{ceil}(\log_{2}(\max_{x\in{\mathcal{S}}}|x|)) (2) and {\bf frac\_bits}={\bf total\_bits}-{\bf int\_bits}-1. (3) The number of MAC operations in the layer is equal to P_{i}\cdot C_{i}\cdot D_{i}\cdot H_{i}\cdot W_{i} , where P_{i} is the number of neurons in an output feature map, C_{i} and D_{i} are numbers of input and output channels, and W_{i} and H_{i} are the width and the height of the filter. The memory footprint of the single layer is C_{i}\cdot D_{i}\cdot

Read the complete text