Optimal Weighted Convolution for Classification and Denosing

2025

Read Optimal Weighted Convolution for Classification and Denosing (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24558.txt.

Introduction

Simone Cammarasana and Giuseppe Patanè add a new twist to image networks in 2025. Standard convolution treats all nearby pixels in the same way. Their weighted version folds in a density map that gives each nearby pixel a weight based on its place. The change keeps the same count of learned values and fits current network designs.

The team tests the method on image sorting and on cleaning noisy images. Well known networks gain clear score boosts with the weighted step in place. Run times stay close to the standard step thanks to precomputed maps. The idea also extends to three dimensional scans and to signals over time.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24558

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimal Weighted Convolution for Classification and Denosing Abstract We introduce a novel weighted convolution operator that enhances traditional convolutional neural networks (CNNs) by integrating a spatial density function into the convolution operator. This extension enables the network to differentially weight neighbouring pixels based on their relative position to the reference pixel, improving spatial characterisation and feature extraction. The proposed operator maintains the same number of trainable parameters and is fully compatible with existing CNN architectures. Although developed for 2D image data, the framework is generalisable to signals on regular grids of arbitrary dimensions, such as 3D volumetric data or 1D time series. We propose an efficient implementation of the weighted convolution by pre-computing the density function and achieving execution times comparable to standard convolution layers. We evaluate our method on two deep learning tasks: image classification using the CIFAR-100 dataset [ KH+09 ] and image denoising using the DIV2K dataset [ AT17 ] . Experimental results with state-of-the-art classification (e.g., VGG [ SZ15 ] , ResNet [ HZRS16 ] ) and denoising (e.g., DnCNN [ ZZC+17 ] , NAFNet [ CCZS22 ] ) methods show that the weighted convolution improves performance with respect to standard convolution across different quantitative metrics. For example, VGG achieves an accuracy of 66.94 % 66.94\% with weighted convolution versus 56.89 % 56.89\% with standard convolution on the classification problem, while DnCNN improves the PSNR value from 20.17 to 22.63 on the denoising problem. All models were trained on the CINECA Leonardo cluster to reduce the execution time and improve the tuning of the density function values. The PyTorch implementation of the weighted convolution is publicly available at: https://github.com/cammarasana123/weightedConvolution2.0 . Optimal Weighted Convolution for Classification and Denosing Simone Cammarasana 1 1 1 Simone Cammarasana CNR-IMATI, Via De Marini 6, Genova, Italy [email protected] , Giuseppe Patanè 2 2 2 Giuseppe Patanè CNR-IMATI, Via De Marini 6, Genova, Italy Keywords: Convolution, Density function, Denoising, Classification, Deep learning 1 Introduction Deep learning (DL) is a subset of artificial intelligence methodologies that focuses on the processing and analysis of signals defined on regular grids (e.g., 2D images). DL accounts for large datasets and hierarchical feature representations, including multiple linear and non-linear layers. These transformations map the input signal into higher-level abstractions, reducing the number of parameters required to represent the signal. DL is widespread in image-based applications, such as robotics [ SAD23 ] , autonomous navigation [ KBF+21 ] , computational chemistry [ GHV17 ] , and healthcare [ CNP22 ] . The convolution operator is applied to 2D images to extract both geometrical and texture features and characterise spatial hierarchies and local patterns, leading to a class of DL models named convolutional neural networks (CNNs). In standard CNNs, convolution operations equally scale neighbouring pixels of a reference pixel, relying on optimised kernel weights to determine feature relevance. This assumption implies that all pixels in a local region contribute equally to the convolution, independent of their relative position (Sect. 2 ). We propose a novel weighted convolution operator that enhances the standard convolutional framework by incorporating a spatial density function, allowing the network to account for the relative position of each pixel and improving spatial characterisation and feature extraction. Although our method is focused on 2D image data, the weighted convolution framework is general to any signal defined on regular grids, such as 3D volumetric data (e.g., medical imaging), 1D time-series signals, or spatio-temporal sequences. As a significant advantage, the proposed weighted convolution does not increase the number of trainable parameters with respect to standard convolution, and is fully compatibility with existing convolutional neural network frameworks (see Sect. 3 ). We propose an efficient implementation of the weighted convolution with a pre-computation of the density function and the update of the kernel weights with the density function at every iteration, reducing the computational cost with an execution time comparable to the standard convolution layers. We analyse the application of our weighted convolution to state-of-the-art deep learning problems and architectures. In particular, we discuss two different problems: (i) a classification problem with the CIFAR-100, a dataset of 60K images with 32\times 32 resolution and 100 classes; (ii) a denoising problem with the DIV2K, a dataset of 1,000 high-resolution RGB images. For the problem (i), we compare five different state-of-the art classification methods: the deep residual learning for image recognition (ResNet), very deep convolutional networks for large-scale image recognition (VGG), network in network (NIN), gated multi layer perceptron (gMLP), and gated attention coding for spiking neural networks (GAC-SNN), discussing the classification results through quantitative metrics: accuracy, F1-score, and confusion matrix. A sixth method, i.e., EfficientNet, has been tested without achieving convergence with both standard and weighted convolution. For the problem (ii), we compare three different state-of-the-art denoising methods: the residual learning of deep CNN (DnCNN), nonlinear activation free network (NAFNET), and cascaded gaze network (CGNet), discussing the denoising results through quantitative metrics: peak signal-to-noise ratio (PSNR), structural similarity (SSIM), feature-based similarity (FSIM), normalised mean squared error (MSE), and universal image quality (UIQ). For both problems (i) and (ii), we compare the standard convolution with our weighted convolution within the learning architectures. In particular, we manage the density function values as hyperparameters of the networks, keeping the same number of training parameters (Sect. 4 ). Our weighted convolution improves the results of standard convolution for all the tested methods. In the classification problem, the VGG has an accuracy of 66.94\% with the weighted convolution, compared to an accuracy of 56.89\% with the standard convolution. In the denoising problem, DnCNN has a PSNR value of 22.63 with the weighted convolution, compared to a PSNR value of 20.17 with the standard convolution. For the denoising problem, we also compare the results with different kernel sizes, showing that a 5\times 5 kernel and a density function with a small contribution of the external elements have better results than a 3\times 3 kernel. For the classification problem, we apply only 3\times 3 kernel size, due to the small image resolution. We have performed our tests on the CINECA Leonardo cluster. The parallelisation and high-performance of the hardware allow us to tune the density function to improve the accuracy of the weighted convolution and the results of the classification and denoising. We underline that we have implemented the public versions of all the learning methods for both classification and denoising. For a fair comparison, we have defined the same hyper-parametrisation in terms of weights initialisation, optimisation criteria, and data augmentation. For this reason, the accuracy results slightly differ with respect to the results mentioned in the respective papers. Finally, we discuss conclusions and future work (Sect. 5 ) as the extension to 3D kernels and applicative contexts (e.g., biomedical data). The PyTorch class for the weighted convolution is available at https://github.com/cammarasana123/weightedConvolution2.0 . 2 Related work Convolutional neural network The weighted convolutional neural network ensemble [ FA14 ] combines output probabilities from multiple CNNs, assigning greater influence to models with higher accuracy. The constrained convolution layer [ AAA22 ] restricts the number of trainable weights within each kernel by pruning less significant connections during training. DropOut [ WZZ+13 ] reduces overfitting through a regularisation technique where each unit in a fully connected layer is randomly deactivated with a probability

Read the complete text