Towards Lightweight Hyperspectral Image Super-Resolution with Depthwise Separable Dilated Convolutional Network
Usman Muhammad 1 , Jorma Laaksonen 1 , and Lyudmila Mihaylova 2 · 2025
Read Towards Lightweight Hyperspectral Image Super-Resolution with Depthwise Separable Dilated Convolutional Network by Usman Muhammad 1 , Jorma Laaksonen 1 , and Lyudmila Mihaylova 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00374.txt.
Introduction
Usman Muhammad, Jorma Laaksonen, and Lyudmila Mihaylova sharpen hyperspectral images with a deliberately small neural network, in this 2025 paper. Such images record hundreds of wavelengths, but fine spatial detail is scarce, and training samples are few. Big models and fusion with ordinary photos, the usual fixes, are often impractical.
Borrowing the MobileNet recipe, their network uses depthwise separable convolutions, which split the filtering work cheaply, plus a fusion block with stretched filters that widens the view. A custom training loss guards both spatial detail and the spectral fingerprint of each pixel. On two public data sets the light model performs competitively with heavy rivals. The authors release the code, aiming at real deployments where computing power and data are limited.
Catalog record
| CREATOR | Usman Muhammad 1 , Jorma Laaksonen 1 , and Lyudmila Mihaylova 2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-00374
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Lightweight Hyperspectral Image Super-Resolution with Depthwise Separable Dilated Convolutional Network Usman Muhammad 1 , Jorma Laaksonen 1 , and Lyudmila Mihaylova 2 Abstract Deep neural networks have demonstrated highly competitive performance in super-resolution (SR) for natural images by learning mappings from low-resolution (LR) to high-resolution (HR) images. However, hyperspectral super-resolution remains an ill-posed problem due to the high spectral dimensionality of the data and the scarcity of available training samples. Moreover, existing methods often rely on large models with a high number of parameters or require the fusion with panchromatic or RGB images, both of which are often impractical in real-world scenarios. Inspired by the MobileNet architecture, we introduce a lightweight depthwise separable dilated convolutional network (DSDCN) to address the aforementioned challenges. Specifically, our model leverages multiple depthwise separable convolutions, similar to the MobileNet architecture, and further incorporates a dilated convolution fusion block to make the model more flexible for the extraction of both spatial and spectral features. In addition, we propose a custom loss function that combines mean squared error (MSE), an L2 norm regularization-based constraint, and a spectral angle-based loss, ensuring the preservation of both spectral and spatial details. The proposed model achieves very competitive performance on two publicly available hyperspectral datasets, making it well-suited for hyperspectral image super-resolution tasks. The source codes are publicly available at: https://github.com/Usman1021/lightweight . Fig. 1: A detailed overview of the proposed model. Shallow features are initially extracted using a lightweight separable convolutional layer with ReLU activation. The gray color represent depthwise convolutional blocks for deep feature extraction. The blue block denotes the dilated fusion module, capturing spatial and spectral features in parallel. The pink block performs upsampling to reconstruct the high-resolution output. I Introduction Hyperspectral imaging systems capture surface information across numerous spectral bands, providing richer spectral details than multispectral or natural images. This enables precise characterization of ground objects [ 1 , 2 , 3 , 4 ] . Moreover, the wide spectrum of information makes them extremely valuable for a variety of applications, including anomaly detection, surveillance, environmental monitoring, and satellite image scene classification [ 5 , 6 , 7 , 8 , 9 ] . However, hyperspectral images often suffer from low resolution due to environmental factors and sensor energy limitations [ 10 ] . Deep learning-based super-resolution (SR) methods have shown remarkable success, leveraging large models to reconstruct high-resolution images from degraded low-resolution inputs [ 11 , 12 ] . Nonetheless, due to advancements in deep learning models, the number of parameters in deep learning networks has increased significantly. As a result, numerous lightweight super-resolution models have gained significant attention in recent years [ 13 ] , focusing on reducing model parameters and computational complexity through various strategies. In particular, knowledge distillation [ 14 ] is widely used for model compression, in which a large model (the teacher network) is first trained on the original data and then used to guide the intermediate feature representations of a smaller model (the student network). For instance, Gao et al. [ 15 ] employ a lightweight student SR model to acquire knowledge from a deeper teacher SR network. Other model compression techniques, such as pruning [ 16 ] and low-rank factorization [ 17 ] , have also proven effective for developing super-resolution models. For instance, Zhan et al. [ 16 ] integrate neural architecture search with a layer-wise pruning strategy to develop efficient super-resolution model. Wu et al. [ 17 ] propose a convex regularizer for low-rank solutions, addressing unconstrained cases with proximal gradient and a custom PG-like algorithm. In addition, some quantization-based methods [ 18 , 19 ] leverage low-bit representations to enhance the inference speed of super-resolution models. However, these models often exhibit a significant performance gap compared to state-of-the-art super-resolution methods [ 20 ] . In order to reduce the size of the neural network, convolutional filters play a crucial role, and significant efforts have been made to maximize their potential. For instance, MobileNet [ 21 ] model introduces depthwise separable convolution, demonstrating great potential for network decomposition. Ahn et al. [ 22 ] employ group convolution instead of depthwise convolution to make model efficiency more adaptable. Kim et al. [ 23 ] propose a deeply recursive convolutional network, arguing that increasing recursion depth can enhance performance without introducing additional parameters for extra convolutions. Dilated convolution is another modified version of standard convolutions that utilizes a distinctive grid structure [ 24 ] . It has been widely adopted to expand the receptive field of kernels and enhance global information aggregation, leading to notable improvements over previous methods. However, the classification accuracy of these models may be compromised during compression, as a large number of image features are omitted due to the simplified convolution operations [ 25 ] . Our approach is inspired by MobileNet [ 21 ] , which reduces the number of parameters and computational costs by introducing the concept of depthwise separable convolution. In particular, we aim to combine depthwise separable convolutions with dilated convolutional fusion blocks [ 26 ] to develop a novel super-resolution model called the depthwise separable dilated convolution network (DSDCN) for hyperspectral images. Specifically, the dilated convolutional fusion block consists of two different types of convolutions: (1) dilated convolution (spatial branch) and (2) pointwise convolution (spectral branch). The outputs of the dilated convolution and pointwise convolution are then concatenated to effectively integrate spatial and spectral information. By doing so, we make our model suitable for hyperspectral super-resolution tasks while minimizing the compromise on model parameters compared to the MobileNet architecture. To further improve the performance of the proposed method, we employ a custom loss function that integrates mean squared error (MSE), an L2 regularization-based constraint, and a spectral angle-based loss to ensure high-fidelity reconstruction. In summary, our contributions are three-fold: 1. We present a novel lightweight DSDCN that combines depthwise separable convolutions, residual connections, and dilated convolutional fusion to enhance spatial resolution and preserve spectral integrity.. 2. A custom loss function is introduced, integrating mean squared error (MSE), an L2 regularization constraint, and a spectral angle-based loss to enhance high-fidelity reconstruction. 3. Experiments on two hyperspectral datasets are conducted across various resolution degradation-restoration scenarios (2 \times , 4 \times , and 8 \times downsampling), demonstrating competitive performance on both datasets. II Methodology Fig. 1 shows the band grouping and the three main components of the model: (1) depthwise separable convolutions with residual connections, (2) dilated convolution fusion, and (3) upsampling. We first define the band grouping along with other components. The following subsections detail this and the custom loss used in the model. II-A Band Grouping Since hyperspectral images consist of hundreds of spectral bands, processing all bands together can be computationally challenging and may introduce redundancy due to the high spectral correlation between bands. To mitigate this, we utilize band grouping [ 27 ] , which involves partitioning adjacent bands into overlapping groups for seamless integration with our proposed model. Specifically, hyperspectral bands are organized into overlapping subgroups by defining a fixed group size with a designated overlap, ensuring that consecutive subgroups share common bands. II-B Depthwise Separable Convolution Given a low-resolution hyperspectral image X\in\mathbb{R}^{H\times W\times B} , where H , W , and B denote the spatial height, width,