3D Fourier-based Global Feature Extraction for Hyperspectral Image Classification

Muhammad Ahmad · 2026

Read 3D Fourier-based Global Feature Extraction for Hyperspectral Image Classification by Muhammad Ahmad (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16426.txt.

Introduction

Ahmad classifies hyperspectral images with a hybrid Fourier network. Transformer models scale badly because attention grows quadratically. Older Fourier methods use flat 2D transforms and miss band-to-band links. His HGFNet mixes local 3D convolutions with global frequency filtering. Three Fourier transforms cover the spectral axis, the spatial plane, and both jointly. That setup models long-range links and cuts noise. An adaptive focal loss fights the sharp class imbalance in such data.

Catalog record

CREATORMuhammad Ahmad
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37806
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16426

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

3D Fourier-based Global Feature Extraction for Hyperspectral Image Classification Muhammad Ahmad Abstract Hyperspectral image classification (HSIC) has been significantly advanced by deep learning methods that exploit rich spatial-spectral correlations. However, existing approaches still face fundamental limitations: transformer-based models suffer from poor scalability due to the quadratic complexity of self-attention, while recent Fourier transform-based methods typically rely on 2D spatial FFTs and largely ignore critical inter-band spectral dependencies inherent to hyperspectral data. To address these challenges, we propose Hybrid GFNet (HGFNet), a novel architecture that integrates localized 3D convolutional feature extraction with frequency-domain global filtering via GFNet-style blocks for efficient and robust spatial-spectral representation learning. HGFNet introduces three complementary frequency transforms tailored to hyperspectral imagery: Spectral Fourier Transform (a 1D FFT along the spectral axis), Spatial Fourier Transform (a 2D FFT over spatial dimensions), and Spatial-Spatial Fourier Transform (a 3D FFT jointly over spectral and spatial dimensions), enabling comprehensive and high-dimensional frequency modeling. The 3D convolutional layers capture fine-grained local spatial-spectral structures, while the Fourier-based global filtering modules efficiently model long-range dependencies and suppress noise. To further mitigate the severe class imbalance commonly observed in HSIC, HGFNet incorporates an Adaptive Focal Loss (AFL) that dynamically adjusts class-wise focusing and weighting, improving discrimination for underrepresented classes. Additionally, an adaptive fully connected classification head enhances flexibility and generalization across datasets with varying class distributions. Extensive experiments on benchmark hyperspectral datasets demonstrate that HGFNet consistently outperforms state-of-the-art methods in terms of accuracy, effectively overcoming the limitations of prior approaches. The source code will be made publicly available on GitHub. I Introduction Hyperspectral Image (HSI) Classification (HSIC) is a challenging problem in remote sensing and Earth observation, aiming to assign a semantic land-cover/material label to each pixel by exploiting hundreds of contiguous spectral bands [ 40 , 1 ] . Unlike RGB imagery, hyperspectral measurements provide dense reflectance signatures that enable fine-grained discrimination among materials with subtle spectral differences [ 33 , 7 ] , which is essential for precision agriculture [ 20 , 32 ] , environmental monitoring [ 29 , 31 ] , mineral exploration [ 25 , 10 ] , and land-use/land-cover mapping [ 26 ] . However, HSIC remains challenging due to the intrinsic properties of hyperspectral data: extremely high dimensionality, strong inter-band correlation (spectral redundancy), and complex spatial heterogeneity [ 9 , 16 ] . The “curse of dimensionality” manifests in two coupled ways: (i) the effective sample complexity increases rapidly with the feature dimension, and (ii) redundant and noisy bands can dominate learning when labeled samples are limited, which increases the risk of overfitting and unstable decision boundaries [ 3 ] . In practical scenarios, the difficulty is further amplified by scarce and imbalanced annotations, since ground truth acquisition requires expensive field surveys and expert interpretation [ 11 , 14 ] , while classes often exhibit high inter-class spectral similarity (e.g., vegetation species) and large intra-class variability induced by illumination [ 4 , 34 ] , atmospheric effects, phenological stages, and mixed pixels [ 39 , 6 ] . Deep learning has substantially advanced HSIC by learning hierarchical spatial-spectral features directly from data [ 8 ] , with 3D convolutional neural networks (3D CNNs) and transformers emerging as two dominant paradigms [ 38 ] . 3D CNNs are effective because their kernels jointly convolve across spatial neighborhoods and spectral bands, thereby encoding local spectral gradients, local texture, and neighborhood context in a unified manner [ 28 ] . This local inductive bias is particularly valuable for hyperspectral imagery, where small spatial structures and local mixing patterns can disambiguate classes with similar spectra [ 12 ] . Nevertheless, 3D CNNs can be computationally expensive and memory intensive, and their locality limits the receptive field unless deeper stacks or larger kernels are used, which often increases the number of parameters and exacerbates the dependence on larger labeled datasets for stable generalization [ 17 ] . Transformers, in contrast, are attractive due to their ability to capture long-range dependencies through self-attention, enabling global context aggregation that improves spatial consistency and class boundary delineation [ 30 , 5 , 13 ] . Recent hybrid designs attempt to reduce transformer overhead while retaining global modeling capacity, such as MSC-3DLT, which combines multi-scale convolutional extraction with lightweight transformer modules [ 36 ] , and SSFBF, which couples CNN and transformer components via dynamic routing attention to enhance high-resolution spatial-spectral semantics [ 35 ] . Despite these advances, transformer-based HSIC pipelines can still be constrained by the quadratic attention cost and by the difficulty of scaling to high-dimensional spectral inputs without careful tokenization and dimensionality reduction. Fig. 1 : HSI cubes are first divided into 3D patches to preserve local and contextual dependencies. Three consecutive 3D Convolutional layers extract hierarchical features, while the GFNet layer enhances representations by transforming spatial-spectral data into the frequency domain. After normalization, a 3D FFT decomposes features into frequency components, where learnable global filters emphasize relevant information and suppress noise. The transformed features undergo regularization and pass through a Multilayer perceptron (MLP) block with AFL to handle class imbalances. A residual connection ensures stable gradient flow and feature preservation before dynamic fully connected layers generate the final class probabilities. Beyond these mainstream approaches, several works incorporate specialized mechanisms to balance local detail and global context. For example, SClusterFormer introduces spatial-spectral cluster attention and deformable convolutions to adaptively model fine-grained structures, though its robustness can be affected by dataset-dependent spectral resolution, sensor noise, and the stability of clustering under limited annotations [ 18 ] . MCTGCL integrates CNNs, transformers, and graph contrastive learning for planetary HSIC, offering strong accuracy with reduced complexity, but challenges such as domain shift, limited labels, and generalization across acquisition conditions remain significant [ 37 ] . These limitations motivate exploring alternative representations and operators that can provide efficient global interactions with strong inductive priors suited to hyperspectral data. Frequency-domain learning has recently emerged as a promising direction to complement and replace attention-based global modeling. In particular, Fourier transform-based operators can provide global receptive fields with favorable computational complexity by leveraging the Fast Fourier Transform (FFT), typically \mathcal{O}(n\log n) , compared to the \mathcal{O}(n^{2}) complexity of full self-attention over n tokens [ 2 ] . The Global Frequency Network (GFNet) exploits FFT-based global filtering to enhance robustness to noise and distortions by modulating representations in the frequency domain [ 22 , 27 ] . However, when directly applied to hyperspectral imagery, many existing frequency-based designs perform FFT primarily over spatial dimensions and treat spectral channels as static features, which can underutilize the most discriminative aspect of hyperspectral data: inter-band spectral correlation and wavelength-dependent frequency structure. Moreover, hyperspectral datasets commonly exhibit severe class imbalance, where minority classes have very few labeled pixels and are easily dominated during optimization; despite its practical importance, relatively few HSIC architectures incorporate principled loss designs that explicitly adapt training dynamics to such imbalance. To address these challenges, this work proposes Hybrid GFNet (HGFNet), a novel architecture that couples a lightweight 3D convolutional stem for localized spatial-spectral feature extraction with GFNet-inspired frequency-domain global filtering to jointly learn local and global representations. The design is motivated by a key observation: hyperspectral discrimination requires both (i) local neighborhood evidence to resolve mixed pixels and boundary ambiguity, and

Read the complete text