VSANet: View-aware Sparse Attention Network for Light Field Image Denoising

Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray · 2026

Read VSANet: View-aware Sparse Attention Network for Light Field Image Denoising by Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24737.txt.

Introduction

Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, and Aurobinda Routray introduce VSANet, a network for cleaning noise from light field images. Light field cameras record a scene from many viewpoints at once, giving four dimensional data. Noise strikes each sub aperture image independently. Scene content, though, correlates strongly across views, and good denoising should exploit that. VSANet is built around a view aware sparse attention block.

The attention block treats the four dimensional feature map as one spatial angular token space. Locality sensitive hashing keeps attention sparse, so cross view aggregation stays at linear cost. A second block refines features across spatial, angular, and epipolar subspaces, stressing the most informative ones. The two blocks form a sequential attention refinement module at the network's core. Experiments show VSANet beating current state of the art light field denoising methods. Panda and colleagues credit the global cross view interactions for the gain.

Catalog record

CREATORGargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24737

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VSANet: View-aware Sparse Attention Network for Light Field Image Denoising Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray Abstract Light field (LF) image denoising is challenging due to the high-dimensional structure of LF data. While noise is independent across sub-aperture images, scene content exhibits strong cross-view correlations. We introduce VSANet, a view-aware sparse attention network for LF denoising. Specifically, we propose a view-aware sparse attention (VSA) block that represents the 4D LF feature map as a unified spatial-angular token space and performs cross-view aggregation via locality-sensitive hashing-based sparse attention. This enables global feature interactions with linear complexity, effectively exploiting LF correlations across views and spatial locations. In addition, we design a feature refinement (FR) block to emphasize informative features in spatial, angular, and epipolar subspaces. The VSA and FR blocks are integrated within a sequential attention refinement module, forming the core of VSANet. Experiments demonstrate VSANet outperforms state-of-the-art LF denoising methods. I Introduction Light field (LF) imaging captures both spatial and angular information of a scene by simultaneously recording light rays from multiple viewpoints [ 1 , 17 ] . The resulting four-dimensional (4D) representation, comprising S\!\times\!T sub-aperture images (SAIs) of spatial resolution H\!\times\!W , enables numerous applications including depth estimation [ 6 ] , refocusing [ 22 ] , and view synthesis [ 16 ] . However, LF acquisition systems are often affected by photon-limited noise, particularly under low-light or high-speed imaging conditions, which degrades image quality and subsequent LF processing tasks [ 5 ] . Consequently, LF denoising has become an essential preprocessing step in LF imaging pipelines [ 11 , 20 ] . Unlike single-image denoising, LF denoising should exploit the fact that noise is generally independent across views, whereas the underlying scene content exhibits strong spatial-angular correlations [ 2 , 5 , 3 , 8 ] . Traditional methods, such as LFBM5D [ 2 ] , leverage this property through collaborative filtering of similar patches collected from neighboring views. However, their dependence on hand-crafted priors limits their adaptability to complex LF structures. Recent deep learning (DL) approaches improve denoising performance by incorporating spatial-angular regularization or epipolar geometry-guided processing [ 9 , 15 , 21 , 19 ] . Despite their effectiveness, these methods rely on predefined geometric decompositions and are therefore limited in modeling long-range dependencies across the complete 4D LF. Moreover, transformer-based LF methods developed for other LF tasks commonly partition LF data into isolated 2D subspaces, preventing direct interaction among all spatial-angular positions [ 14 , 13 , 24 , 10 ] . Additional discussion of related LF methods is provided in the supplementary material. Fig. 1 : Architecture of proposed VSANet. Given the noisy LF image \mathbf{L}_{n} , VSANet generates the denoised image \mathbf{L}_{d} . To address these limitations, we propose VSANet, a view-aware sparse attention network for LF image denoising. The core of VSANet is a novel view-aware sparse attention (VSA) block that represents the entire 4D LF feature map as a unified token sequence, enabling global spatial-angular interaction within a single attention space. To maintain computational efficiency, locality-sensitive hashing (LSH) [ 4 , 12 ] is employed to group similar tokens into sparse attention buckets, facilitating implicit non-local aggregation across views with linear complexity. In addition, a feature refinement (FR) block is introduced to enhance discriminative representations in the spatial, angular, and epipolar subspaces. The VSA and FR blocks are integrated into a sequential extraction attention refinement (SEAR) module, which serves as the fundamental building block of VSANet. To the best of our knowledge, VSANet is the first LF framework that performs attention over the entire 4D LF representation. Extensive experiments on two benchmark LF datasets under three noise levels demonstrate that VSANet outperforms existing state-of-the-art (SOTA) methods. II Proposed Method II-A Problem Formulation A 4D LF image comprises S\!\times\!T SAIs, each with spatial resolution \!H\!\times\!W . We denote the noisy LF as \mathbf{L}_{n}\in\mathbb{R}^{S\times T\times H\times W\times 3} , where the additive noise is assumed to be independent and identically distributed (i.i.d.) across views and spatially uncorrelated. Although the noise is view-independent, the underlying scene content exhibits strong spatial-angular correlations governed by the LF geometry [ 5 ] . The objective of LF denoising is to estimate the denoised LF \mathbf{L}_{d}\in\mathbb{R}^{S\times T\times H\times W\times 3} from the noisy observation L_{n} . To this end, we propose VSANet that exploits both inter-view and intra-view correlations by performing efficient non-local aggregation over the entire 4D LF representation. II-B Network Architecture We propose VSANet, whose architecture is illustrated in Fig. 1 . The network exploits four complementary LF subspaces to model distinct spatial-angular dependencies: spatial subspace (SS, \mathbb{R}^{S\cdot T\times H\times W\times 3} ), angular subspace (AS, \mathbb{R}^{H\cdot W\times S\times T\times 3} ), horizontal epipolar subspace (EHS, \mathbb{R}^{S\cdot H\times T\times W\times 3} ), vertical epipolar subspace (EVS, \mathbb{R}^{T\cdot W\times S\times H\times 3} ). Given a noisy LF \mathbf{L}_{n} , we first perform shallow feature extraction in the SS using a convolution layer with feature dimension C , capturing local intra-view spatial information. The resulting feature is then reshaped back to the 4D LF representation using R4D operation and processed through a cascade of G stacked SEAR modules with a global residual connection. Finally, a convolution layer is applied in the SS, and the output is reshaped to 4D structure to obtain the denoised LF \mathbf{L}_{d} . The core of the network relies on the three sequential stages embedded within each SEAR module: sequential feature extraction (SFE), view-aware sparse attention, and feature refinement. In the SFE stage, F residual feature extraction (FE) blocks are cascaded to capture local LF structures. Each FE block contains two parallel branches. The spatial-angular branch operates in the SS and AS domains using convolution and activation layers to exploit spatial and angular correlations. The epipolar branch operates in the EHS and EVS domains to capture geometric consistency encoded in epipolar structures. The features extracted from the two branches are fused and subsequently passed to the VSA block for global cross-view non-local aggregation. The detailed formulation of the VSA block is presented in Section II-C . Following VSA, the FR block employs convolutional block attention modules (CBAMs) [ 23 ] in the SS, AS, EHS, and EVS domains. CBAMs apply channel and spatial attentions sequentially to enhance discriminative feature representations. The resulting features are concatenated and fused through a convolution layer before being forwarded to the next SEAR module. TABLE I : Performance comparison with the SOTA methods. Mean \pm SD of PSNR and SSIM are reported. We highlight the best performance in red color, and underline the second-best performance in blue color. Method (Publication) \sigma=10 \sigma=20 \sigma=50 # Params(K) / Runtime(s) STFLytro PSNR / SSIM EPFL PSNR / SSIM STFLytro PSNR / SSIM EPFL PSNR / SSIM STFLytro PSNR / SSIM EPFL PSNR / SSIM LFBM5D (MMSP’17) 39.61 \pm 1.37 / 0.9436 \pm 0.0444 37.74 \pm 0.92 / 0.9661 \pm 0.0126 34.23 \pm 1.40 / 0.8675 \pm 0.0783 33.28 \pm 1.13 / 0.9255 \pm 0.0293 25.45 \pm 1.12 / 0.6693 \pm 0.0949 25.46 \pm 1.22 / 0.7616 \pm 0.0701 - / 287 DRLF (TPAMI’22) 43.21 \pm 2.29 / 0.9811 \pm 0.0046 39.05 \pm 1.45 / 0.9800 \pm 0.0056 40.11 \pm 2.61 / 0.9677 \pm 0.0061 35.76 \pm 1.74 / 0.9643 \pm

Read the complete text