Distributed Multi-View Vision-Only RSSI Estimation
Jung-Beom Kim, Woongsup Lee · 2026
Read Distributed Multi-View Vision-Only RSSI Estimation by Jung-Beom Kim, Woongsup Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26738.txt.
Introduction
Kim and Lee propose MulViT-TF, a vision-only method for estimating signal strength from multi-view observations. Standard feedback estimation adds uplink overhead, suffers unstable measurements, and lags behind feedback loops. That lag blocks fast adaptation, while vision methods lack spatial diversity for camera-side blocked-view cases. Transformer fusion of multi-view observations gives wider coverage with no extra sensing inputs. In two indoor scenes, it cuts error by over a quarter and lifts 3dB error coverage by nearly 14 points over the best single-view rival.
Catalog record
| CREATOR | Jung-Beom Kim, Woongsup Lee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19493 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.26738
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Distributed Multi-View Vision-Only RSSI Estimation Jung-Beom Kim, Woongsup Lee Abstract Received Signal Strength Indicator (RSSI) estimation is essential for wireless link management, yet conventional feedback-based approaches incur uplink overhead, suffer from measurement instability, and are subject to inherent feedback loop latency, rendering proactive adaptation infeasible. Although vision-based approaches have been explored, existing methods remain limited by hardware dependency or auxiliary inputs, and lack the spatial diversity needed to resolve camera-side NLoS conditions. To address these limitations, we propose MulViT-TF, a vision-only RSSI estimation framework that exploits distributed multi-view observations through Transformer-based fusion, achieving complementary spatial coverage without any auxiliary sensing inputs. Experimental results across two distinct indoor scenes demonstrate that MulViT-TF achieves RMSE reductions of up to 26.3% and improves the 3dB error coverage by up to 13.8 percentage points over the best-performing single-view baseline, while using fewer FLOPs and parameters. I Introduction Received Signal Strength Indicator (RSSI) is a critical metric in wireless communication, playing a key role in various operations, including handover [ 1 ] , beam management [ 2 ] , and transmit power control for energy efficiency [ 3 ] . Conventionally, RSSI is obtained through receiver-side feedback; however, this approach consumes uplink resources, suffers from measurement instability due to multipath fading and shadowing, and inherently reports past channel conditions due to feedback loop latency, precluding proactive adaptation. Inspired by the concept of out-of-band information aided wireless communications [ 4 ] , visual environmental observations have emerged as a particularly promising source of spatial context [ 5 ] . Since wireless signal propagation is fundamentally shaped by the spatial configuration of the environment, including the positions of obstacles and persons, camera images provide a direct and passive means of capturing such information eliminating the need for receiver-side feedback. Leveraging visual environmental observations has thus shown promise not only for RSSI estimation and prediction [ 7 , 6 , 8 , 9 ] but also for a broader range of wireless tasks, including handover [ 10 ] , channel estimation and prediction [ 11 , 12 , 13 ] , beamforming [ 15 , 14 , 16 ] , and codebook design [ 17 ] . Existing studies on wireless communication leveraging visual information commonly suffer from several limitations. First, several approaches require additional inputs beyond camera images — such as depth images [ 9 , 12 , 15 ] , LiDAR [ 6 ] , GPS coordinates [ 7 , 16 ] , or explicit feedback signals [ 6 , 10 , 13 ] — which either limit deployability due to specialized hardware requirements or introduce continuous communication overhead and synchronization burden during inference. Second, prior works are either limited to single-view settings, which suffer from restricted Field-of-View (FoV) coverage and Non-Line-of-Sight (NLoS) conditions [ 7 , 8 , 9 , 11 , 15 ] ; mobile single-view approaches can partially mitigate these limitations, but still depend on a single instantaneous viewpoint during inference, leaving FoV and NLoS constraints fundamentally unresolved [ 6 , 17 ] . Furthermore, multi-view configurations partially address FoV limitations but still fail to resolve NLoS conditions, as centralized deployments lack sufficient spatial diversity [ 12 , 13 , 14 ] ; distributed deployments process each view independently without cross-view fusion, failing to effectively exploit spatially distributed cameras and thus reducing to multiple independent single-view systems [ 10 , 16 ] . Real-world indoor environments are increasingly equipped with distributed RGB camera-based IoT devices, such as CCTV systems and service robots, which naturally provide multi-view observations. Building upon this, leveraging distributed multi-view observations for wireless communication enables spatially diverse and complementary observations across NLoS regions that are otherwise restricted by limited FoV coverage and Line-of-Sight (LoS) dependency. In this letter, we propose MulViT-TF, a vision-only RSSI estimation framework that leverages spatially distributed RGB cameras, without requiring specialized hardware or auxiliary signal measurements. Independent ViT encoders process per-camera observations, and a Transformer-based fusion module captures cross-camera spatial correlations, enabling robust estimation by leveraging complementary viewpoints across spatially distributed cameras. The proposed framework is validated through real-world experiments using actual RGB camera and WiFi RSSI data collected across two distinct indoor scenes. Compared to the best-performing single-view baseline, MulViT-TF reduces RMSE by 26.3% and 16.6% and raises the proportion of estimates within a 3dB error bound from 70.7% to 84.5% and from 70.9% to 78.4% in Scene1 and Scene2, respectively, despite using fewer FLOPs and parameters. The source code and pretrained models are publicly available at https://github.com/Kim-JungBeom/distributed-multi-view-rssi-estimation , and the hardware implementation and time synchronization pipeline (Raspberry Pi and ESP32) at https://github.com/Kim-JungBeom/esp32-csi-raspi-cam-sync-collector . The remainder of this letter is organized as follows. Section II presents the proposed MulViT-TF framework. Section III provides the experimental results and analysis. Finally, Section IV concludes the letter. II Proposed Framework Fig. 1 : Overall architecture of MulViT-TF with distributed multi-view ViT and Transformer-based fusion. To leverage spatial information from multiple distributed viewpoints, we propose a multi-view framework for RSSI estimation in which per-camera ViT [ 18 ] encoders extract viewpoint-specific features that are subsequently fused by a Transformer [ 19 ] module. Fig. 1 illustrates the two-view case of MulViT-TF as an example, showing two independent ViT encoders and a Transformer-based fusion module. Each camera image is divided into N patches and embedded into a D -dimensional space. A learnable CLS token x^{cls} is prepended to the patch sequence to serve as a global representation of the input image, and positional embeddings are added as follows: \mathbf{z}_{0}=[x^{cls};x^{1}_{p}E;x^{2}_{p}E;\cdots;x^{N}_{p}E]+E_{pos}, (1) where x^{i}_{p}\in\mathbb{R}^{P^{2}\cdot C} is the i -th patch, P is the patch size, C is the number of input channels, E\in\mathbb{R}^{P^{2}C\times D} is the linear projection matrix, and E_{pos} is the positional embedding. The resulting sequence \mathbf{z}_{0} is passed through L Transformer blocks, where each block applies Multi-Head Attention (MHA) and a Feed-Forward Network (FFN) as follows: \mathbf{z}^{\prime}_{l}=\mathrm{MHA}(\mathrm{LN}(\mathbf{z}_{l-1}))+\mathbf{z}_{l-1}, (2) \mathbf{z}_{l}=\mathrm{FFN}(\mathrm{LN}(\mathbf{z}^{\prime}_{l}))+\mathbf{z}^{\prime}_{l}, (3) where \mathrm{LN}(\cdot) denotes Layer Normalization (LN). The final output \mathbf{z}_{L}\in\mathbb{R}^{(N+1)\times D} is the token matrix after L Transformer blocks. The token matrices from both cameras are then concatenated to form the fusion input: \mathbf{Z}=\begin{bmatrix}\mathbf{z}^{A}\\ \mathbf{z}^{B}\end{bmatrix}\in\mathbb{R}^{2(N+1)\times D}, (4) where \mathbf{z}^{A},\mathbf{z}^{B}\in\mathbb{R}^{(N+1)\times D} are the token matrices of cam A and cam B, respectively. The concatenated token matrix \mathbf{Z} is then processed by the fusion Transformer block, which adopts the same number of attention heads and embedding dimension D as the individual ViT encoders, but takes M(N+1) patches as input, scaling proportionally with the number of cameras M . The fusion block is stacked L^{\prime} times, yielding output \mathbf{Z}^{\prime} . By allowing each token to attend to all tokens from both cameras, the MHA enables the model to capture cross-camera spatial correlations that cannot be exploited by simple feature concatenation. The CLS token vectors are then extracted from \mathbf{Z}^{\prime} for each camera, \mathbf{v}^{A}_{cls}=\mathbf{Z}^{\prime}[0]\in\mathbb{R}^{D} and \mathbf{v}^{B}_{cls}=\mathbf{Z}^{\prime}[N+1]\in\mathbb{R}^{D} , and concatenated to form the fused feature vector: \mathbf{f}=[\mathbf{v}^{A}_{cls};\mathbf{v}^{B}_{cls}]\in\mathbb{R}^{2D}, (5) which is passed through a Multi-Layer Perceptron (MLP) head to produce the final RSSI estimate \hat{y}=\mathrm{MLP}(\mathbf{f}) . Each ViT encoder is initialized from the same checkpoint pre-trained on the Places365 dataset [ 20 ] using an image classification task following the DeiT training recipe [ 21 ] , and subsequently fine-tuned independently with unshared weights to allow each encoder to specialize to its respective camera viewpoint.