Vision Transformer Based User Equipment Positioning
Parshwa Shah 1 , Dhaval K. Patel 2 , Brijesh Soni 3 , Miguel López-Benítez 4 , Siddhartan Govindasamy 5 · 2025
Read Vision Transformer Based User Equipment Positioning by Parshwa Shah 1 , Dhaval K. Patel 2 , Brijesh Soni 3 , Miguel López-Benítez 4 , Siddhartan Govindasamy 5 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08549.txt.
Introduction
Parshwa Shah and four co-authors tackle the problem of locating user devices in wireless networks from channel measurements alone. Standard deep learning models spread attention evenly over the input and handle single snapshots of channel data poorly, so the team builds a vision transformer tuned for this task.
Their model focuses on the angle delay profile drawn from the channel state information matrix. Tested on the DeepMIMO and ViWi ray-tracing datasets, it errs by about half a meter indoors. Outdoor errors are larger, near thirteen meters in one dataset and about three meters in a blockage scenario in the other. The authors report accuracy about thirty-eight percent better than leading prior schemes.
Catalog record
| CREATOR | Parshwa Shah 1 , Dhaval K. Patel 2 , Brijesh Soni 3 , Miguel López-Benítez 4 , Siddhartan Govindasamy 5 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08549
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Vision Transformer Based User Equipment Positioning Parshwa Shah 1 , Dhaval K. Patel 2 , Brijesh Soni 3 , Miguel López-Benítez 4 , Siddhartan Govindasamy 5 Abstract Recently, Deep Learning (DL) techniques have been used for User Equipment (UE) positioning. However, the key shortcomings of such models is that: i) they weigh the same attention to the entire input; ii) they are not well suited for the non-sequential data e.g., when only instantaneous Channel State Information (CSI) is available. In this context, we propose an attention-based Vision Transformer (ViT) architecture that focuses on the Angle Delay Profile (ADP) from CSI matrix. Our approach, validated on the ‘DeepMIMO’ and ‘ViWi’ ray-tracing datasets, achieves an Root Mean Squared Error (RMSE) of 0.55m indoors, 13.59m outdoors in DeepMIMO, and 3.45m in ViWi’s outdoor blockage scenario. The proposed scheme outperforms state-of-the-art schemes by ∼ \sim 38%. It also performs substantially better than other approaches that we have considered in terms of the distribution of error distance. I Introduction Positioning is a very demanding use-cases of mobile systems [ 12 ] , especially for 5G and beyond . The demand for accurate positioning has grown due to the rise in popularity of IoT devices and industrial automation. 5G New Radio (NR) 3GPP Rel-16 [ 1 ] introduced positioning/localization based features for upcoming wireless network models and has been evolving since then . The goal is to enhance network-based positioning, locating User Equipment (UE) via wireless signals for increased accuracy compared to global positioning system alone. 5G localization’s accuracy and versatility find applications in various fields, from optimizing traffic and indoor navigation to vehicle tracking. Existing methods are typically algorithmic or data-driven, with algorithm-driven approaches often relying on Time of Arrival (ToA) and Angle of Arrival (AoA) from multiple Base Stations (BS) for triangulation [ 11 , 17 , 13 ] . There are also other methods which work on the basis of the channel matrix such as [ 14 ] . Such methods are limited when there is no Line of Sight (LoS) path available, making accurate position prediction challenging. Due to the rapid advancement of learning-based signal processing techniques and the excellent learning ability of data-driven approaches, some works have utilized machine learning/deep learning (ML/DL) techniques for positioning and localization [ 16 , 15 ] . For instance, the work in [ 22 ] investigated how Convolutional Neural Network (CNN) models can improve accuracy of network-based positioning algorithms. It shows that the Deep-CNN (DCNN) model improves localization accuracy conditioned on the availability of sufficient data points. Another similar work is [ 20 ] , where a DCNN approach is considered. This work introduced special pre-processing as well as multiple deep layers with varying kernel sizes. The authors in [ 10 ] present a recurrent neural network-based predictive model for LoS and Non-Line of Sight (NLoS) scenarios. Similarly, Received Signal Strength Indicator (RSSI) based UE positioning using Long Short Term Memory (LSTM) architecture is proposed in [ 4 ] . Similarly, the authors in [ 24 ] showcase work utilizing simple PCA and Bi-LSTM / GRU models for UE positioning. However, these works have considered multiple frame inputs where the knowledge of the previous location/history is available. In scenarios like, device-to-device and sidelink based system, where the temporal data is not available, such approaches may not render high prediction accuracy. Additionally, the above architectures extract the spatial/temporal features and weighs the same attention to the entire input data. Recently, the attention mechanism has received significant interest from the research community, wherein the key idea is to concentrate only on the relevant information in the data. This is a promising approach, especially for localization and/or positioning problems. There are very few works in the literature that have explored the attention mechanism for localization. For instance, the work in [ 18 ] utilizes CNN-LSTM for the attention mechanism in spatiotemporal data. However, it uses sequence-to-sequence distinctive attention mechanism which converts time-series input to more interpretable encoded sequences. Such models are not well suited for the non-sequential data; for instance when the UE is static/quasi-static and/or in the blockage scenario during which only instantaneous Channel State Information (CSI) is available. There have been recent advances in the attention mechanism as proven by the transformer models [ 21 ] . Moreover, it is observed that Vision Transformer (ViT) [ 9 ] is excellent at retrieving spatial features from images. This suggests the idea that if we can map CSI to new embeddings in which spatial features can help predict UE location then we can utilize ViT to significantly improve prediction accuracy. In this context, we compute the Angle Delay Profile (ADP) which approximates power value of signal against AoA and ToA. Motivated by this idea, we utilize multi-headed self-attention mechanism of ViT for the UE localization. To the best of the authors’ knowledge, UE positioning using a transformer-based attention mechanism, although a promising approach, has not yet been reported in the literature. Fig. 1: Vision Transformer architecture to process ADP inputs The key contribution of this work is a transformer 1 1 1 From now on, we interchangeably use ViT with transformer model-based novel predictive positioning scheme. Transformer models use positional embeddings, which allow them to learn not only the features in an ADP image but also their spatial locations. This allows the model to learn the angle and delay relation in the image. To validate the robustness of the proposed approach, the model is trained and tested on ray tracing-based DeepMIMO [ 6 ] , and ViWi [ 8 ] datasets. ViWi has a blockage scenario that contains locations where UE has no LoS path with its BS. This type of condition is very likely to happen in urban scenarios. In the DeepMIMO outdoor scenario proposed model achieves 13.59m Root Mean Squared Error (RMSE) and for the indoor scenario, the model performs with RMSE of 0.55m. In the ViWi scenario, the model has an RMSE of 3.45m . We also compare the Cumulative Distribution Function (CDF) of the prediction error using our approach with other methodologies and find out that it substantially out-performs existing methodologies. The rest of this paper is organized as follows. First, Section II describes the system model and preliminaries of the ViT in the context of this work. The proposed scheme, dataset construction, and methodology are comprehensively discussed in Section III. Section IV describes the experimental results. Finally, Section V draws the conclusions from this work. ((a)) Channel Response Matrix ( H ) From I (near) to IV (far) shows the blur in overall matrix ((b)) Enhanced Fingerprint used to train model named ADP removes the blur and creates ADP Fig. 2: Visualization of H and ADP II System Model and Preliminaries II-A System Model We assume a UE with a single antenna, served by a single BS 2 2 2 For indoor scenarios, we refer to the access point as BS. . Similar to [ 10 ] and [ 5 ] , we assume that BS has a Uniform Linear Array (ULA) antenna and half wavelength spacing between antennas. The BS has N_{t} antennas which employ Orthogonal Frequency Division Multiplexing (OFDM) with N_{c} sub-carriers. Furthermore, we assume the channel model with C clusters