qAttCNN - Self Attention Mechanism for Video QoE Prediction in Encrypted Traffic
Michael Sidorov, Ofer Hadar · 2026
Read qAttCNN - Self Attention Mechanism for Video QoE Prediction in Encrypted Traffic by Michael Sidorov, Ofer Hadar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06862.txt.
Introduction
Michael Sidorov and co-authors posted a 2026 arXiv preprint. The preprint deals with qAttCNN - self attention mechanism for video QoE prediction in encrypted traffic. It came out on arXiv in 2026 as a PAPERS preprint. The rapid growth of multimedia consumption, driven by major advances in mobile devices since the mid-2000s.
Has led to widespread use of video conferencing applications (VCAs) such as Zoom and Google Meet. As well as instant messaging applications (IMAs) like WhatsApp and Telegram, which increasingly support video conferencing as a core feature. Readers in the field get a short, focused account of the problem and the steps the authors take.
Catalog record
| CREATOR | Michael Sidorov, Ofer Hadar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-06862
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
qAttCNN - Self Attention Mechanism for Video QoE Prediction in Encrypted Traffic Michael Sidorov, Ofer Hadar Abstract The rapid growth of multimedia consumption, driven by major advances in mobile devices since the mid-2000s, has led to widespread use of video conferencing applications (VCAs) such as Zoom and Google Meet, as well as instant messaging applications (IMAs) like WhatsApp and Telegram, which increasingly support video conferencing as a core feature. Many of these systems rely on the Web Real-Time Communication (WebRTC) protocol, enabling direct peer-to-peer media streaming without requiring a third-party server to relay data, reducing the latency and facilitating a real-time communication. Despite WebRTC’s potential, adverse network conditions can degrade streaming quality and consequently reduce users’ Quality of Experience (QoE). Maintaining high QoE therefore requires continuous monitoring and timely intervention when QoE begins to deteriorate. While content providers can often estimate QoE by directly comparing transmitted and received media, this task is significantly more challenging for internet service providers (ISPs). End-to-end encryption, commonly used by modern VCAs and IMAs, prevent ISPs from accessing the original media stream, leaving only Quality of Service (QoS) and routing information available. To address this limitation, we propose the QoE Attention Convolutional Neural Network (qAttCNN), a model that leverages packet size parameter of the traffic to infer two no-reference QoE metrics viz. BRISQUE and frames per second (FPS). We evaluate qAttCNN on a custom dataset collected from WhatsApp video calls and compare it against existing QoE models. Using mean absolute error percentage (MAEP), our approach achieves 2.14% error for BRISQUE and 7.39% for FPS prediction. Keywords — Quality of Experience in Video, Encrypted Traffic, Multi-headed Self-attention, Deep Learning, Machine Learning, Video Conferencing 1 Introduction Predicting the Quality of Data (QoD) delivered to the end user is a central challenge in modern communication systems, as it directly shapes users’ Quality of Experience (QoE). QoE, in turn, strongly influences whether users continue using (or abandon) a specific Content Provider (CP) or Internet Service Provider (ISP). The most direct way to assess QoD (and consequently QoE) is to compare, at the client side, the received content with the original data transmitted by the server. In practice, however, such end-to-end comparison is feasible primarily for CPs, since they control both ends of the delivery pipeline. For ISPs to obtain similar insight, they would need to intercept and analyze transferred packets, a practice historically known as Deep Packet Inspection (DPI), which was widely used during the 1990s and early 2000s. Since approximately 2010, the rapid growth of the internet and increased privacy concerns have made end-to-end encryption a fundamental requirement for most online communications. As a result, traditional DPI has become largely ineffective fo ISPs [ 19 ] , because encrypted traffic payloads cannot be interpreted without access to private keys. Consequently, ISPs must rely primarily on passive measurements of the network Quality of Service (QoS) [ 8 ] . Their objective is to infer QoD from observed QoS metrics, and ultimately predict users’ QoE. This inference is inherently challenging due to the complex and highly non-linear relationship between QoS and QoE, motivating extensive research over the past decades. For high-volume applications such as video streaming, a data-driven approach particularly natural. Accordingly, numerous machine learning (ML) and deep learning (DL) methods have been proposed to infer QoE under encrypted traffic constraints, achieving progressively improved accuracy. The remainder of this paper is organized as follows. Section 2 surveys recent studies on QoE prediction and highlights works using attention mechanisms to improve performance across domains. Section 3 analyzes the dataset used in our experiments. Section 4 presents the proposed method, and Section 5 describes the experiment setup employed during models’ performance evaluation. Section 6 reports the experimental results, and finally, Section 7 concludes the paper, discusses limitations, and outlines directions for future research. 2 Related Work The domain of QoE analysis has been extensively studied over the years. Bentaleb et al. [ 2 ] introduced a Recursive Least Squares (RLS) model to predict the instantaneous available network bandwidth. Their goal was to improve QoE by optimizing the data chunk size within the Dynamic Adaptive Streaming over HTTP (DASH) protocol. Through their method, the authors reported improved achieved bitrates and a reduction in stall events during video streaming sessions. Numerous studies have proposed Neural Network (NN) and Deep Learning (DL)–based methods for QoE prediction under the constraint of encrypted traffic. For example, Vega et al. [ 33 ] introduced an unsupervised DL model based on a Restricted Boltzmann Machine (RBM) [ 10 ] for real-time prediction of various No-Reference (NR) QoE metrics in video streaming. Their model estimates indicators such as video jerkiness, image blockiness, and multiple blur and noise related features. Although they report an accuracy exceeding 85%, this performance is achieved only for a specific type of video content, limiting the generalization of their approach. Raca et al. [ 23 ] explored two classical ML methods, viz. Support Vector Machines (SVM) and Random Forests (RF), alongside a DL approach using Long Short-Term Memory (LSTM) networks to predict throughput in cellular networks. Their experiments demonstrated that increasing the granularity of the input data improved performance, reflected in a reduced absolute error percentage between predicted and actual throughput. A Reinforcement Learning (RL)–based framework was proposed by Mao et al. [ 18 ] , which computes three QoE metrics using predicted values of bitrate, available bandwidth, and buffer level in video sessions. Their results show that the RL model significantly outperforms traditional Adaptive Bitrate (ABR) mechanisms for QoE optimization. The self-attention mechanism has found broad applicability across domains ranging from genetics to municipal operations. Following the breakthrough success of Transformers in Natural Language Processing (NLP) [ 34 ] and their subsequent adoption in computer vision tasks [ 7 ] , considerable research has focused on incorporating attention, particularly multi-head self-attention, into various deep learning architectures (e.g., CNNs, RNNs, LSTMs). These hybrid models often achieve substantial performance gains by enhancing the expressiveness of the most relevant features while suppressing those with minimal impact on the predicted variable. Building on similar ideas, Zhao et al. [ 38 ] proposed an attention-enhanced model augmented with a Sparrow Search Algorithm (SSA) to mitigate accuracy degradation caused by outliers. Their approach was applied to electricity price prediction in energy markets and demonstrated improved robustness and forecasting performance. Liu et al. [ 15 ] developed a hybrid architecture combining CNN, attention (ATT), and LSTM modules to estimate carbon emission levels using features spanning the economic, societal, energy, and environmental domains. Their experiments demonstrated clear performance improvements attributable to the inclusion of the attention mechanism. Another study, combining CNN, LSTM, and attention modules, was conducted by Liu et al. [ 14 ] , who proposed a method for total electron content (TEC) prediction in the ionosphere, i.e., the electrically charged layer of the atmosphere. Their model, termed Att-CNN-BiLSTM, extends earlier work by Tang et al. [ 32 ] by replacing the previously used unidirectional LSTM with a bidirectional LSTM (BiLSTM). In their approach, the CNN extracts positional features, while the BiLSTM captures temporal dependencies. These complementary representations are then adaptively weighted by an attention mechanism, resulting in accurate predictions of TEC values. Yi et al. [ 36 ] proposed a composite