QoE Optimization for Semantic Self-Correcting Video Transmission in Multi-UAV Networks

Xuyang Chen, Chong Huang, Daquan Feng · 2025

Read QoE Optimization for Semantic Self-Correcting Video Transmission in Multi-UAV Networks by Xuyang Chen, Chong Huang, Daquan Feng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06717.txt.

Introduction

Xuyang Chen and co-authors present a way to stream video from groups of drones without wasting scarce wireless capacity. Their 2025 paper notes that live drone video serves urgent tasks such as watch duty, rescue work, and checks on the land. Weak links, delays, and lost data make that hard.

Their system turns each frame into a compact set of meaning-based codes, then sends only the share the link can bear. At the far end, a vision model rebuilds lost codes by reading how frames link in space and time. A learning scheme then splits resources and picks rates to lift the viewer's experience. Tests show the system beats standard video tools on coding gains and use of the link.

Catalog record

CREATORXuyang Chen, Chong Huang, Daquan Feng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06717

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

QoE Optimization for Semantic Self-Correcting Video Transmission in Multi-UAV Networks Thanks: Xuyang Chen and Daquan Feng are with the College of Electronics and Information Engineering, Shenzhen University, Shenzhen 518060, China (email: [email protected], [email protected]). Thanks: Chong Huang is with 5GIC & 6GIC, Institute for Communication Systems, University of Surrey, Guildford, GU2 7XH, UK (e-mail: [email protected]). Thanks: Yao Sun is with the James Watt School of Engineering, University of Glasgow, Glasgow, G12 8QQ, UK (email: [email protected]). Thanks: Lei Luo is with the School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China, and also with the School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 610051, China (e-mail: [email protected]). Thanks: Xiang-Gen Xia is with the Department of Electrical and Computer Engineering, University of Delaware, Newark, DE 19716, USA (e-mail: [email protected]) Xuyang Chen, Chong Huang, Daquan Feng Abstract Real-time unmanned aerial vehicle (UAV) video streaming is essential for time-sensitive applications, including remote surveillance, emergency response, and environmental monitoring. However, it faces challenges such as limited bandwidth, latency fluctuations, and high packet loss. To address these issues, we propose a novel semantic self-correcting video transmission framework with ultra-fine bitrate granularity (SSCV-G). In SSCV-G, video frames are encoded into a compact semantic codebook space, and the transmitter adaptively sends a subset of semantic indices based on bandwidth availability, enabling fine-grained bitrate control for improved bandwidth efficiency. At the receiver, a spatio-temporal vision transformer (ST-ViT) performs multi-frame joint decoding to reconstruct dropped semantic indices by modeling intra- and inter-frame dependencies. To further improve performance under dynamic network conditions, we integrate a multi-user proximal policy optimization (MUPPO) reinforcement learning scheme that jointly optimizes communication resource allocation and semantic bitrate selection to maximize user Quality of Experience (QoE). Extensive experiments demonstrate that the proposed SSCV-G significantly outperforms state-of-the-art video codecs in coding efficiency, bandwidth adaptability, and packet loss robustness. Moreover, the proposed MUPPO-based QoE optimization consistently surpasses existing benchmarks. I Introduction UAV networks are critical components of integrated air-space-ground communication systems, which are considered key enablers of 6G technologies [ 1 ] . With decreasing costs and improved endurance, UAVs have been widely adopted in diverse applications such as geological exploration, scene modeling, forest fire monitoring, and border surveillance. Their flexibility in deployment and rapid maneuverability also make them effective for emergency communications, serving as valuable supplements to terrestrial networks [ 2 ] . Video backhaul is a fundamental capability for many UAV-based missions. In scenarios such as wildfire detection and border patrol, timely video feedback is essential for providing ground operators with real-time situational awareness. However, in remote or rugged environments, wireless signals are often obstructed by natural terrain features like mountains and dense forests. Additionally, the high mobility of UAVs leads to severe wireless channel fluctuations and rapid temporal variations. Moreover, limited by the transmission link budget and the power restrictions imposed by battery capacity, UAVs often experience reduced video bitrate or even stalling. To further reduce the bandwidth consumption of video transmission, many studies have introduced semantic communication (SemCom) techniques. Owing to its ultra-high spectral efficiency, SemCom is considered one of the key enabling technologies for future networks [ 3 ] . Unlike conventional communications that prioritize precise bit-level reconstruction, SemCom encodes information into compact semantic representations tailored to specific downstream tasks and informed by a shared semantic knowledge base. The receiver utilizes both the noisy received semantic features and the shared knowledge base to complete the intended tasks. The compact semantic representation saves a significant amount of bandwidth budget, making it highly suitable for UAV video backhaul in bandwidth-constrained environments. Nevertheless, fluctuations in network bandwidth and sporadic semantic errors can still result in playback interruptions and degraded user experience. To better accommodate fluctuating network bandwidth and ensure the QoE of users, many studies have further incorporated adaptive bitrate (ABR) techniques. [ 4 ] . Among them, Scalable Video Coding (SVC) is a common approach in real-time streaming applications. SVC addresses bandwidth variations by structuring the video bitstream into a base layer and multiple enhancement layers. Despite its theoretical suitability for adaptive transmission, SVC exhibits three key limitations in highly dynamic network environments. First, the strict inter-layer dependency requires successful reception of the base layer for video reconstruction, making the system highly vulnerable to packet loss over unreliable channels. Second, the rigid layer structure provides only coarse-grained bitrate control, typically limited to several discrete levels, which is insufficient for scenarios demanding fine-grained adaptation. Third, encoding multiple layers simultaneously introduces significant computational overhead compared to single-layer schemes, increasing energy consumption on resource-constrained edge devices. I-A Related Works 1) UAV video transmission. UAV wireless video transmission is primarily divided into two categories: cellular-based video transmission and UAV ad hoc network video transmission. Cellular-based UAV video transmission utilizes cellular networks to provide broadband connections for UAVs, enabling long-distance, high-quality video transmission. There is substantial existing research in this area [ 5 , 6 , 7 ] . In [ 5 ] , the authors defined a multi-UAV-assisted cellular communication scenario, jointly optimizing UAV trajectories, UAV selection, and transmission power to maximize QoE while minimizing the total network power consumption. In [ 6 ] , a client-server-ground & user (C-S-G&U) framework and a split-merge stream (SMS) algorithm for multi-link concurrent transmission were designed. [ 7 ] proposed two algorithms to enhance the reliability and robustness of wireless video transmission: Pixel Row Interleaving (PRI) for effective spatial error concealment and intra-frame error recovery, and Temporal Field Interleaving with Alternative Motion Compensated Prediction (TFI-AMCP) for automatic error concealment across at least four consecutive frames. UAV ad hoc network video transmission utilizes its networking capabilities to establish temporary UAV networks, serving as an effective supplement in areas lacking cellular base stations [ 8 , 9 , 10 , 11 ] . In [ 8 ] , a multi-UAV wildfire video monitoring communication framework was proposed. UAV-UEs transmit real-time video streams to UAV-BSs acting as base stations, optimizing the placement of UAV-UEs and UAV-BSs, as well as video resolution and transmission power to maximize QoE. A communication framework integrating Intelligent Reflecting Surfaces (IRS) with multi-antenna UAVs was introduced in [ 9 ] . The authors minimized UAV propulsion energy consumption and communication energy consumption through a two-stage optimization process using path discretization, alternating optimization, successive convex approximation, and a double-loop iterative algorithm based on penalized block coordinate descent. The authors of [ 10 ] and [ 11 ] both considered UAV secure communication scenarios, employing deep reinforcement learning (DRL) techniques to select optimal video compression methods and transmission power levels to ensure user QoE and reduce energy consumption. 2) Semantic video transmission. Video data accounts for a significant portion of internet traffic [ 12 ] . Due to the ability of SemCom to significantly reduce spectrum consumption in wireless communications, video semantic transmission has become a hot research topic [ 13 , 14 , 15 ] . In [ 13 ] , a deep learning-based wireless video transmission scheme integrates video compression, channel coding, and modulation into a single neural network, known as deep joint source-channel coding (DeepJSCC). This method achieves smooth degradation when mismatched with channel quality to overcome the cliff effect of traditional digital communication schemes. In [ 14 ]

Read the complete text