Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models

Chuanhong Liu, Caili Guo, Senior Member, IEEE, Yang Yang, Mingzhe Chen · 2025

Read Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models by Chuanhong Liu, Caili Guo, Senior Member, IEEE, Yang Yang, Mingzhe Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13243.txt.

Introduction

Chuanhong Liu and co-authors present a 2025 paper on semantic communication for tasks. Semantic systems send meaning, not raw bits, to save bandwidth. Large AI models boost meaning extraction but cost heavy compute. That cost clashes with real-time links. The team uses knowledge distillation to shrink the big model into a light one. Standard shrinking is slow and blind to channel state, which hurts it here.

Their fast method stores compressed knowledge ahead of time. That pre-storage skips long inference during shrinking. The design also fits task-oriented goals, where only task-relevant meaning matters. Wireless teams get a light sender that still thinks with big-model knowledge. Drones, cars, and field sensors all need meaning at low power. The paper speaks to that gap between smart models and weak devices.

Catalog record

CREATORChuanhong Liu, Caili Guo, Senior Member, IEEE, Yang Yang, Mingzhe Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13243

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models Thanks: Copyright (c) 20xx IEEE. Personal use of this material is permitted. However, permission to use this material for any other purposes must be obtained from the IEEE by sending a request to [email protected]. Thanks: This work was supported in part by the National Natural Science Foundation of China (No. 62371070), and in part by Beijing Natural Science Foundation (No. L222043). ( Corresponding author: Caili Guo ) Thanks: C. Liu and C. Guo are with the Beijing Key Laboratory of Network System Architecture and Convergence, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China (e-mail: [email protected]; [email protected]). Thanks: Y. Yang is with the Beijing Laboratory of Advanced Information Networks, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China (e-mail: [email protected]). Thanks: M. Chen is with the Department of Electrical and Computer Engineering and Institute for Data Science and Computing, University of Miami, Coral Gables, FL, USA (e-mail: [email protected]). Thanks: T. Q. S. Quek is with the Dept. of Information Systems Technology and Design, Singapore University of Technology and Design, Singapore, 487372 (e-mail: [email protected]). Chuanhong Liu, Caili Guo, Senior Member, IEEE, Yang Yang, Mingzhe Chen Abstract Recent studies have focused on leveraging large-scale artificial intelligence (LAI) models to improve semantic representation and compression capabilities. However, the substantial computational demands of LAI models pose significant challenges for real-time communication scenarios. To address this, this paper proposes utilizing knowledge distillation (KD) techniques to extract and condense knowledge from LAI models, effectively reducing model complexity and computation latency. Nevertheless, the inherent complexity of LAI models leads to prolonged inference times during distillation, while their lack of channel awareness compromises the distillation performance. These limitations make standard KD methods unsuitable for task-oriented semantic communication scenarios. To address these issues, we propose a fast distillation method featuring a pre-stored compression mechanism that eliminates the need for repetitive inference, significantly improving efficiency. Furthermore, a channel adaptive module is incorporated to dynamically adjust the transmitted semantic information based on varying channel conditions, enhancing communication reliability and adaptability. In addition, an information bottleneck-based loss function is derived to guide the fast distillation process. Simulation results verify that the proposed scheme outperform baselines in term of task accuracy, model size, computation latency, and training data requirements. I Introduction Semantic communication (SemCom), a technique capable of notably enhancing communication efficiency and robustness, is now acknowledged as a foundational technology driving the progression of sixth-generation wireless networks [ 1 ] . Existing SemCom systems can be categorized into two main categories: source data reconstruction and task execution. In contrast to data reconstruction, task-oriented SemCom (TOSC) aims to transmit semantic-aware information and obtains the inference result in a mission-oriented fashion without recovering the original data, which is beneficial to meet the increasing requirements of complicated, diverse, and intelligent transmission. Recently, various TOSC systems have been proposed to perform various downstream tasks [ 2 , 3 , 4 , 5 ] . The authors in [ 2 ] proposed an explainable TOSC system for text sentiment analysis and question answering tasks based on semantic triplets. The authors in [ 3 , 4 ] focusing on image classification task, proposed various semantic encoding and compression schemes to reduce the transmission burden. The authors in [ 5 ] developed multi-users SemCom system for visual question answering task. However, almost all current works suffer from limited semantic understanding capability stemming from constrained network structure and optimization strategies. These limitations significantly hamper the performance and broader applicability of SemCom. Fortunately, there has been considerable advancement in the field of large-scale artificial intelligence (LAI) models, particularly in sophisticated transformer models encompassing billions of parameters. LAI models have achieved remarkable breakthroughs in various domains such as natural language understanding, image analysis, and video generation. These models offer numerous benefits, including comprehensive knowledge representation and precise semantic interpretation. Wireless networks are expected to increasingly provide diverse intelligent services with greater generality and efficiency, driven by the integration of LAI models [ 6 ] . The authors in [ 7 ] proposed a semantic importance-aware communication scheme using pre-trained large language models (LLMs). The pre-trained language model was utilized to quantify the semantic importance of data frames, based on which semantic importance-aware power allocation was investigated. The authors in [ 8 ] proposed a LAI model based SemCom framework for image data, in which segment anything model was designed as knowledge base to split the original image into different semantic segments. The authors in [ 9 ] establish a foundation model-based multi-user semantic communication framework via personalized federated parameter-efficient finetuning, in which each user equipment is provided with personalized semantic services in diverse downstream tasks. The aforementioned works directly apply LAI models in the processes of semantic encoding or transmission. However, due to their vast number of parameters and high computational complexity, these models incur significant energy consumption and computational latency, even during inference. This makes them unsuitable for meeting the real-time and low-energy requirements of next-generation wireless communications. Therefore, there is an urgent need for research on lightweight semantic communication schemes that reduce communication complexity and fully exploit the strengths of LAI models. To enable real-time TOSC for resource-constrained scenarios (e.g., Internet of vehicles), this paper proposes a novel lightweight TOSC scheme, where the semantic codec is distilled from LAI models. The primary contributions are summarized as follows: \bullet To the best of the author’s knowledge, this is the first work that integrates LAI model and TOSC through knowledge distillation. By distilling LAI model into a streamline TOSC network, we can achieve both the advantages of large model’s robust semantic representation capabilities, and the benefits from small model’s low-power and low-latency attributes, striking a good balance between complexity and accuracy of semantic communication. \bullet We propose a fast distillation method (FDM) that effectively transfers knowledge from LAI models to a lightweight TOSC model. This method significantly reduces distillation time and resource consumption while maintaining high performance. We then derive a loss function based on the information bottleneck (IB) principle to guide the fast distillation process, achieving the optimal semantic rate-distortion tradeoff. Consequently, the lightweight TOSC can significantly reduce the communication burden while maintaining the communication accuracy. \bullet Additionally, to address the limitation of LAI models in accounting for wireless channel variations, we incorporate a channel adaptive module, which dynamically adjusts the weights of transmitted semantics in response to varying channel conditions, ensuring improved communication reliability and adaptability. Simulation results verify the superiority of the proposed scheme. Fig. 1: System model of lightweight task-oriented semantic communications empowered by large-scale artificial intelligence models. II Proposed Distillation-based Lightweight TOSC Framework As shown in Fig. 1 , we consider a TOSC system that consists of a semantic transmitter, a semantic receiver, and two edge servers. Specifically, the transmitter consists of a joint semantic channel encoder to extract the semantic features, and a channel adaptive module to combat the channel noise. The receiver is composited with a joint semantic channel decoder for semantics recovery and task execution. The LAI models are deployed at edge servers to guide the training of joint semantic channel encoder and decoder, i.e., part (b) in Fig. 1 . We first

Read the complete text