Covert Prompt Transmission for Secure Large Language Model Services

Ruichen Zhang, Yinqiu Liu, Shunpu Tang, Jiacheng Wang, Dusit Niyato · 2025

Read Covert Prompt Transmission for Secure Large Language Model Services by Ruichen Zhang, Yinqiu Liu, Shunpu Tang, Jiacheng Wang, Dusit Niyato (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21311.txt.

Introduction

Zhang and a large team (2025) study how to send prompts to language model services over wireless links without being detected. A covert channel protects both privacy and the fact of communication itself. The team frames the task as cutting delay while keeping answers faithful and the transmission hidden. They tune transmit power and prompt compression together.

Their framework first compresses the prompt with help from a small local model. That model scores how surprising each token is and keeps only the ones that carry meaning. A light permutation cipher then scrambles the result. For the wireless side, they train a policy method that samples groups of candidate actions and penalizes drift. In simulations, compression cut preprocessing delay hugely with answer quality intact. The transmission method cut covert delay by up to about 39 percent against rival learning strategies.

Catalog record

CREATORRuichen Zhang, Yinqiu Liu, Shunpu Tang, Jiacheng Wang, Dusit Niyato
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-21311

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Covert Prompt Transmission for Secure Large Language Model Services Thanks: R. Zhang, Y. Liu, S. Tang, J. Wang, and D. Niyato are with the College of Computing and Data Science, Nanyang Technological University, Singapore (e-mail: [email protected], [email protected], [email protected], [email protected], [email protected]). Thanks: G. Sun is with the College of Computer Science and Technology, Jilin University, Changchun 130012, China (e-mail: [email protected]). Thanks: Y. Li is with the School of Electrical and Information Engineering, University of Sydney, Sydney, NSW 2006, Australia (e-mail: [email protected]). Thanks: S. Sun is with the Institute for Infocomm Research, Agency for Science, Technology and Research, Singapore (e-mail: [email protected]). Ruichen Zhang, Yinqiu Liu, Shunpu Tang, Jiacheng Wang, Dusit Niyato Abstract This paper investigates covert prompt transmission for secure and efficient large language model (LLM) services over wireless networks. We formulate a latency minimization problem under fidelity and detectability constraints to ensure confidential and covert communication by jointly optimizing the transmit power and prompt compression ratio. To solve this problem, we first propose a prompt compression and encryption (PCAE) framework, performing surprisal-guided compression followed by lightweight permutation-based encryption. Specifically, PCAE employs a locally deployed small language model (SLM) to estimate token-level surprisal scores, selectively retaining semantically critical tokens while discarding redundant ones. This significantly reduces computational overhead and transmission duration. To further enhance covert wireless transmission, we then develop a group-based proximal policy optimization (GPPO) method that samples multiple candidate actions for each state, selecting the optimal one within each group and incorporating a Kullback-Leibler (KL) divergence penalty to improve policy stability and exploration. Simulation results show that PCAE achieves comparable LLM response fidelity to baseline methods while reducing preprocessing latency by over five orders of magnitude, enabling real-time edge deployment. We further validate PCAE effectiveness across diverse LLM backbones, including DeepSeek-32B, Qwen-32B, and their smaller variants. Moreover, GPPO reduces covert transmission latency by up to 38.6% compared to existing reinforcement learning strategies, with further analysis showing that increased transmit power provides additional latency benefits. I Introduction The rise of generative artificial intelligence (GAI) has led to the rapid development of large language models (LLMs), such as OpenAI’s ChatGPT and DeepSeek’s R1, which demonstrate strong capabilities in text generation, reasoning, and multimodal understanding [ 1 ] . Due to their high computational requirements, these models are typically hosted on centralized cloud servers, while user prompts are transmitted wirelessly from edge devices [ 2 ] . This cloud-edge architecture enables real-time services such as virtual assistants and customer support [ 3 ] , but also introduces significant security risks. In particular, transmitting prompts over open wireless channels exposes both their content and existence to potential eavesdropping or detection [ 4 ] . While prior research has primarily focused on improving LLM inference, the security risks associated with prompt transmission remain largely underexplored. Particularly, securing prompt transmission is crucial because many real-world prompts are extensive or semantically sensitive, including detailed financial transactions, comprehensive medical histories, and full-length document translations. These long prompts inherently increase transmission duration, directly escalating both the risks of content interception and the probability of adversarial detection [ 4 ] . Therefore, securing LLM-based wireless communication requires addressing two key challenges: I). Data Privacy and Query Confidentiality : Wireless transmission of user queries to cloud-hosted LLMs inherently introduces privacy vulnerabilities, as adversaries may intercept, analyze, and infer sensitive information from transmitted signals [ 5 ] . This risk is particularly critical in privacy-sensitive applications, where user prompts may contain personal, financial, or proprietary content, making them prime targets for identity theft or corporate espionage. Therefore, it is essential to apply encryption mechanisms that obfuscate semantic content at the token level, ensuring that even if signals are intercepted, meaningful information cannot be extracted. Such encryption not only secures the query content but also complements physical-layer stealth techniques, providing a foundational layer of protection for confidential LLM services. II). Transmission Security and Detection Avoidance : Wireless transmission of LLM queries also poses the risk of detection, where adversarial wardens may monitor signal patterns to infer the existence of LLM-related traffic. Even if query content is fully encrypted, adversarial wardens can exploit transmission patterns, power fluctuations, and spectral characteristics to identify, classify, or block LLM communications. This challenge is further exacerbated by advanced detection techniques, such as channel state information (CSI)-based analysis, which can expose transmissions [ 6 ] . To mitigate this risk, it is essential to ensure that LLM-related transmissions remain covert through adaptive power control, noise injection, and signal obfuscation strategies, making them indistinguishable from background noise. To address the aforementioned security challenges, two important strategies have been introduced, i.e., prompt encryption and compression to safeguard query confidentiality and transmission signal covert communication to ensure undetectable wireless transmissions. I). LLM Prompt Encryption: To address data privacy and query confidentiality, prompt encryption and compression have been introduced to transform user queries into an obfuscated and compressed representation, preventing adversaries from extracting meaningful content while preserving interpretability for LLM inference [ 7 ] . Specifically, encryption techniques such as token-level substitution, structural transformation, and multimodal encoding have been applied to conceal sensitive information while ensuring efficient transmission. Additionally, lossy and lossless cryptographic methods are incorporated to minimize data size while retaining essential semantics. For example, numerical values and domain-specific terms in prompts can be transformed into structured placeholders (e.g., replacing “The transaction of $5000 was completed at Bank A” with “Transaction Amount at Institution X”), effectively anonymizing critical details without compromising the LLM’s ability to generate responses [ 8 ] . II). Transmission Signal Covert Communication: To address transmission security and detection avoidance, transmission signal covert communication technique has been introduced to ensure that LLM-related wireless transmissions remain undetectable to adversarial monitoring. This approach prevents unauthorized entities from detecting, intercepting, or inferring the presence of LLM queries over wireless channels [ 9 ] . Specifically, covert communication techniques such as power control, artificial noise injection, and spread spectrum modulation have been employed to embed transmissions within background interference, thereby reducing the probability of detection. Unlike traditional encryption, which secures content but still reveals transmission activity, covert communication conceals the very existence of transmission, preventing adversarial wardens from even recognizing LLM-related communications [ 10 ] . For example, leveraging artificial noise and stochastic power shaping enables transmitted signals to blend seamlessly into environmental noise, making them statistically indistinguishable from background interference. Motivated by the aforementioned reasons, this work investigates covert prompt transmission for secure LLM services. Specifically, we develop a multi-layered security framework that integrates prompt encryption and compression with covert wireless transmission to protect both query confidentiality and transmission detectability. To the best of the authors’ knowledge, this is the first work to introduce a covert prompt transmission method that ensures secure and undetectable LLM-based communications over wireless networks. The key contributions of this paper are summarized as follows: • Problem Formulation and System Modeling: We formulate a covert prompt transmission problem that jointly optimizes the prompt compression ratio and transmit power to minimize end-to-end latency, while ensuring LLM response fidelity and maintaining the warden’s total detection error. To this end, we derive a tractable expression for the detection probability constraint, effectively capturing the covertness requirement under wireless channel uncertainty. • Prompt Compression and Encryption via PCAE: To address the challenges of

Read the complete text