NetEcho : From Real-World Streaming Side-Channels to Full LLM Conversation Recovery
Zheng Zhang 1 2 , Guanlong Wu 1 , Sen Deng 2 , Shuai Wang 2 3 and Yinqian Zhang 1 3 · 2025
Read NetEcho : From Real-World Streaming Side-Channels to Full LLM Conversation Recovery by Zheng Zhang 1 2 , Guanlong Wu 1 , Sen Deng 2 , Shuai Wang 2 3 and Yinqian Zhang 1 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25472.txt.
Introduction
Zheng Zhang led four co-authors in presenting NetEcho. Guanlong Wu, Sen Deng, and Shuai Wang helped. Yinqian Zhang closes the five-author team. Their 2025 paper recovers language model conversations from traffic. Real-time streaming is now the main way models are used. Streaming improves user experience for model uses. It also exposes a network side-channel attack surface.
Adversaries can infer sensitive information from encrypted traffic patterns. Providers deploy padding defenses against this. The team study contemporary side-channel defenses systematically. Seven representative deployment scenarios are studied closely. Services from OpenAI and DeepSeek are included. Despite defenses, great residual information remains vulnerable. NetEcho is their language model based recovery approach. Both user prompts and model responses are recovered. Tests used medical and legal uses on leading models. About seventy percent of conversation information was recovered. Current defenses have critical limitations, they conclude.
Catalog record
| CREATOR | Zheng Zhang 1 2 , Guanlong Wu 1 , Sen Deng 2 , Shuai Wang 2 3 and Yinqian Zhang 1 3 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-25472
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NetEcho : From Real-World Streaming Side-Channels to Full LLM Conversation Recovery Zheng Zhang 1 2 , Guanlong Wu 1 , Sen Deng 2 , Shuai Wang 2 3 and Yinqian Zhang 1 3 Abstract In the rapidly expanding landscape of Large Language Model (LLM) applications, real-time output streaming has become the dominant interaction paradigm. While this enhances user experience, recent research reveals that it exposes a non-trivial attack surface through network side-channels. Adversaries can exploit patterns in encrypted traffic to infer sensitive information and reconstruct private conversations. In response, LLM providers and third-party services are deploying defenses such as traffic padding and obfuscation to mitigate these vulnerabilities. This paper starts by presenting a systematic analysis of contemporary side-channel defenses in mainstream LLM applications, with a focus on services from vendors like OpenAI and DeepSeek. We identify and examine seven representative deployment scenarios, each incorporating active/passive mitigation techniques. Despite these enhanced security measures, our investigation uncovers significant residual information that remains vulnerable to leakage within the network traffic. Building on this discovery, we introduce NetEcho , a novel, LLM-based framework that comprehensively unleashes the network side-channel risks of today’s LLM applications. NetEcho is designed to recover entire conversations—including both user prompts and LLM responses—directly from encrypted network traffic. It features a deliberate design that ensures high-fidelity text recovery, transferability across different deployment scenarios, and moderate operational cost. In our evaluations on medical and legal applications built upon leading models like DeepSeek-v3 and GPT-4o, NetEcho can recover avg ∼ \sim 70% information of each conversation, demonstrating a critical limitation in current defense mechanisms. We conclude by discussing the implications of our findings and proposing future directions for augmenting network traffic security. I Introduction Large Language Models (LLMs) are increasingly deployed across diverse domains through two primary modes. First, major vendors offer services based on proprietary models, such as OpenAI’s ChatGPT, DeepSeek’s web interface [ 2 , 20 ] , and various API offerings. Second, developers build customized applications by curating domain-specific datasets [ 44 , 33 ] and integrating open-source foundation models via fine-tuning [ 21 ] or RAG [ 19 ] frameworks. In both cases, these services deliver streaming, token-by-token responses. Recent studies [ 41 , 51 , 43 ] reveal that the token-by-token streaming of LLM responses leaks semantic information through network-level side channels. By analyzing encrypted traffic patterns—specifically packet timing and lengths—adversaries can infer parts of the model’s output or the user’s prompt (as detailed in Sec. II-B ). To mitigate such side-channel risks, vendors have adopted two types of defenses. First, active defenses [ 6 ] aim to fundamentally eliminate side-channel leakage by obfuscating traffic features through padding and batching. Second, passive defenses reduce leakage granularity by aggregating multiple tokens into each packet instead of transmitting them one-by-one. While this approach does not fundamentally block the attack surface, it significantly increases the difficulty of conducting attacks [ 41 ] . However, in this paper, we show that the effectiveness of existing defenses remains limited in practice. We first conduct a real-world analysis of network traffic across a broad set of LLM applications. Despite that there exist varying deployment scenarios, where each scenario is incorporating defense methods, we observe a high volume of residual information, which may presumably leak private data. On the other hand, we believe that existing attacks generally underexploit the network traffic side channels. We show that by aggregating multi-dimensional network traffic and employing reasoning LLMs, we achieve highly effective attacks even under the state-of-the-art (SoTA) defenses. We summarize key findings below: Real-World Study. We surveyed SoTA defense mechanisms across different LLM application deployment scenarios. \bullet Active defenses are rare: Only giant vendors implement padding [ 6 ] . Since active defenses require modifying streaming protocols and Server Sent Event(SSE) interfaces, most downstream applications cannot implement such measures. \bullet Passive defenses remain weak: Despite widespread API adoption, excessive tokens per chunk significantly degrade user experience [ 8 , 35 ] , limiting batching strength. \bullet Frontend-backend configurations create diverse traffic patterns: Different deployment setups exhibit significant variations in traffic patterns and residual information. We summarize four kinds of inference backends and three mainstream frontends, and accordingly examine seven common deployment scenarios adopted by today’s AI applications. We show that only one of these scenarios are enforcing full-fledged defenses. To validate this observation, on medical [ 10 ] and legal [ 34 ] datasets, we collected both 10K data samples, and trained network trace-based classification models that can recover user conversation topics with accuracy of around 90%. Research Gaps. There is an urgent need to comprehensively expose network side-channel risks of LLM applications, thereby promoting further defense efforts. Notice that existing attacks in this field are primarily effective in few scenarios [ 41 ] , whereas other relevant attacks only leak basic information such as conversation topics [ 31 , 5 , 40 ] . In short, we identify four research gaps in previous attacks: \bullet Isolated attack vectors : Focus on specific mechanisms rather than comprehensive real-world scenarios. \bullet Single traces : Reliance on individual network trace analysis instead of a comprehensive, multi-dimensional trace viewpoint. \bullet Partial recovery : Limited to basic conversation information (topics or responses) rather than complete conversations. \bullet Generation ability : Fail to fully use SoTA LLMs to understand, reason, and generate high-quality textual conversations. This paper introduces NetEcho , a novel framework for recovering entire user-LLM conversations from encrypted network traffic. It uniquely combines two core techniques: trace-constrained text generation and iterative prompt refinement. Initially, NetEcho uses a victim’s network trace to retrieve similar (conversation, trace) samples from a pre-compiled database, adopting a RAG-like methodology. This database is created beforehand by the attacker, who acts as a regular user to probe the target application and log the conversation-trace pairs. These examples provide context for a local LLM to generate likely LLM responses constrained by the victim’s traces. To further recover the user prompt, NetEcho conducts a “semantic gradient” from the retrieved and generated content, which guides a reasoning model to iteratively rewrite and improve its guess of the user’s original prompt. This iterative loop progressively refines the entire conversation, enabling high-fidelity recovery of both prompts and responses. NetEcho achieves highly accurate recovery on conversational contents, including both user prompts and LLM responses. Using local open-source models and remote reasoning models, our attack can be easily transferred to different scenarios by simply tweaking its configurations according to trace features. Across levels of characters, phrases, and semantics, we recovered 65%/80% of responses/prompts on medical data and 80%/55% on legal data, achieving up to 100% attack success rate in certain scenarios. Moreover, NetEcho performs well on real-world data including imbalanced, large-scale scenarios and out-of-distribution samples, and demonstrates improvement in iterative refinement, highlighting the novelty and effectiveness. Contributions. We make the following contributions: \bullet Systematic Analysis of Real-World Defenses : We conduct the first comprehensive study of side-channel defenses across seven mainstream LLM deployment scenarios. We demonstrate that existing countermeasures are ineffective in practice and fail to prevent information leakage from encrypted traffic. \bullet A Novel Attack Framework : We design and implement NetEcho , a framework that pioneers a new attack paradigm. It for the first time integrates multi-dimensional trace analysis with LLM-driven reasoning,