Privacy-Preserving Offloading for Large Language Models in 6G Vehicular Networks
Ikhlasse Badidi, Nouhaila El Khiyaoui, Aya Riany, Badr Ben Elallid, Amine Abouaomar · 2025
Read Privacy-Preserving Offloading for Large Language Models in 6G Vehicular Networks by Ikhlasse Badidi, Nouhaila El Khiyaoui, Aya Riany, Badr Ben Elallid, Amine Abouaomar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-05320.txt.
Introduction
Offloading language model work from cars to roadside computers without leaking user data is the goal of Ikhlasse Badidi and four co-authors in a 2025 networks paper. Sixth-generation vehicular networks promise smarter transport, but sending prompts to edge servers exposes private information.
Their framework mixes federated learning, where models train without centralising raw data, with differential privacy, which adds calibrated noise to protect individuals. A partitioning algorithm splits each task between car and edge under privacy and efficiency limits, and a secure protocol moves updates safely. Tests report accuracy close to unprotected systems at a chosen privacy level, with modest communication cost per round.
Catalog record
| CREATOR | Ikhlasse Badidi, Nouhaila El Khiyaoui, Aya Riany, Badr Ben Elallid, Amine Abouaomar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-05320
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Privacy-Preserving Offloading for Large Language Models in 6G Vehicular Networks Ikhlasse Badidi, Nouhaila El Khiyaoui, Aya Riany, Badr Ben Elallid, Amine Abouaomar Abstract The integration of Large Language Models (LLMs) in 6G vehicular networks promises unprecedented advancements in intelligent transportation systems. However, offloading LLM computations from vehicles to edge infrastructure poses significant privacy risks, potentially exposing sensitive user data. This paper presents a novel privacy-preserving offloading framework for LLM-integrated vehicular networks. We introduce a hybrid approach combining federated learning (FL) and differential privacy (DP) techniques to protect user data while maintaining LLM performance. Our framework includes a privacy-aware task partitioning algorithm that optimizes the trade-off between local and edge computation, considering both privacy constraints and system efficiency. We also propose a secure communication protocol for transmitting model updates and aggregating results across the network. Experimental results demonstrate that our approach achieves 75% global accuracy with only a 2-3% reduction compared to non-privacy-preserving methods, while maintaining DP guarantees with an optimal privacy budget of ε = 0.8 \varepsilon=0.8 . The framework shows stable communication overhead of approximately 2.1MB per round with computation comprising over 90% of total processing time, validating its efficiency for resource-constrained vehicular environments. I Introduction The fast growth of connected vehicles and the arrival of sixth-generation (6G) vehicular networks are driving a new stage in intelligent transportation systems. These networks support important applications such as real-time traffic prediction, vehicle diagnostics, cooperative driving, and environmental monitoring [ 1 , 2 ] . A key part of this progress is the use of Large Language Models (LLMs), which can process continuous streams of vehicular data to give useful insights and improve system intelligence [ 3 ] . Unlike older models, LLMs can handle different types of inputs—such as sensor readings, driving behavior, and network information—making them valuable for the future of connected and autonomous vehicles. At the same time, using such large models in vehicles brings serious challenges. LLMs require huge amounts of computation that the onboard hardware in vehicles cannot satisfy. A common solution is to offload the processing to roadside units or edge servers [ 4 ] . While this approach reduces the load on vehicles, it also raises privacy risks. Sensitive data such as location history, driving patterns, and environmental details can be exposed during communication and aggregation. This creates a clear trade-off between improving intelligence and protecting private data of road users in next-generation vehicular systems. Federated Learning (FL) has been studied as a way to reduce this risk. It allows vehicles to train models locally and only share updates with edge servers, so that raw data never leaves the vehicle [ 5 , 6 ] . This approach reduces communication costs and improves privacy. However, when applied to LLMs in fast-changing vehicular networks, traditional FL faces limits. It may not meet strict demands for low delay, high scalability, and strong privacy. Also, even if raw data is not shared, attackers can still learn private information from model updates [ 7 ] . This creates a crucial need for stronger privacy-preserving methods. To meet these needs, this paper presents a novel privacy-preserving offloading framework for LLM-integrated 6G vehicular networks. The framework combines FL with Differential Privacy (DP), so that only protected model updates are sent to edge servers. Each vehicle trains a Time Series Transformer (TST) model, which uses attention mechanisms to capture long-term dependencies in sequential vehicular data more effectively than recurrent models. Before sending updates, the vehicle applies gradient clipping and adds Gaussian noise to protect privacy. This design protects user privacy and keeps high model accuracy, reaching 75% with only a small 2–3% drop compared to non-private methods. The framework also shows low and stable communication overhead, with most of the resource use in local computation, making it practical for vehicles with limited resources. In addition, it provides strong DP guarantees with a budget of \epsilon=0.8 , balancing privacy and performance. The main contributions of this paper are presented as follows: • Privacy-preserving framework: A federated learning system with differential privacy for secure offloading of LLMs in 6G vehicular networks. • Privacy-aware model training: Use of a transformer-based model for sequential vehicular data, combined with privacy techniques to protect data while keeping good accuracy. • Comprehensive evaluation: Detailed experiments showing strong accuracy, efficient communication, and strong privacy guarantees in vehicular environments. The rest of the paper is organized as follows: Section II reviews related works. Section III presents the system model and privacy threat assumptions. Section IV explains the proposed framework. Section V discusses performance evaluation and results. Section VI concludes the paper and gives directions for future work. II Related Work Recent research has explored various aspects related to privacy-preserving machine learning in distributed environments. Zhou et al. [ 8 ] implemented a three-tier architecture for FL that preserves privacy in fog computing using DP and homomorphic encryption, though primarily targeting static IoT environments rather than dynamic vehicular networks. Liu et al. [ 9 ] proposed FedGRU for traffic prediction while prioritizing scalability over comprehensive privacy protection, whereas Mo et al. [ 10 ] developed PPFL using Trusted Execution Environments (TEEs) to protect model training and aggregation. In the context of vehicular networks, Elbir et al. [ 11 ] proposed FL for vehicular environments to reduce data transmission overhead and enhance privacy, but without integrating advanced 6G capabilities or specialized privacy-preserving mechanisms for LLMs. Their work demonstrated the feasibility of FL in vehicular applications, particularly for object detection, while identifying challenges in data labeling, model training, and resource management. The FLEXE framework [ 12 ] examined how mobility and communication disruptions affect FL performance but lacked substantial privacy-preserving mechanisms essential for LLM deployment. Zhang et al. [ 13 ] introduced blockchain-based FL for device failure detection, offering insights on data integrity and incentivization that could benefit vehicular systems. Wang et al. [ 14 ] introduced adaptive control mechanisms for resource-constrained distributed learning by optimizing global aggregation frequency, providing valuable insights for heterogeneous vehicular data without addressing LLM-specific concerns. Previous studies have examined intelligent control strategies to improve traffic efficiency and safety. The work of [ 5 ] federated deep reinforcement learning has been applied to vehicle control for collision avoidance, with the goal of reducing travel delays while preserving data privacy. A comparison between a local deep deterministic policy gradient model and a global federated deep deterministic policy gradient model demonstrated that the federated approach provides superior performance by reducing collisions, lowering travel delays, and increasing average speed. These studies emphasize the potential of FL to balance system performance with privacy preservation, which is increasingly relevant for next-generation vehicular networks. Regarding LLM integration with 6G networks, Liu and Zhao [ 15 ] tackled resource allocation challenges through a hybrid computing framework where vehicles handle initial computation layers while offloading intensive tasks to roadside units, though overlooking critical privacy concerns. Xu et al. [ 16 ] proposed split learning between mobile devices and edge servers to distribute computational loads, while Nguyen et al. [ 17 ] analyzed security threats to LLMs in 6G environments without implementing specific privacy-preserving techniques for vehicular contexts. Broader research on next-generation network security by Nguyen et al. [ 18 ] has classified 6G privacy risks across multiple layers,