6G EdgeAI: Performance Evaluation and Analysis
Chien-Sheng Yang ∗ , Yu-Jen Ku ∗ , Yuan-Yao Lou † , Nathan Tenny ∗ and Alex C.-C. Hsu ∗ · 2025
Read 6G EdgeAI: Performance Evaluation and Analysis by Chien-Sheng Yang ∗ , Yu-Jen Ku ∗ , Yuan-Yao Lou † , Nathan Tenny ∗ and Alex C.-C. Hsu ∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-16529.txt.
Introduction
Yang, Ku, Lou, Tenny, and Hsu propose in twenty twenty-five a network design that fuses communication and computing at the network edge for future 6G services. Today's edge setups treat the two as separate worlds, which strains the tight delays that live AI chat services need. Their framework puts computing inside radio network nodes and manages bandwidth and compute power jointly.
Queueing maths showed the fused design nearly doubles service capacity over the split design, at a fixed standard for on-time jobs. Simulations with real AI workloads, chip specs, and priority scheduling confirmed a large gain, though smaller. The authors pitch the design as a cheaper path to real-time AI services on 6G. Costs and rollout questions remain open.
Catalog record
| CREATOR | Chien-Sheng Yang ∗ , Yu-Jen Ku ∗ , Yuan-Yao Lou † , Nathan Tenny ∗ and Alex C.-C. Hsu ∗ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-16529
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
6G EdgeAI: Performance Evaluation and Analysis Chien-Sheng Yang ∗ , Yu-Jen Ku ∗ , Yuan-Yao Lou † , Nathan Tenny ∗ and Alex C.-C. Hsu ∗ Abstract Generative AI (GenAI) services powered by large language models (LLMs) increasingly deliver real-time interactions, yet existing 5G multi-access edge computing (MEC) architectures often treat communication and computing as separate domains, limiting their ability to meet stringent latency requirements. To address this challenge, we introduce an Integrated Communication and Computing (ICC) framework where computing capabilities are enabled to reside directly in radio access network (RAN) nodes and jointly manage bandwidth and computing resources. Our queueing-theoretic analysis shows that ICC outperforms 5G MEC, achieving higher service capacity (defined as the maximum arrival rate that maintains a specified fraction of jobs completed within a given delay budget) by 98 % 98\% . We corroborate these gains through system-level simulations that account for transformer-based LLM workloads, realistic GPU specifications, and a priority-based scheduling scheme. The simulations show that ICC improves service capacity by 60 % 60\% , demonstrating its potential to enable efficient, cost-effective real-time GenAI services in 6G. I Introduction Generative AI (GenAI) services are rapidly expanding their reach to mainstream consumer markets, driven primarily by advances in large language models (LLM). These models enable sophisticated tasks such as real-time language translation, and content generation—capabilities with stringent low-latency requirements. As an increasing number of applications integrate GenAI functionalities, ensuring minimal response time becomes critical for delivering seamless user experiences. The evolution of cellular technology from 4G to 5G has dramatically expanded the types of applications that mobile networks can support, including virtual reality, augmented reality, and Industry 4.0 use cases. However, GenAI services introduce additional computational overhead, particularly to handle LLM inference workloads that existing 5G infrastructure may struggle to satisfy. Thus, 6G development aims to incorporate native computing capabilities into the mobile network fabric, supported by industry-wide efforts (e.g., AI-RAN Alliance [ 1 ] ). Many of today’s LLM-based services rely on large-scale cloud servers. However, this design paradigm entails significant drawbacks. The need to route requests and responses between remote data centers and end-user devices can introduce noticeable latency, limiting the potential for real-time interactions. Additionally, reliance on centralized computing inflates network congestion and raises concerns about scalability and operational overhead. Although 5G multi-access edge computing (MEC) seeks to mitigate these issues by moving compute closer to end users—thus reducing signal travel distance and improving responsiveness—current MEC implementations are typically confined to operator-managed sites located behind a User Plane Function (UPF), limiting proximity to end users. This setup rules out RAN-based or device-based servers and prevents mobile network operators (MNOs) from fully harnessing the performance, cost, and flexibility benefits of placing computing resources across the broader network, including the RAN and user devices. Furthermore, current 5G MEC architectures typically treat communication and computing resources as separate domains, each governed by its own framework. While adequate for many existing applications, this disjoint approach cannot fully optimize the system for the stringent latency requirements of LLM inference. When both communication overhead and compute latency are critical, coordinating them independently can lead to inefficiencies and underutilized capacity. Therefore, a holistic approach that manages communication and computing resources under one unified framework is essential for 6G networks. This paper introduces the concept of Integrated Communication and Computing (ICC). With ICC, computing capabilities can be enabled within RAN nodes, allowing efficient offloading of LLM inference tasks while maintaining seamless control over both communication and computing. By coordinating resource usage end-to-end, ICC offers superior performance compared to traditional disjoint approaches, opening the door for new service paradigms in which AI computations are distributed intelligently across the MNO’s network. To evaluate the benefits of ICC, we first develop a theoretical framework using queueing modeling where user requests arrive following a Poisson process and all incoming jobs contend for both communication and computing resources. Compared to 5G MEC, our queueing analysis demonstrates that integrating RAN computing with joint communication-computing latency management increases the achievable service capacity (defined as the maximum arrival rate that maintains a specified fraction of jobs completed within a given delay budget) by 98\% . Beyond theoretical insights, we conduct simulation-based evaluations of LLM inference tasks offloaded to an MNO’s network. Our methodology accounts for typical transformer architectures, GPU specifications, and the interplay of communication and computing latencies. We further include a priority-based scheme to highlight tangible performance gains from a joint latency management approach. Simulation results validate ICC’s ability to reduce end-to-end job latency and increase service capacity by 60\% , all while lowering the operator’s compute costs by 27\% against 5G MEC. Collectively, these findings underscore the feasibility and promise of deploying ICC for GenAI services in 6G networks. Related Work: Recent years have witnessed a growing emphasis on integrated communication and computing (see e.g., [ 2 , 3 , 4 ] ). The 6G network is expected to facilitate ambient intelligence (AmI), revolutionizing the interaction between humans and technology. Beyond mere reactions and responses, AmI infers and anticipates user needs by collecting, processing, analyzing, and learning from a wide variety of data sources to deliver the best response in the most intuitive form possible to the end user [ 3 ] . To realize AmI capabilities at scale, advancements in computing technologies, such as GPUs, NPUs, and DPUs, have enabled distributed inference and edge AI [ 5 ] , which are crucial for supporting AmI in 6G networks. Specifically, the heterogeneity of the device cloud and RAN cloud fosters tight collaboration for the distributed AI/ML inference at the edge of 6G network [ 4 , 6 ] . The prior studies have addressed this by partitioning inference tasks and distributing them among device clouds, edge clouds, and traditional clouds through adaptive joint device selection and LLM model partition problems [ 7 ] or by optimizing DNN partitioning to minimize delays [ 8 ] . On the other hand, the previous works [ 9 ] have focused on jointly allocating communication and computation resources to optimize LLM inference, considering heterogeneous resource constraints and user requirements. There are also existing researches that investigate the concept of device clouds built around user devices in a multi-level inference framework by utilizing open dataset [ 10 ] or deploying a real testbed [ 11 ] . Despite these prior works, we investigate LLM inference under an ICC-based 6G framework that brings computing resources closer to the end user and jointly manages communication and computing latencies, with particular emphasis on service capacity and cost efficiency. Our queueing-based theoretical analysis shows that ICC outperforms both 5G MEC and cloud-centric models in delivering higher service capacity. We validate these insights using a system-level simulator (SLS) that integrates L1 physical layer and L2 protocol modeling for communication latency, as well as an LLM-centric inference model for computing latency under a joint latency management. II Integrated Communication and Computing Fig. 1 : High-level overview of the proposed ICC design. II-A 5G MEC Overview The 3GPP EDGE architecture, defined in TS 23.558 [ 12 ] , brings compute and application processing closer to end users. It adopts a model based on an operator-managed data network, conceptually resembling the over-the-top (OTT) model familiar from cloud computing. Edge Application