Cooperative Task Offloading through Asynchronous Deep Reinforcement Learning in Mobile Edge Computing for Future Networks

2025

Read Cooperative Task Offloading through Asynchronous Deep Reinforcement Learning in Mobile Edge Computing for Future Networks (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17526.txt.

Introduction

Liu and four co-authors built a joint task shed plan in twenty twenty-five for edge servers in next-wave nets like 6G. Phones shed heavy tasks to near servers to save time and power. One lone server can clog, though, and core-led picks add lag.

Their plan lets edge servers team up and train out of sync. A forecast block built on transformers guides the picks. Loads split across the net with less wait for slow sites. Tests cut lag by up to four fifths and power by more, they report.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-17526

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cooperative Task Offloading through Asynchronous Deep Reinforcement Learning in Mobile Edge Computing for Future Networks Abstract Future networks (including 6G) are poised to accelerate the realisation of Internet of Everything. The latter will imply a high demand for computational resources to support new services. Mobile Edge Computing (MEC) is a promising solution that enables offloading computation-intensive tasks to nearby edge servers from the end-user devices, thereby reducing latency and energy consumption . Nevertheless, relying solely on a single MEC server for task offloading can lead to uneven resource utilisation and suboptimal performance in complex scenarios. Additionally, traditional task offloading strategies specialise in centralised policy decisions, which unavoidably entails extreme transmission latency and reach computational bottleneck. To address these gaps, we propose a latency-efficient and energy-efficient Cooperative Task Offloading framework with Transformer-driven Prediction (CTO-TP), leveraging asynchronous multi-agent deep reinforcement learning to address these challenges. This approach fosters edge-edge cooperation and decreases the synchronous waiting time by performing asynchronous training, optimising task offloading, and resource allocation across distributed networks. The performance evaluation demonstrates that the proposed CTO-TP algorithm reduces up to 80% overall system latency and 87% energy consumption compared to the baseline schemes. I Introduction and Related Work The advancement of 5G communication technologies, along with current efforts towards 6G and beyond, has led to the possibility of realising exciting new services. These include, but are not limited to, real-time gaming, Augmented Reality (AR), Vehicle-to-Everything (V2X) communication, robotic surgery, and the metaverse. These services require enhanced Quality of Experience (QoE) for users and huge computing capacity. At the same time, requirements for such services easily surpass the capabilities of end-user devices in terms of computing capacity and energy. The most common approach to address this limitation is acquiring resources from cloud servers; however, accessing cloud computing will impose extra delays. To this end, Mobile Edge Computing (MEC) is recognised as a promising solution to address this challenge [ 1 ] . MEC facilitates end-user devices, including mobile devices, to process computation-intensive tasks on nearby edge servers, which can significantly reduce the devices’ service latency and energy consumption [ 2 ] . These devices could be even Internet of Things (IoT) devices that are constrained by energy and computational power. Benefiting from MEC, the user QoE can be dramatically improved by offloading high computational tasks to edge servers with more computational resources compared to end-user devices [ 3 ] . Nevertheless, the geographical distribution of MEC servers in reality is a challenge. Furthermore, the highly dynamic changes in user activities using services through end-user devices cause an uneven distribution of workload requests, both in terms of time and location. This imbalance results in varying load levels among MEC servers, leading to decreased overall resource utilisation. Some MEC servers might become fully loaded while others may remain idle. Notably, a single MEC server is often resource-limited and unable to handle peaks in task requests. Therefore, offloading tasks to distributed MEC servers without collaboration can lead to uneven resource utilisation, making it difficult to efficiently meet the large, complex, and dynamic demands of computing tasks. To address these challenges, cooperative task offloading has recently emerged as a promising solution where distributed MEC servers can collaborate more effectively. Given the mobility of users and the variability over time, computational tasks can be offloaded from an overloaded edge server to a nearby server with available resources, which may be idle or less busy by comparison [ 4 ] . However, the dynamic and complex environment, including fluctuating task requests, network resources, and multi-objective optimisation factors such as latency and energy consumption, presents challenges for achieving effective long-term optimisation. Fortunately, AI-based strategies, especially Deep Reinforcement Learning (DRL) [ 5 , 6 ] , present effective solutions to address these challenges. The DRL-based cooperative task offloading strategies can effectively reduce the overload conditions and excessive resource utilisation on individual MEC servers and improve long-term computational efficiency. To this end, synchronous DRL-based methods [ 5 ] focus on having all DRL agents collaborate to train and update simultaneously, thereby enhancing training stability. However, due to varying spatiotemporal computational task demands [ 7 ] , task arrivals and requirements for each agent are often imbalanced. For example, some agents may remain constantly busy, while others experience long periods with no task arrivals. This imbalance causes agents to waste considerable time waiting for others to synchronise. On the other hand, asynchronous DRL-based algorithms [ 6 ] reduce communication overhead and training time by allowing each agent to train independently. However, this approach prevents agents from sharing essential information, such as states and actions, during asynchronous training, which overlooks the importance of strong collaboration in cooperative task offloading. To fill the identified gaps, in this paper, we propose a joint latency and energy-efficient Cooperative Task Offloading with Transformer-driven Prediction (CTO-TP) framework, based on asynchronous multi-agent DRL. The main contributions of this paper can be summarized as follows: • We model cooperative task offloading and resource allocation in distributed scenarios as a Markov Decision Process (MDP) to optimise long-term latency and energy consumption, considering the impact of past actions. • We address the problem of dynamic task arrivals and requirements by adapting offline-trained transformer models tailored to predict future task arrival times and resource demands for each MEC server. • We present and evaluate against benchmark models a novel hybrid solution backed by Multi-Agent Deep Q Network (MADQN) and Multi-Agent Deep Deterministic Policy Gradient (MADDPG) models, which enables collaborative interaction and asynchronous training, reducing waiting time, improving efficiency, and enhancing resource utilisation. Our approach is supported by an asynchronous multi-agent DRL approach, combining MADQN for discrete server selection and MADDPG for continuous offloading and resource allocation. The remainder of the paper is organised as follows. Section II describes the system model and problem formulation. Section III details the latency and energy-efficient CTO-TP framework based on the asynchronous hybrid MADQN-MADDPG. The performance evaluation is discussed in Section IV followed by conclusions and future work in Section V . II System Model In this section, we discuss our system model and problem formulation. As shown in Fig. 1 , a cooperative MEC network comprising M MEC servers with asynchronous task request arrival is considered, where each base station is equipped with a MEC server and is connected to other base stations by fibre links so that tasks can be migrated to other MEC servers for collaborative processing. The task arrivals at each MEC server are asynchronous, i.e., the task arrival time is independent across different MEC servers. This asynchrony reflects the real-world scenario where task requests are influenced by service users’ activities, leading to imbalanced and heterogeneous task distribution among MEC servers. II-A Communication Model In the considered cooperative MEC environment, MEC servers communicate with each other to share computational resources effectively and process tasks collaboratively. This will result in optimising computational resource utilisation to minimise overall system latency. Each MEC server, associated with a base station, can offload tasks to other cooperative MEC servers through existing fibre links. This inter-MEC communication will alleviate processing overhead by distributing the computational workload across multiple servers. The communication model involves data transmission between local MEC servers and cooperative MEC servers. According to [ 8 ] , data

Read the complete text