Reinforcement Learning Controlled Adaptive PSO for Task Offloading in IIoT Edge Computing
Minod Perera, Sheik Mohammad Mostakim Fattah, Sajib Mistry, Aneesh Krishna · 2025
Read Reinforcement Learning Controlled Adaptive PSO for Task Offloading in IIoT Edge Computing by Minod Perera, Sheik Mohammad Mostakim Fattah, Sajib Mistry, Aneesh Krishna (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15203.txt.
Introduction
Minod Perera, Mostakim Fattah, Sajib Mistry, and Aneesh Krishna tackle task placement for factory devices linked to nearby edge servers. Their paper is from two thousand twenty-five. Factory sensors and machines make heavy data loads that need fast replies. Sending each task to the right place is a hard puzzle that changes over time.
Their method mixes two ideas. A swarm search, modeled on how particles drift toward good spots, proposes placements. A learning agent then tunes the search as conditions shift, such as when people interact with the system. This blend aims to cut delays and spread work fairly across servers. The authors report better resource use and service quality than with fixed rules.
Catalog record
| CREATOR | Minod Perera, Sheik Mohammad Mostakim Fattah, Sajib Mistry, Aneesh Krishna |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15203
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reinforcement Learning Controlled Adaptive PSO for Task Offloading in IIoT Edge Computing Minod Perera, Sheik Mohammad Mostakim Fattah, Sajib Mistry, Aneesh Krishna Abstract Industrial Internet of Things (IIoT) applications demand efficient task offloading to handle heavy data loads with minimal latency. Mobile Edge Computing (MEC) brings computation closer to devices to reduce latency and server load, optimal performance requires advanced optimization techniques. We propose a novel solution combining Adaptive Particle Swarm Optimization (APSO) with Reinforcement Learning, specifically Soft Actor Critic (SAC), to enhance task offloading decisions in MEC environments. This hybrid approach leverages swarm intelligence and predictive models to adapt to dynamic variables such as human interactions and environmental changes. Our method improves resource management and service quality, achieving optimal task offloading and resource distribution in IIoT edge computing. I Introduction The advent of 5G networks has intensified the transmission of large data volumes, including high-definition videos, augmented reality (AR), and virtual reality (VR), all demand low latency, high bandwidth, and reliable connections. Processing this data at the network’s central core introduces latency issues for time-sensitive tasks. Mobile Edge Computing (MEC) [ 1 ] mitigates this by offloading compute-intensive tasks to proximate servers, reducing latency and server load. However, mobile devices often lack the processing power to fully utilize this capability. Fig. 1: Environment of Smart Factory In Industrial Internet of Things (IIoT) environments such as smart factories [Fig. 1 ], efficient task offloading is crucial to enhance the production processes through data collection and analysis. Selecting the optimal MEC server for task offloading is a complex problem influenced by factors such as server processing capabilities, current load, and environmental changes. Traditional methods like always choosing the nearest server are suboptimal. Particle Swarm Optimization (PSO) has been shown to be effective for task offloading in relatively static environments but struggles as the number of servers and devices increases. Reinforcement Learning (RL) algorithms, particularly in dynamic environments, offer promising solutions. This paper proposes a novel approach that integrates Soft Actor Critic (SAC), a type of RL algorithm, with Adaptive Particle Swarm Optimization (APSO) to enhance task offloading efficiency in MEC for IIoT environments. II Related Work Mobile Edge Computing (MEC) addresses the limitations of centralized cloud computing by distributing computational workloads closer to data sources, reducing latency and server strain in IoT environments. The role of MEC in enhancing cloud and IoT systems is discussed in [ 2 ] . Energy efficiency in task offloading is improved using differential evolution, as shown in [ 3 ] . Particle Swarm Optimization (PSO) has been applied effectively to task offloading due to its simplicity and efficiency. Energy-efficient service allocation in fog computing using PSO and other meta-heuristics is presented in [ 4 ] . PSO is demonstrated to outperform genetic algorithms and simulated annealing in reducing energy consumption and latency in multi-user, multi-server IIoT environments in [ 5 ] . Further optimizations of PSO for IIoT task offloading achieve reduced latency and energy consumption, as described in [ 6 ] . Reinforcement Learning (RL) has also been employed to manage dynamic resource allocation in MEC. The application of Deep Deterministic Policy Gradient (DDPG) to minimize task delay in IoT systems is detailed in [ 7 ] . An RL-based approach for UAV-assisted task offloading effectively handles high-dimensional state and action spaces, as proposed in [ 8 ] . However, these RL methods may not be optimal for IIoT environments with mostly static device and server placements. This work combines the strengths of PSO and RL to improve task offloading in MEC for IIoT environments. By integrating Soft Actor Critic (SAC) with Adaptive PSO, the limitations of both methods are addressed, enhancing efficiency in scenarios with known search spaces and static placements. III Methodology We propose a novel approach that integrates Adaptive Particle Swarm Optimization (APSO) with Soft Actor Critic (SAC) reinforcement learning to enhance task offloading decisions in MEC environments. Particle Swarm Optimization (PSO) is a population-based optimization algorithm inspired by the social behavior of flocks of birds or schools of fish. Particles represent potential solutions and adjust their positions based on personal and global best experiences. Each generated particle, i , at any time-step t , represents a solution to the given problem and has four characteristics, its position (x_{i}(t)) , velocity (v_{i}(t)) , personal-best solution (pbest) , and current fitness (f(x^{t}_{i})) . \displaystyle v_{i}(t+1)=w_{t}*v_{i}(t)+c^{1}_{t}*U(a,b)(pbest_{i}(t)-x_{i}(t)) (1) \displaystyle+c^{2}_{t}*U(a,b)(gbest(t)-x_{i}(t)) Equation 1 showcases how PSO performs a simulation step. Each particle’s position, i.e. the solution, is updated using their respective velocity vector. This process is repeated until a termination criterion is met, in general a number of iterations is chosen, and in our case 50 iterations will be the threshold be termination occurs. PSO is effective in static environment’s, but its performance degrades in dynamic scenarios due to fixed hyperparameters ( c^{1}_{t},c^{2}_{t},\And w(t) ). To overcome this limitation, Adaptive-PSO (APSO) dynamically adjusts the PSO hyperparameters during the optimization process to enhance exploration and exploitation capabilities. The concept of Adaptive Particle Swarm Optimization (APSO) was introduced as an extension to PSO, enhancing the algorithm with a mechanism to dynamically change its hyperparameters during the optimization process [ 9 ] . The Evolutionary Factor, which reflects the swarm’s distribution state, enables transitions between Convergence, Exploitation, Exploration, and Jumping Out states. This dynamic adjustment allows APSO to gradually shift between these states, optimizing hyperparameters more effectively to achieve the optimal result. However, APSO relies on problem-specific adaptation strategies, requiring extensive domain knowledge and manual tuning. We enhance base PSO to mimic APSO, by integrating Soft Actor Critic (SAC), an off-policy reinforcement learning algorithm that optimizes a stochastic policy by maximizing expected reward while encouraging exploration through entropy regularization. SAC balances exploration and exploitation by adjusting the policy based on both the reward and the entropy of actions, and was chosen for it’s insensitivity to hyper-parameter tuning, allowing the algorithm to be used without fine tuning and extensive domain knowledge requirements. \displaystyle\pi^{*}=\arg\max_{\pi}\mathbb{E}_{\tau\sim\pi}\Bigg[\sum_{t=0}^{\infty}\gamma^{t}\Big(R(s_{t},a_{t},s_{t+1}) (2) \displaystyle+\alpha H(\pi(\cdot|s_{t}))\Big)\Bigg] where: • R(s_{t},a_{t},s_{t+1}) is the reward for taking action a_{t} in state s_{t} , • \gamma is the discount factor, • H(\pi(\cdot|s_{t}))=\mathbb{E}_{a\sim\pi(\cdot|s_{t})}[-\log\pi(a|s_{t})] is the entropy of the policy at state s_{t} , • \alpha is the entropy coefficient, which controls the trade-off between exploration and exploitation. Equation 2 shows the objective function in SAC, which combines the expected reward with an entropy bonus, promoting exploration by favoring more diverse actions. In our approach, SAC is used to adaptively fine-tune the hyperparameters of PSO in response to environmental changes. The SAC agent observes the performance of PSO and adjusts the acceleration coefficient parameters to improve convergence and adaptability. This integration allows the system to handle dynamic variables and scaling in IIoT environments without manual intervention. The State-Value Function V^{\pi}(s) , which is a measure of the expected return or the cumulative reward the agent can achieve in a given state s , includes the entropy bonus at each timestep. \displaystyle V^{\pi}(s)=\mathbb{E}_{\tau\sim\pi}\Bigg[\sum_{t=0}^{\infty}\gamma^{t}\Bigg(R(s_{t},a_{t},s_{t+1}) (3) \displaystyle+\alpha H(\pi(\cdot|s_{t}))\Bigg)\Bigg|s_{0}=s\Bigg] The State-Action Value Function allows the agent to make decision on choosing what actions to follow in a given state s , by measuring the expected return from taking a specific action a , while continuing to follow the policy \pi afterward. By combining SAC with APSO, our method leverages the