Data Scheduling Algorithm for Scalable and Efficient IoT Sensing in Cloud Computing
Noor Islam S. Mohammadcor1 · 2025
Read Data Scheduling Algorithm for Scalable and Efficient IoT Sensing in Cloud Computing by Noor Islam S. Mohammadcor1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04334.txt.
Introduction
The author presents a 2025 plan for scheduling sensor data tasks in cloud systems that serve the Internet of Things. Swarms of devices pour out vast, mixed data streams, and the cloud must meet limits on delay, energy, and service grade. Older methods adapt poorly when loads and network states shift fast.
The plan joins a learning agent with an ant-colony search method. The agent learns task placement from live states, while the colony search spreads load and cuts crowding across cloud nodes. In large tests on made-up data, the mix cut response time and energy use and raised resource use against past methods.
Catalog record
| CREATOR | Noor Islam S. Mohammadcor1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-04334
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data Scheduling Algorithm for Scalable and Efficient IoT Sensing in Cloud Computing Noor Islam S. Mohammadcor1 Abstract The rapid growth of Internet of Things (IoT) devices produces massive, heterogeneous data streams, demanding scalable and efficient scheduling in cloud environments to meet latency, energy, and Quality-of-Service (QoS) requirements. Existing scheduling methods often lack adaptability to dynamic workloads and network variability inherent in IoT-cloud systems. This paper presents a novel hybrid scheduling algorithm combining deep Reinforcement Learning (RL) and Ant Colony Optimization (ACO) to address these challenges. The deep RL agent utilizes a model-free policy-gradient approach to learn adaptive task allocation policies responsive to real-time workload fluctuations and network states. Simultaneously, the ACO metaheuristic conducts a global combinatorial search to optimize resource distribution, mitigate congestion, and balance load across distributed cloud nodes. Extensive experiments on large-scale synthetic IoT datasets, reflecting diverse workloads and QoS constraints, demonstrate that the proposed method achieves up to 18.4% reduction in average response time, 12.7% improvement in resource utilization, and 9.3% decrease in energy consumption compared to leading heuristics and RL-only baselines. Moreover, the algorithm ensures strict Service Level Agreement (SLA) compliance through deadline-aware scheduling and dynamic prioritization. The results confirm the effectiveness of integrating model-free RL with swarm intelligence for scalable, energy-efficient IoT data scheduling, offering a promising approach for next-generation IoT-cloud platforms. [ orcid=0009-0007-8823-6681 ] keywords IoT Data Scheduling ,Cloud Computing ,Reinforcement Learning (RL) ,Ant Colony Optimization (ACO) ,Hybrid Optimization Algorithms ,Data Locality ,Heterogeneous Distributed Systems ,QoS Optimization † † titlenote: Department of Computer Science, New York University, 6 MetroTech Center, Brooklyn, NY 11201, USA. † † corresponding: Corresponding author: Noor Islam S. Mohammad ([email protected]) 1 Introduction The proliferation of Internet of Things (IoT) systems has led to an unprecedented surge in data generation, necessitating scalable and latency-aware computing infrastructures within cloud and grid computing environments [ 1 , 2 ] . Traditional IoT cloud architectures are typically characterized by tightly coupled compute and storage components managed under centralized control. However, such designs struggle to accommodate the extreme heterogeneity, dynamic workload fluctuations, and stringent latency constraints inherent in modern large-scale, data-intensive IoT deployments [ 3 , 4 ] . These limitations often manifest as scalability bottlenecks, network congestion, and high operational overhead, particularly in geographically distributed or resource-constrained settings. We proposed to enhance data reliability and parallel processing capabilities of IoT clusters, which commonly adopt redundant storage strategies and replicate data blocks across multiple nodes. This approach enables local task execution; tasks are processed on nodes that host the required data, thus improving efficiency through reduced transmission latency. However, recent trends toward disaggregated cloud architectures, where compute and storage resources are decoupled and connected via ultra-high-speed interconnects [ 5 , 6 , 7 ] , offer promising flexibility. These architectures support independent resource scaling, modular upgrades, and hardware heterogeneity, making them well-suited for complex IoT environments. However, they also introduce critical challenges related to non-local data execution and increased data movement across the network. Given the immense volume of real-time sensing data, network infrastructure often becomes a performance bottleneck due to bandwidth constraints and communication latency [ 8 , 9 ] . The emerging computing and processing IoT frameworks increasingly adopt data-parallel processing paradigms that co-locate computation with data at the node level. Data block placement aligns task execution with data locality; these systems minimize network load and improve resource utilization [ 10 , 11 ] . Convergent, realizing efficient task-to-data affinity in heterogeneous IoT clusters is highly non-trivial. Nodes differ significantly in computational capabilities, memory hierarchies, and I/O throughput data placement. Moreover, workloads are dynamic and unpredictable, with variations in task arrival rates, contention for shared resources, and energy constraints—further complicating scheduling decisions. Distributed file systems such as the Hadoop Distributed File System (HDFS) [ 12 , 13 ] , widely used in IoT infrastructures, replicate data blocks to improve fault tolerance and availability. However, this replication introduces a combinatorial explosion in task-to-node scheduling choices. Resource contention, naive heuristics, and static placement strategies can lead to degraded data locality and suboptimal system performance. Existing schedulers often rely on hierarchical locality models for execution on local or same-rack nodes. While effective in homogeneous environments, these models neglect node-specific capabilities in heterogeneous clusters, leading to severe load imbalance and scheduling inefficiencies [ 14 , 15 ] . This paper proposes a novel challenge and a context-aware, reinforcement learning-driven scheduling framework tailored for heterogeneous IoT clusters. The proposed framework, Sensor Cloud Computing and Data Scheduling Optimization (SCC-DSO), jointly considers data placement topology, node-level resource heterogeneity, and workload dynamics to optimize task-to-node mapping [ 16 ] . The SCC-DSO formulates scheduling as a constrained min–max optimization problem aimed at minimizing makespan while maximizing data locality, subject to node capacity and network bandwidth constraints. A kernel-based regression model predicts task execution times using node and workload features, capturing complex non-linear relationships [ 17 , 18 ] . SCC-DSO incorporates a metaheuristic strategy that fuses reinforcement learning with ant colony optimization to navigate the high-dimensional scheduling space. The proposed framework is designed for next-generation IoT applications that demand ultra-low latency, high reliability, and scalable resource utilization. These include mission-critical domains such as autonomous driving, industrial robotics, and environmental sensing. SCC-DSO aims to deliver robust performance across dynamic, distributed IoT-cloud infrastructures by enabling intelligent, adaptive scheduling in real-time [ 19 , 20 ] . The primary contributions of this work are a way to go there: (i). We propose a novel integration of reinforcement learning (RL) and metaheuristic optimization to enable adaptive, heterogeneity-aware task allocation in IoT cloud environments, enhancing scheduling efficiency under dynamic workloads. (ii). We formulate a constrained min-max optimization model that jointly maximizes data locality and minimizes execution latency, addressing the challenges of resource heterogeneity and stringent latency requirements in IoT-cloud systems. (iii). We develop an RL-guided ant colony optimization (ACO) mechanism that facilitates adaptive task migration and predictive data prefetching, ensuring robust performance in highly dynamic and unpredictable workload scenarios. (iv). We validate the SCC-DSO framework through extensive experiments on a 100-node heterogeneous cluster, achieving up to 22.4% reduction in execution time, 93.1% data locality, and significant throughput improvements compared to state-of-the-art baselines, demonstrating its scalability, efficiency, and robustness for latency-sensitive IoT cloud applications [ 21 , 22 ] . 2 Related Work The paper emphasized that in data placement optimization and computing execution, efficient data scheduling and resource optimization in heterogeneous Internet of Things (IoT) clusters remain central challenges in scalable edge–cloud computing. Moreover, various approaches have emerged to address these issues, particularly in the context of execution latency, energy efficiency, and resource heterogeneity. This section reviews key contributions across three primary dimensions: predictive task scheduling, data placement strategies, and energy-aware orchestration. Predictive Scheduling Models: One widely studied technique is the Reservation First-Fit with Feedback Distribution (RF-FD) model [ 23 ] , which utilizes multiple linear regression to estimate job completion times based on historical execution patterns. While RF-FD performs well in semi-homogeneous clusters, its linear modeling lacks flexibility in handling node-level variability and non-linear workload dynamics. In contrast, RSYNC [ 24 ] employs a log-based synchronization mechanism to maintain consistency across fog nodes under fluctuating data streams. Although RSYNC is effective for sequential synchronization, it suffers from throughput degradation in high-load, heterogeneous environments. Autonomic frameworks