Elastic Data Transfer Optimization with Hybrid Reinforcement Learning
Rasman Mubtasim Swargo, Md Arifuzzaman · 2025
Read Elastic Data Transfer Optimization with Hybrid Reinforcement Learning by Rasman Mubtasim Swargo, Md Arifuzzaman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06159.txt.
Introduction
Rasman Mubtasim Swargo and Md Arifuzzaman tackle a practical problem in science computing: moving petabytes of data between distant computing clusters. Older tools force users to tune transfer settings by hand or adjust only one setting at a time. Their method adjusts several transfer parameters together to keep data moving fast.
Their system combines heuristic parallelism, continuous pipelining, and a deep reinforcement learning optimizer that sets concurrency. A lightweight network simulator cuts agent training to under four minutes, far faster than training online. In tests across varied datasets, the method beat existing tools, reaching up to nine and a half times higher throughput.
Catalog record
| CREATOR | Rasman Mubtasim Swargo, Md Arifuzzaman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-06159
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Elastic Data Transfer Optimization with Hybrid Reinforcement Learning Rasman Mubtasim Swargo, Md Arifuzzaman Abstract Modern scientific data acquisition generates petabytes of data that must be transferred to geographically distant computing clusters. Conventional tools either rely on preconfigured sessions, which are difficult to tune for users without domain expertise, or they adaptively optimize only concurrency while ignoring other important parameters. We present LDM , an adaptive data transfer method that jointly considers multiple parameters. Our solution incorporates heuristic-based parallelism, infinite pipelining, and a deep reinforcement learning based concurrency optimizer. To make agent training practical, we introduce a lightweight network simulator that reduces training time to less than four minutes and provides a 2750 × 2750\times speedup compared to online training. Experimental evaluation shows that LDM consistently outperforms existing methods across diverse datasets, achieving up to 9.5 × 9.5\times higher throughput compared to state-of-the-art solutions. I Introduction The modern scientific landscape is experiencing a data deluge, driven by advances in instrumentation, sensing technologies, and computational power that generate datasets at an unprecedented scale. This phenomenon, often referred to as “Big Data,” is commonly characterized by three dimensions: immense volume, high velocity of acquisition, and wide variety of data types. Research infrastructures such as high-energy physics experiments, large-scale genomics initiatives, and global sensor networks now routinely produce petabytes of data. For analysis, this data often must be transferred to geographically distant High-Performance Computing (HPC) clusters [ 30 , 20 , 31 , 18 , 26 , 28 , 24 , 25 , 23 , 29 , 27 ] . Moving data at this scale requires extremely high network bandwidth. To address this need, Internet2 has already increased its backbone to 400 Gbps [ 10 ] , and ongoing efforts aim to extend network capacity to the terabit scale [ 6 ] . To maximize the capabilities of modern transfer infrastructures, it is essential to carefully tune a variety of parameters, such as pipelining (transferring multiple files through a single connection) [ 8 , 7 ] , parallelism (transferring one file in parts) [ 15 , 9 , 12 , 19 ] and concurrency (transferring multiple files at a time) [ 14 , 13 , 16 ] . These adjustments can be made entirely at the application layer without altering the underlying transfer protocols, and they play a crucial role in enhancing the overall efficiency and throughput of end-to-end data transfers. Most existing approaches to maximizing bandwidth utilization in high-speed networks rely solely on concurrency. This method can be effective for datasets with uniformly sized medium-to-large files. However, it performs poorly when the dataset contains a few very large files or a large number of small files, since it does not take parallelism or pipelining into account. The key challenge is to design a framework that remains user-friendly, since end users often lack the domain knowledge required to manually tune parameters for optimal performance. Another important consideration is that networks are not static. Bandwidth can fluctuate due to various factors, and a fixed parameter configuration may no longer remain optimal. For this reason, most recent works have modeled the problem as an online optimization task. Hasibul et al. [ 11 ] addressed this problem using deep reinforcement learning. Although the approach is conceptually sound, it is impractical in practice because it requires day-long online training before the agent can be deployed. This paper presents LDM , a novel adaptive data transfer method that considers not only concurrency but also pipelining and parallelism. Parallelism is addressed using a heuristic approach based on file size, while pipelining is implemented as an infinite strategy. Concurrency is optimized through a policy-driven deep reinforcement learning (DRL) agent. To eliminate the impracticality of day-long online training [ 11 ] , we design a lightweight simulator that reduces training time to as little as four minutes. In summary, the major contributions of this work are: • We propose an adaptive multi-parameter framework for maximizing bandwidth utilization during data transfer. Parallelism is determined heuristically, pipelining is implemented as infinite, and concurrency is optimized using a Proximal Policy Optimization (PPO) agent. These three parameters operate transparently, requiring no user expertise. Unlike approaches that rely solely on concurrency, our method generalizes across diverse dataset file-size distributions. • We introduce a lightweight network simulator that emulates data transfer dynamics and enables efficient agent training. This simulator achieves a 2750\times speedup compared to online training. • We demonstrate through extensive experiments that LDM outperforms existing methods across all dataset scenarios, achieving up to 9.5\times higher throughput compared to state-of-the-art solutions. II Related Work & Motivation Trade-off Between Performance and Overhead : Both heuristic and supervised machine learning models estimate parameter values before data transfers begin, using fixed configurations throughout the entire process. This static approach prevents adaptation to changing network conditions during long-running transfers. Additionally, these solutions lack a back-off mechanism, meaning that large parameter values may overwhelm systems in various production environments. For example, if x parallel TCP connections are required to fully utilize the available bandwidth, assigning x connections to every new transfer becomes inefficient when multiple concurrent transfers are initiated. In a scenario with N concurrent transfers, Nx connections would be created, leading to diminished throughput per connection (by a factor of N ), but significantly increased overhead (Figure ). A more efficient alternative would be to allocate fewer connections, say, 10% of x – to each new transfer, under the assumption that overlapping transfers or other processes will compete for I/O resources. For instance, Globus Online, a widely adopted data transfer service, allows tuning of three key parameters: pipelining, parallelism, and concurrency. However, in production environments, system administrators set these values heuristically and often very conservatively to minimize I/O and network contention. While this approach helps balance overhead with resource utilization, it frequently leaves networks underutilized. As a result, static configurations present a dilemma: either prioritize utilization at the cost of high overhead, or reduce overhead and risk underutilizing the network. Long Convergence Time of Adaptive Solutions : Static solutions become suboptimal when the host or network environments deviate from initial assumption; a common occurrence in long-running transfers due to constantly evolving network dynamics. Moreover, these solutions lack an effective back-off mechanism to manage overhead. Ideally, at the start of a transfer, a system should maximize its bandwidth usage, but as new transfers join, existing transfers should release some connections. Similarly, when a transfer finishes, remaining transfers should immediately capture the freed bandwidth. However, to be useful, these solutions must quickly converge to optimal configurations at the beginning of a transfer or whenever network conditions change, minimizing the search time spent in suboptimal states. The convergence speed is directly related to the search space: with N parameters and M possible ranges per parameter, the search space is M^{N} . This exponential growth in the search space with each additional parameter increases convergence time significantly. Stochastic approximation algorithms [ 21 , 32 , esma-tcc , 17 ] offer promising alternatives to static solutions as they can discover optimal parameter configuration in the runtime. However, Existing solutions in this domain fall short to offer practical option due to long convergence time and failure to provide fairness and stability guarantees in shared environments. for example,