Entanglement Request Scheduling in Quantum Networks Using Deep Q-Network
Gongyu Ni 1 , Lester Ho 1 , Holger Claussen 1 2 3 · 2025
Read Entanglement Request Scheduling in Quantum Networks Using Deep Q-Network by Gongyu Ni 1 , Lester Ho 1 , Holger Claussen 1 2 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12461.txt.
Introduction
Gongyu Ni, Lester Ho, and Holger Claussen schedule entanglement requests in quantum networks with a learning agent in this 2025 paper. Future quantum networks must link pairs of nodes on demand. Each slot, a scheduler picks which pairs to entangle. The rest wait in a queue for later slots. Past work used simple chance models for the hardware. Simulators also ignored queues, pending jobs, and dropped requests.
The team built a dynamic network model covering those behaviors. On it, a deep Q-network learns the scheduling policy. Delay and fairness between users are the twin goals. Real deployments need exactly this network-level view. The paper bridges quantum hardware models and network practice. It is a systems paper for quantum networking.
Catalog record
| CREATOR | Gongyu Ni 1 , Lester Ho 1 , Holger Claussen 1 2 3 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-12461
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Entanglement Request Scheduling in Quantum Networks Using Deep Q-Network Gongyu Ni 1 , Lester Ho 1 , Holger Claussen 1 2 3 Abstract In this paper, a novel Deep Q-Network ( DQN ) based scheduling method to optimize delay time and fairness among entanglement requests in quantum repeater networks is proposed. The scheduling of requests determines which pairs of end nodes should be entangled during the current time slot, while other pairs are placed in a queue for future slots. However, existing research on quantum networking often relies on simple statistical models to capture the behavior of quantum hardware, such as the failure rate of establishing entanglement. Moreover, current quantum simulators do not support network behaviors, including handling, pending, and dropping requests. To bridge the gap between quantum deployments and network behaviors, in this paper a dynamic network model is presented, encompassing quantum simulations, random topologies, and user modeling. The DQN based scheduling scheme allows us to balance the conflicting objectives of minimizing delay time and maximizing fairness among these entanglement requests. The proposed technique was evaluated using simulations, with results showing that the proposed DQN achieves higher performance compared to Greedy, Proportional fair and FIFO scheduling schemes. Emails: {gongyu.ni, lester.ho, holger.claussen}@tyndall.ie I Introduction Quantum networks enhance communication technology by transmitting and manipulating of qubits between remote locations [ 1 ] . Qubits in quantum network can be sent through a wave guide such as optical fibers, or through free space [ 2 ] . Recent research in the long-distance transmission of quantum information are almost done via optical fibers due to relatively low absorption, decoherence and fairly easily detection [ 3 ] . Applications of quantum networks include detecting eavesdropping in Quantum Key Distribution ( QKD ) [ 4 ] , distributed quantum computing [ 5 ] and distributed quantum sensing [ 6 ] . To establish a quantum network capable of transmitting quantum information between two end nodes, a fundamental step is to create entanglement between them [ 7 ] . Entanglement, which is the correlation between remote qubits, can be established between two end nodes by consuming entangled pairs. Due to the no-cloning theorem [ 8 ] in quantum mechanics, qubits cannot be copied. To extend the potential range of entanglement beyond the maximum distance between interconnected quantum nodes, repeaters are utilized [ 9 ] . The field of quantum networks is still in its early stages, with even single-hop communications presenting significant challenges. A known feature of entanglement is that it is inherently fragile and has a probability of failure. Therefore, a challenge arises in the network layer: determining which pairs of end nodes can be serviced within the current time slot, while others are queued for subsequent time slots. This issue is known as request scheduling in quantum networking. Within this area, researchers are actively investigating entanglement requests scheduling methods within quantum networks. In [ 10 ] , the authors apply deep reinforcement learning methods to allocate quantum channels for accommodating multiple entanglement requests. However, the success rates of qubit entanglement and qubit swapping within the input states of the models are not considered. In [ 11 ] , the authors integrate a quantum simulator with network simulation to investigate scheduling methods for entanglement requests. Some of the trade-offs involved between efficiency and fairness of different scheduling policies were highlighted. However, there is still a need for exploring scheduling methods that balance the trade-offs involved in scheduling decisions and further evaluation in this area, particular using more user-centric performance metrics. In this paper, we present a Deep Q-Network (DQN) framework applied to quantum network entanglement request scheduling that considers the request delay and fairness. The DQN framework is evaluated using a system model framework that encompasses quantum behavior and network simulation, showing its flexibility to train schedulers that manages the trade-offs between the delay and fairness. II System Model To capture quantum behaviors, such as fidelity, entangled pair generation, and noise in quantum channels, a quantum simulation framework is developed. The NetSquid quantum simulator [ 12 ] is employed to generate distributions of fidelity and the time required to complete the entanglement of quantum links. For the network layer, a time slot simulation is used to extract features of network behavior, including the queuing, execution, and dropping of requests. In brief, the number of entanglement requests are assigned dynamically with random source and destination nodes using a time slot simulation. Lookup tables are then employed to assign the quantum behavior involved in generating, transmitting, and measuring the entangled pairs. These lookup tables are derived from quantum simulations to obtain fidelity and the time required to complete the entanglement process between two end nodes. II-A Quantum Model A Bell pair, which is a pair of entangled qubits, |\Phi\rangle shown in the Equation ( 1 ) are generated in the quantum source. Once qubit A is measured, the state of qubit B can be determined based on the measurement result of qubit A . |\Phi\rangle=\frac{1}{\sqrt{2}}\left(|0\rangle_{A}|0\rangle_{B}+|1\rangle_{A}|1\rangle_{B}\right) (1) To quantify whether the entanglement is successful or not, fidelity [ 13 ] F is used to calculate the difference between the density matrix \rho of the state that receive at the node and expected state |\psi\rangle . F(|\psi\rangle,\rho)=\langle\psi|\rho|\psi\rangle (2) In two-node entanglement, Bell pairs are generated by quantum sources at one end node. Therefore, one of the qubits from bell pair is sent to the other end node. The fidelity of the entanglement between the two nodes is then calculated and recorded based on the measurement results obtained from both nodes. In long distance entanglement, distance-dependent losses in the channel becomes a limitation, and quantum repeaters are utilized to perform entanglement swapping. Entanglement swapping involves combining two short-distance Bell pairs to create a single longer-distance Bell pair [ 2 ] . In the node chain, as shown in Fig. 1 , entanglement swapping and correction processes involve three main steps: First, the intermediate node generates entanglement with its adjacent neighbors. Second, the intermediate node performs a swap operation using a projective measurement. Finally, the outcomes of this measurement are transmitted through a classical channel to the end node, which then uses an appropriate sequence of X and Z gates to make corrections to the local qubit at the end node. Fig. 1: Components of establishing entanglement in a node chain. To simplify the model, the physical deployment of repeaters is treated the same as end nodes and structure the quantum model to consist of nodes and channels. Within the nodes, physical models are implemented, including entangled pair generation, entanglement swapping, Bell state measurement, and correction. Entanglement swapping is implemented at the intermediate node and correction operations at the destination node. By comparing the obtained state with the expected state, the fidelity of this node chain entanglement is calculated. Apart from entanglement swapping and correction, the configuration for nodes and channels are the same for both two-node and node-chain entanglement. The specific configurations are described below. First, the quantum source that generates Bell pairs randomly samples both the correct state and the wrong state to replicate a source fidelity of 0.9 . Second, each node contains one quantum processor, which includes quantum memories and physical instructions. Third, for the error model,