The pros and cons of using deep reinforcement learning or genetic algorithms to design control schemes for quantum state transfer on qubit chains
Sofía Perón Santana (1) (2), Ariel Fiuri (1), Martín Domínguez (1), Omar Osenda (1) (2) · 2026
Read The pros and cons of using deep reinforcement learning or genetic algorithms to design control schemes for quantum state transfer on qubit chains by Sofía Perón Santana (1) (2), Ariel Fiuri (1), Martín Domínguez (1), Omar Osenda (1) (2) (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06303.txt.
Introduction
Moving a quantum state along a chain of qubits must be fast, before decoherence spoils it. Sofía Perón Santana and 3 co-authors compare two control design methods for that task in a 2026 paper. External control pulses, applied step by step, force the chain's evolution toward the target.
One approach uses a genetic algorithm, evolving candidate control sequences toward better performance. The other uses a reinforcement learning variant that learns a control policy. The genetic algorithm matched the learning method's short transmission times and surpassed its fidelity. Under noisy pulses, however, the learned policies proved more robust. The authors map the regimes where each method suits the job best, giving practitioners a practical guide.
Catalog record
| CREATOR | Sofía Perón Santana (1) (2), Ariel Fiuri (1), Martín Domínguez (1), Omar Osenda (1) (2) |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-06303
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The pros and cons of using deep reinforcement learning or genetic algorithms to design control schemes for quantum state transfer on qubit chains Sofía Perón Santana (1) (2), Ariel Fiuri (1), Martín Domínguez (1), Omar Osenda (1) (2) Abstract In recent years, control methods based on different optimization techniques have shed light on the possibilities of processing information in many quantum systems. When exploring the transmission of quantum states, faster transmission times are mandatory to avoid the deleterious effects of multiple sources of decoherence that spoil the transmission process. In particular, using Reinforcement Learning to devise sequences of step-wise external controls provides good transfer policies at short transmission times. We present two approaches to control the transmission of quantum states in qubit chains using external controls to force the dynamical evolution of the chain state. The first approach relies on the well-known Genetic Algorithm to generate a sequence of external controls, while the second approach uses a variant of Reinforcement Learning. The Genetic algorithm achieves excellent transmission fidelity at as short transmission times as Reinforcement Learning, surpassing the fidelities achieved by the latter method. Nevertheless, the Reinforcement Learning method offers robust control policies when the control pulses are noisy enough, owing to an imperfect timing of the pulses, deficient control devices, or other sources of phase decoherence. We present the regime where each method is best suited to control the transmission of arbitrary qubit states. I Introduction Controlling the time evolution of the quantum state 6 ; 50 ; 37 is the fulcrum on which quantum technologies, such as computing 7 , quantum state transfer 20 ; 1 ; 68 ; 47 ; 9 , state preparation 51 , and cryptography, operate. The exquisite level of control needed to perform quantum algorithms that provide sensible answers is, at present, beyond the accuracy levels required to perform large-scale calculations, although the frontier between what is doable and not is moving by the day. Optimal Control Theory is a method commonly employed to construct external control pulses for quantum 59 ; 40 and classical systems, owing to its high accuracy and clear physical interpretation, which is grounded in the variational principle. Nevertheless, its use is far from direct, and when the number of actuators increases, the numerical cost can become prohibitive. There is a growing demand for methods that provide control policies for the increasing number of platforms where quantum information is processed 6 ; 50 ; 37 . From the design of control pulses for single-quantum gates to the control of shallow quantum circuits 38 , other machine learning methods are being developed or adapted for quantum systems 67 ; 45 ; 33 ; 28 . In the long run, controlling open quantum demands methods resilient against decoherence and, ideally, faulty implementations of the control pulses 57 ; 24 ; 44 . This goal suggests that those control methods that rely on variable environments to train an agent should be up to the task. Reinforcement learning methods naturally incorporate the described ingredients. The numerous implementations available for studying a given problem should allow choosing the most appropriate Reinforcement Learning version for the investigation at hand 26 ; 53 ; 34 . Regrettably, there is a lot of trial and error to overcome before gaining insight into which traits of a given version of the Reinforcement Learning method are indispensable and which are superfluous 6 ; 50 ; 39 ; 37 ; 41 . Among many problems, reinforcement learning methods allow the preparation of random pure states in systems of up to seven qubits using different control sets 41 , enhance the transmission of quantum states in qubit chains, and improve the performance of quantum gates. Although the transmission of quantum states achieved using Reinforcement Learning with Deep Q-Networks with an \epsilon greedy policy for short to moderate qubit chain lengths is not of a remarkable quality 67 . Nevertheless, it shows that Reinforcement Learning could provide control sequences compatible with fast transmission. Training reinforcement Learning models without noise or some disturbances does not result in a well-trained model 54 ; 58 . Indeed, for an open quantum system or one with faulty controls, training with noise is a matter of using it as an advantage, a problem, and transforming it into an opportunity. A trained model provides robust control sequences for a broad spectrum of situations 19 ; 55 , assuming the training included a large set of possibilities. Otherwise, faced with a slightly different problem, the model will not provide a sensible answer. On the other hand, in general, Genetic Algorithms 31 work best for systems without fluctuations and provide very good to excellent solutions to problems when a given quantity needs to be optimised. In most situations, the resulting controls fail when used on systems with fluctuations or faulty implementations. Qubit chains with site-dependent interactions, designed using the Genetic Algorithm (GA), have demonstrated excellent transmission performance 45 ; 33 ; 5 ; 36 ; 13 . The preparation of particular sets of quantum states using GA is possible. All in all, there is an increasing field of applications. In the most common cases analysed using the Genetic Algorithm, the setting results in tuning the parameters of a time-independent Hamiltonian. Nevertheless, more recently, the design of control pulses has been considered. In this work, we aim to compare the performance of both the Genetic Algorithm and the Reinforcement Algorithm when applied to the problem of transmitting quantum states over homogeneous qubit chains. The study of quantum state transfer with 61 ; 29 ; 1 ; 68 ; 42 ; 60 and without external controls 48 ; 32 ; 56 ; 49 ; 11 ; 15 ; 43 ; 52 , using qubit chains with site-dependent interactions 25 ; 45 ; 16 ; 69 or homogeneous ones 21 , has led to numerous protocols verified in different experimental setups, such as optical systems 10 ; 4 , superconducting qubit processors 27 , magnetic systems 66 ; 8 ; 65 , cold atoms 28 ; 3 , quantum dot-based qubit chains 62 ; 64 ; 14 ; 22 ; 30 and others 63 . As such, quantum state transfer is one of the tasks instrumental for assessing the utility and reach of every control technique 23 . GA is best suited for problems without fluctuations, whereas DRL algorithms find their best applications in problems with fluctuating environments. In situations with fluctuating environments, it is possible to validate the trained model 19 ; 55 . Even starting the physical system under study in the same initial state results in different answers, which, for a properly trained model, would produce high-quality quantum state transfer. So, using an appropriate noise model, we can compare the performance of control sequences designed using both types of algorithms to drive quantum state transfer in qubit chains. It makes sense to study the generation of control sequences and their properties first without fluctuations, for both types of algorithms, and then with fluctuations, paying attention to the appearance of new phenomena. We organised the paper as follows. In Section II , we present the qubit chain model Hamiltonian and details about the algorithms employed in the paper. Section III contains