Noise-Resilient Quantum Reinforcement Learning
Jing-Ci Yue, Jun-Hong An · 2025
Read Noise-Resilient Quantum Reinforcement Learning by Jing-Ci Yue, Jun-Hong An (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20601.txt.
Introduction
Quantum learning agents promise sharper choices, but real quantum gear is noisy and noise scrambles their work. Jing-Ci Yue and Jun-Hong An propose a noise-tough scheme in work from twenty twenty-five. Their test case is a two-level quantum agent that must find the low states of its link with its world.
Noise that fades and returns, not plain fading, drives the test. When a bound state forms in the joint energy range of agent plus noise, the learning score climbs back to the noiseless level. The team frames that bound state as a broad shield against fading, not a trick for one setup. Their result gives design rules for learning tools on today's noisy quantum gear.
Catalog record
| CREATOR | Jing-Ci Yue, Jun-Hong An |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-20601
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Noise-Resilient Quantum Reinforcement Learning Jing-Ci Yue, Jun-Hong An Abstract As a branch of quantum machine learning, quantum reinforcement learning (QRL) aims to solve complex sequential decision-making problems more efficiently and effectively than its classical counterpart by exploiting quantum resources. However, in the noisy intermediate-scale quantum (NISQ) era, its realization is challenged by the ubiquitous noise-induced decoherence. Here, we propose a noise-resilient QRL scheme for a quantum eigensolver. By investigating the non-Markovian decoherence effect on the QRL for solving the eigen states of a two-level system as an agent, we find that the formation of a bound state in the energy spectrum of the total agent-noise system restores the QRL performance to that in the noiseless case. Providing a universal physical mechanism to suppress the decoherence effect in quantum machine learning, our result lays the foundation for designing the NISQ algorithms and offers a guideline for their practical implementation. I Introduction The rapid development of quantum technologies and artificial intelligence raises an important question: What would happen if we combine machine learning and quantum physics? The answer is a revolution in algorithms. Running specific algorithms on quantum devices enables quantum machine learning to solve data processing, pattern recognition, and optimization problems more powerfully than its classical machine learning by exploiting quantum effects Huang et al. 2021 ; Cerezo et al. 2022 ; Banchi et al. 2021 . One of the primary types of quantum machine learning is quantum reinforcement learning (QRL), which distinguishes itself from others, such as supervised Innocenti et al. 2020 ; Liu et al. 2021 ; Havlíček et al. 2019 ; Wu et al. 2019 ; Schuld and Killoran 2019 ; Mitarai et al. 2018 ; Schuld et al. 2020 ; Pérez-Salinas et al. 2020 and unsupervised Benedetti et al. 2016 ; Benedetti et al. 2019 ; Amin et al. 2018 ; Torlai et al. 2023 ; Huang et al. 2022 ; Yu and Deng 2021 ; Rocchetto et al. 2018 quantum machine learning, in being able to find an optimal policy in a high-efficiency manner via evaluating the mapping from states to actions without labeled data Dong et al. 2008 ; Dunjko et al. 2016 ; Albarrán-Arriagada et al. 2018 ; Paparo et al. 2014 ; Yu et al. 2019 . QRL can solve the difficulty faced by classical reinforcement learning that the dimension of the action space grows exponentially with the complexity of the task Dong et al. 2008 , which is dubbed the curse of dimensionality. QRL, in turn, promotes the development of quantum technologies. Its significant capabilities have been demonstrated in quantum control Bukov et al. 2018 ; Guo et al. 2021 ; An et al. 2021 , quantum state transfer Zhang et al. 2018 , quantum communication Wallnöfer et al. 2020 , and quantum sensing Xu et al. 2019 ; Schuff et al. 2020 ; Xu et al. 2025 . Figure 1: (a) QRL protocol. (b) Mean fidelity F^{(k)} and (c) mean exploration parameter W^{(k)} as a function of the iteration times k in different values of (r,p) for \tau=15.65\omega_{0}^{-1} . (d) F^{(k)} and (e) W^{(k)} as a function of the interaction time \tau in different values of (r,p) for k=100 . We use N=1000 . Despite these substantial progresses, the practical implementation of quantum algorithms on near-term quantum devices is still challenged by the decoherence caused by different kinds of noises in the quantum world. This is an important feature of the noisy intermediate-scale quantum (NISQ) era Bharti et al. 2022a ; Preskill 2018 ; Bharti et al. 2022b . The inherent fragility of the quantum effects under decoherence has been shown to pose a severe obstacle to achieving the full potential of quantum technologies Pirmoradian and Mølmer 2019 ; Barra 2019 ; Albarelli and Demkowicz-Dobrzański 2022 ; Górecki et al. 2022 ; Gonzalez-Tudela et al. 2011 . In terms of quantum algorithms, noise-induced decoherence also degrades the performance of various quantum algorithms Azuma 2002 ; Marconi et al. 2022 ; Stenberg et al. 2016 ; Wang et al. 2021 ; Chen and Lidar 2020 ; Albash and Lidar 2015 ; Egger et al. 2023 ; Olivera-Atencio et al. 2023 ; Sun 2024 ; Deng et al. 2013 . Typical examples include the barren plateau phenomenon Wang et al. 2021 , where decoherence causes the gradients of the objective function in variational quantum algorithms to vanish exponentially with increasing system size, and the deformation of the ground state in adiabatic quantum computation Deng et al. 2013 , where decoherence induces a loss of fidelity of the ground state and the calculation failure. Decoherence also causes the degradation of the obtained fidelity of QRL Olivera-Atencio et al. 2023 . Many strategies have been designed to overcome the detrimental effects of decoherence on NISQ algorithms, including the hybrid quantum-classical approach Peruzzo et al. 2014 , dynamical decoupling van der Sar et al. 2012 , quantum error mitigation Temme et al. 2017 ; Sagastizabal et al. 2019 ; McClean et al. 2017 and correction Botsinis et al. 2016 , adding ancillas Liao et al. 2023 , NISQ reservoir computing Hu et al. 2024 , and quantum neural network Nguyen et al. 2020 . However, all of the above works are exclusively based on the Born-Markov approximation to describe the decoherence. Given the essential differences of the non-Markovian dynamics from the Born-Markov approximate one Breuer et al. 2016 , this description is obviously insufficient to reveal the intrinsic robustness of quantum algorithms to decoherence. It has been found that the non-Markovian effect can be harnessed as an effective resource to enhance the resistance of different quantum technologies against decoherence Camati et al. 2020 ; Luchnikov et al. 2020 ; Bai et al. 2019 . Hence, how to develop a noise-resistant QRL scheme under non-Markovian decoherence remains an open question. In this Letter, via investigating the noise-induced decoherence on the two-level system as the agent of the QRL, we propose a noise-immune QRL scheme for a quantum eigensolver. In sharp contrast to one’s general belief that the performance of the QRL is deteriorated by the decoherence under the Born-Markov approximation, we discover a physical mechanism in preserving the ideal performance of the QRL in the exact non-Markovian dynamics. Our analysis reveals that it is due to the formation of a bound state in the energy spectrum of the total system consisting of the agent and the noise. Supplying a useful method to overcome the destructive impact of decoherence on the QRL, our result paves the way for its practical realization and application. II Noiseless QRL A QRL generally comprises an agent and an environment [see Fig. 1 (a)]. The agent is a controllable quantum system in an input state |\psi(0)\rangle . The environment acts as a black box that interacts with the agent for a duration of time \tau . Its effect is described by an evolution operator \hat{U}_{\tau}=e^{-i\hat{H}\tau/\hbar} acting on |\psi(0)\rangle , where \hat{H} is an unknown Hamiltonian whose eigenstates are under determined Albarrán-Arriagada et al. 2020 ; Olivera-Atencio et al. 2023 . For explicitness, we restrict our analysis to a two-level system with the bare basis \{|0\rangle,|1\rangle\} and the unknown Hamiltonian ( \hbar=1 ) \hat{H}=\frac{\omega_{0}}{2}(\ket{+}\bra{+}-\ket{-}\bra{-}), (1) where \omega_{0} is a constant with frequency dimension and