QAS-QTNs: Curriculum Reinforcement Learning-Driven Quantum Architecture Search for Quantum Tensor Networks

Siddhant Dutta 1 , Nouhaila Innan 2,3 , Sadok Ben Yahia 4,5 , Muhammad Shafique 2,3 · 2025

Read QAS-QTNs: Curriculum Reinforcement Learning-Driven Quantum Architecture Search for Quantum Tensor Networks by Siddhant Dutta 1 , Nouhaila Innan 2,3 , Sadok Ben Yahia 4,5 , Muhammad Shafique 2,3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12013.txt.

Introduction

Siddhant Dutta and co-authors automate the design of quantum tensor networks in a paper from 2025. Quantum architecture search seeks the best circuit layout for a task without hand design. Their framework uses reinforcement learning with a staged curriculum.

Agents start with shallow, simple circuits and face harder ones step by step. Four classic learning methods were matched against quantum-enhanced versions of the same methods. All were boosted by a replay system that revisits the most useful past tries. The setup targets variational circuits, whose settings are tuned during training. Staged learning should help agents stay stable as circuits grow. The work aids tools that design quantum software on their own.

Catalog record

CREATORSiddhant Dutta 1 , Nouhaila Innan 2,3 , Sadok Ben Yahia 4,5 , Muhammad Shafique 2,3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-12013

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

QAS-QTNs: Curriculum Reinforcement Learning-Driven Quantum Architecture Search for Quantum Tensor Networks Siddhant Dutta 1 , Nouhaila Innan 2,3 , Sadok Ben Yahia 4,5 , Muhammad Shafique 2,3 Abstract Quantum Architecture Search (QAS) is an emerging field aimed at automating the design of quantum circuits for optimal performance. This paper introduces a novel QAS framework employing hybrid quantum reinforcement learning with quantum curriculum learning strategies, enabling learning agents to tackle increasingly complex quantum circuit design tasks. We benchmark four state-of-the-art classical reinforcement learning algorithms (A2C, PPO, DDQN, TD3) against their quantum-enhanced counterparts (QA2C, QPPO, QDDQN, QTD3) for optimizing variational quantum circuits (VQCs). Our approach progressively increases circuit depth and gate complexity during training, leveraging parameterized quantum circuits as function approximations. To improve learning efficiency and stability, all algorithms, both classical and quantum, are augmented with Prioritized Experience Replay (PER). Experimental results show that quantum-enhanced RL significantly outperforms classical methods. In a 2-qubit environment, PERQDDQN achieves a success probability of 0.46 with 3,000 optimal successes, surpassing classical PERDDQN (0.42, 2,400). In the more complex 3-qubit setting, PERQDDQN and PERQTD3 reach success probabilities of 0.47, with optimal success counts of 3,800 and 3,600, respectively, outperforming their classical counterparts. Additionally, we apply our QAS-QTN approach to a classification problem, where the optimized quantum circuit achieves an accuracy of 90.33%, outperforming quantum models consisting of random ansatz. This hybrid classical-quantum approach leads to faster convergence and more efficient quantum circuit designs, demonstrating its potential for advancing automated quantum architecture search. I Introduction Advances in variational quantum computing underscore the need for effective methods to design and optimize quantum circuits, as circuit performance directly impacts the success of quantum algorithms. Quantum Architecture Search (QAS) addresses this challenge by automating the search for optimal quantum circuit designs [ du2022quantum , kuo2021quantum ] . Traditional methods, such as manual or heuristic approaches, often fail to scale with the increasing complexity of quantum systems. Leveraging automated techniques like Deep Reinforcement Learning (DRL), QAS explores vast search spaces to enhance circuit designs for emerging quantum hardware. Quantum Tensor Networks (QTNs) have emerged as a powerful tool in quantum computing [ haghshenas2022variational ] , particularly for applications in quantum machine learning. QTNs offer an efficient way to represent and manipulate high-dimensional quantum states by decomposing complex states into simpler, lower-dimensional tensors. This decomposition makes it easier to simulate and compute quantum systems, as tensor networks can capture the entanglement structure and correlations inherent in quantum states—essential elements for efficient computation. With tensor networks, any quantum state can be represented as a network of tensors, where the bond dimension controls the expressibility and complexity of the state [ biamonte2019lectures ] . One of the key features of QTNs is their ability to represent any quantum state as a tensor network, with the bond dimension controlling the complexity and expressibility of the state. These tensor networks like Matrix Product State (MPS) and Tree-like Tensor Network (TTN) break down a quantum state into smaller, more manageable components, making it easier to simulate and manipulate, particularly for high-dimensional or strongly correlated systems [ ORUS2014117 , Huggins_2019 ] . DRL has become a cornerstone technique in optimizing quantum circuits, particularly in the context of Quantum Architecture Search [ fosel2021quantum ] . In DRL, an agent learns to make decisions through trial and error, receiving feedback in the form of rewards or penalties based on its actions. In the quantum domain, this is used to train models that improve quantum circuit designs iteratively. Classical RL techniques such as Q-learning, Actor-Critic, and Proximal Policy Optimization (PPO) have been adapted for quantum problems, where the state space is typically vast, and the environment is governed by quantum mechanical principles [ zhu2023quantum , liu2023quantum ] . DRL-based automation helps design quantum circuits by guiding the search for optimal circuit structures that minimize error rates and maximize fidelity in quantum computations [ ostaszewski2021reinforcement ] . The advantage of DRL lies in its ability to adapt to complex quantum systems by continually improving circuit architectures based on feedback, making it particularly suitable for tackling the challenges posed by Noisy Intermediate-Scale Quantum (NISQ) devices [ preskill2018quantum ] . Hybrid Quantum Reinforcement Learning (QRL) with quantum techniques has recently shown the potential to improve the efficiency and performance of the agent’s optimal decision-making capability. These approaches often involve adapting classical Reinforcement Learning (RL) methods like Double Deep Q-Network (DDQN) to quantum systems [ dutta2024qadqn ] . This capability is further enhanced when coupled with quantum curriculum learning, where the complexity of the quantum tasks gradually increases, allowing the learning agent to build progressively more sophisticated circuit designs [ tran2024quantum ] . In this paper, we address the challenges of optimizing quantum circuits using QAS and propose a novel framework that integrates DRL and quantum curriculum learning. We focus on automating the design of Variational Quantum Circuits (VQCs) using QTNs, where traditional circuit design methods struggle with scalability and complexity, particularly in NISQ devices. Our contributions are: • We propose the QAS-QTN framework that automates the design of quantum circuits by leveraging quantum deep reinforcement learning and quantum curriculum learning. This framework significantly reduces manual effort in the design process by systematically exploring design spaces. • We evaluate several hybrid classical-quantum approaches that integrate classical RL algorithms with quantum-enhanced variants to optimize quantum circuit architectures, aiming to enhance their performance on NISQ devices. • We automate the incremental learning process through quantum curriculum learning, gradually increasing the task complexity, and allowing the model to handle increasingly challenging quantum circuit optimization tasks. • We demonstrate the effectiveness of our quantum approach by applying it to a real-world dataset, where the QAS-QTN optimized quantum circuit model achieves an accuracy of 90.33%, outperforming quantum models consisting of random ansatz. The structure of the paper is as follows: Sec. II provides the preliminaries and reviews related work. Sec. III outlines the problem formulation and methodology in Sec. III-A , detailing the Curriculum Learning-based QAS-QTN framework in Sec. . In Sec. , the experimental setup is presented in Sec. , and the simulation results with comparisons are discussed in Sec. . Finally, Sec. offers concluding remarks and discusses potential open challenges for future research. II Preliminaries and Related Work II-A Quantum Architecture Search QAS aims to automate the design of quantum circuits through optimization techniques. Early work primarily employed classical optimization methods, such as Genetic Algorithms (GA) and Simulated Annealing (SA), to search through the quantum circuit design space [ lu2023qas ] . These methods optimize the parameterized quantum circuit by minimizing a loss function defined as: \mathcal{L}(\theta)=\|U(\theta)|\psi\rangle-|\psi_{\text{target}}\rangle\|^{2}, (1) where U(\theta) represents the parameterized quantum circuit, |\psi\rangle is the quantum state produced by the circuit, and |\psi_{\text{target}}\rangle is the target state. This loss function quantifies the difference between the quantum state and the target state, which is minimized during optimization. II-B Reinforcement Learning In recent years, RL has been applied to QAS, where the quantum circuit design is viewed as a sequential decision-making problem. In this approach, the agent learns to optimize quantum circuit parameters by maximizing a reward function based on the performance of the quantum circuit [ sun2023differentiable , altmann2023challenges ] . The reward function can be expressed as: R(\theta)=\text{Tr}\left(\rho(\theta)\hat{O}\right), (2) where \rho(\theta) is the quantum state produced

Read the complete text