Pauli Network Circuit Synthesis with Reinforcement Learning
Ayushi Dubal †, David Kremer †, Simon Martiel, Victor Villar, Derek Wang, Juan Cruz-Benito · 2025
Read Pauli Network Circuit Synthesis with Reinforcement Learning by Ayushi Dubal †, David Kremer †, Simon Martiel, Victor Villar, Derek Wang, Juan Cruz-Benito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14448.txt.
Introduction
Ayushi Dubal and co-authors teach a learning system to shrink quantum circuits in a 2025 paper. Quantum programs built from Pauli rotations and Clifford gates often carry more two-qubit gates than the math needs, and each extra gate adds noise on real hardware.
Their method squashes each block of a circuit into a compact code, then lets a reinforcement learning agent rebuild it step by step under the machine's wiring limits. On random six-qubit tests it cut two-qubit gates by more than half compared with top heuristic tools, in under ten milliseconds per circuit. Plugged into the Qiskit compiler, it trimmed gate counts and depth by about a fifth on a standard benchmark.
Catalog record
| CREATOR | Ayushi Dubal †, David Kremer †, Simon Martiel, Victor Villar, Derek Wang, Juan Cruz-Benito |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14448
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pauli Network Circuit Synthesis with Reinforcement Learning Ayushi Dubal †, David Kremer †, Simon Martiel, Victor Villar, Derek Wang, Juan Cruz-Benito Abstract We introduce a Reinforcement Learning (RL)-based method for re-synthesis of quantum circuits containing arbitrary Pauli rotations alongside Clifford operations. By collapsing each sub-block to a compact representation and then synthesizing it step-by-step through a learned heuristic, we obtain circuits that are both shorter and compliant with hardware connectivity constraints. We find that the method is fast enough and good enough to work as an optimization procedure: in direct comparisons on 6-qubit random Pauli Networks against state-of-the-art heuristic methods, our RL approach yields over 2× reduction in two-qubit gate count, while executing in under 10 milliseconds per circuit. We further integrate the method into a collect-and-re-synthesize pipeline, applied as a Qiskit transpiler pass, where we observe average improvements of 20% in two-qubit gate count and depth—reaching up to 60% for many instances—across the Benchpress benchmark. These results highlight the potential of RL-driven synthesis to significantly improve circuit quality in realistic, large-scale quantum transpilation workloads. 2 2 footnotetext: These authors contributed equally to this work. I Introduction Efficient transpiling of quantum circuits is required to bridge the gap between abstract quantum algorithms and practical implementation. Quantum circuit optimization is a central topic in quantum computing, especially for current quantum devices that suffer from relatively high gate error rates and limited qubit connectivity. The task of reducing the number of gates, especially expensive multi-qubit gates, and shortening circuit depth is crucial for mitigating the accumulation of errors, thus improving the fidelity of quantum algorithms. Modern quantum compilers, or “transpilers,” such as Qiskit javadi2024quantum employ a wide range of techniques to systematically reduce circuit size and adhere to hardware constraints such as limited qubit connectivity. Achieving global transpiling optimality for large circuits is widely recognized to be infeasible due to the exponential growth of the search space ge2024quantum ; karuppasamy2025comprehensive . Consequently, local optimizations, where a circuit is decomposed into smaller blocks and each is optimized individually, have emerged as a practical strategy weiden2022widequantumcircuitoptimization ; Sivarajah_2021 . A common way to perform the optimization of the sub-circuits in each block is to just collapse the circuit into some representation (e.g. unitary matrix, Clifford tableau, etc…) and then perform re-synthesis of the operation Clark_2024 ; liu2020relaxedpeepholeoptimizationnovel . This can be done at different stages of the transpilation. One could, for instance, do this before the routing stage, obtaining better opportunities for optimization on the “pure” circuit but risking larger overhead after routing. One could also do this after the routing stage, where the circuit is already mapped to hardware connectivity and “scrambled”, but where any improvements directly translate to improvements in the final circuit li2022paulihedral ; Jin:2023mil . In this work, we focus on the post-routing scenario. This post-routing re-synthesis approach has the advantage of potentially reaching optimal implementations for each sub-circuit, but for practical application to large circuits it requires the re-synthesis method to fulfill the following: • Implement the exact unitary of the original sub-circuit so that it can replace it. • Preserve the coupling map, so that there is no further need of routing. • Be “optimal enough” so that for each re-synthesized block there is a reasonable chance that it will improve the original sub-circuit. • Be “fast enough” that it can be ran for many blocks in the circuit. In earlier work kremer2024practical , it was shown how these requirements can be satisfied with a Reinforcement Learning (RL)-based approach for Clifford blocks up to 10 qubits, enabling the local optimization of larger circuits through sub-block re-synthesis. However, this earlier method restricted attention to purely Clifford blocks, omitting possible gains from incorporating more general operations. Here, we extend this result to the re-synthesis of Pauli Networks up to 6 qubits, allowing the collected blocks to contain a combination of Clifford operations and Pauli rotations. This enables the optimization of arbitrary (unitary) blocks, potentially containing unbound parametric rotations, and allows peephole optimizations that are not possible when only collecting Clifford blocks. As described in kremer2024practical , the RL method performs the synthesis step-by-step by selecting the most adequate gate at each step through a learned heuristic. We find that, as in the case of purely Clifford blocks, it is possible for the RL model to learn a good heuristic for Pauli Network blocks that achieves short circuits with very high success rate while also following a coupling map. There is extensive work on heuristic algorithms for Clifford circuit synthesis with and without connectivity restrictions bravyi2021clifford ; debrugière2022graphstate , optimal databases of Clifford circuits Bravyi_2022 , and methods for encoding Clifford synthesis as a SAT problem peham2023depthoptimalsynthesiscliffordcircuits ; Schneider_2023 . However, these methods are limited to Clifford circuits, and cannot perform optimization accross non-Clifford gates. For synthesis of Pauli rotations, Rustiq debrugière2024faster provides strong results for two-qubit gate count and depth synthesis for full connectivity, and potentially scales to hundreds of qubits, but it does not accommodate for connectivity restrictions and does not efficiently implement the overall Clifford operator. Other methods such as Mukhopadhyay_2023 perform synthesis of sequences of rotations, but focus on the fault tolerant case and optimize the number of non-Clifford gates. Although the re-synthesis of full unitary circuits is possible with methods such as approximate compiling madden2021bestapproximatequantumcompiling , these methods scale poorly, do not implement the exact unitary (even if they may get arbitrarily close) and cannot handle parametric rotations. Our approach marks the first non-approximate peephole optimization approach applicable to a universal class of circuits (Clifford + single-qubit rotations), including parametrized circuits containing unbound parameters. We validate our method’s performance in two ways. First, we benchmark the RL-based synthesis against state-of-the-art heuristics (including Qiskit javadi2024quantum and Rustiq debrugière2024faster ) on up to 6-qubit random Pauli Networks. We observe meaningful reductions of 50% on average in gate count and circuit depth once routing overheads are taken into account. Second, we incorporate the approach into a collect-and-re-synthesize procedure for full-circuit optimization, and run it as a post-transpilation optimization pass on the Benchpress benchmark nation2024benchmarking . Our results show an average improvement of 20% in two-qubit gate count and depth on average across the benchmark, reaching up to 40%-60% for a meaningful number of cases. The remainder of this paper is organized as follows. In Methods, we detail how we adapted the RL synthesis procedure from kremer2024practical to handle Pauli Network blocks, and describe the overall collect-and-re-synthesis pipeline as a Qiskit-compatible transpiler pass. In Results, we present the outcomes of two primary benchmarks: one focusing on direct synthesis of random 6-qubit Pauli Networks, and another illustrating the end-to-end improvement in the Benchpress benchmark. Finally, in Conclusion, we discuss our findings and potential future avenues, such as scaling to larger sub-circuits and exploring different collection strategies. II METHODS II.1 RL-based circuit synthesis In this work, we follow the RL synthesis method described in kremer2024practical , with some modifications to accommodate the properties of the problem. At the core of the algorithm, we define a neural network that takes a representation of the state (here, a Pauli Network) and generates a distribution over all possible gate choices. The set of possible gates can be anything as long as it can generate the