Reinforcement Learning for Fast and Robust Longitudinal Qubit Readout
Yiming Yu, Yuan Qiu, Xinyu Zhao, Ye-Hong Chen, Yan Xia · 2026
Read Reinforcement Learning for Fast and Robust Longitudinal Qubit Readout by Yiming Yu, Yuan Qiu, Xinyu Zhao, Ye-Hong Chen, Yan Xia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18060.txt.
Introduction
Yu and co-authors use reinforcement learning to design fast, robust longitudinal qubit readout pulses. Longitudinal coupling suits quantum nondemolition readout, but hardware caps coupling and photon counts. Their method shapes an auxiliary path with cubic B-splines, built on shortcuts to adiabaticity. At a fixed short readout time, the pulse beats the baseline signal-to-noise ratio by about 50%. The flat-top pulse also holds up well when parameters drift.
Catalog record
| CREATOR | Yiming Yu, Yuan Qiu, Xinyu Zhao, Ye-Hong Chen, Yan Xia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42467 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.18060
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reinforcement Learning for Fast and Robust Longitudinal Qubit Readout Yiming Yu, Yuan Qiu, Xinyu Zhao, Ye-Hong Chen, Yan Xia Abstract Longitudinal coupling offers a compelling pathway for quantum nondemolition (QND) readout, but pulse design is constrained by hardware limitations such as the coupling strength and the photon number required to stay within the linear regime. We develop a reinforcement learning framework to optimize the longitudinal coupling waveform under such constraints. Building upon the theoretical foundation of shortcuts to adiabaticity (STA), we parameterize an auxiliary trajectory with cubic B-splines and reconstruct the physical control. At a fixed short readout time, the optimized pulse converges to a constraint saturating flat-top protocol and yields a approximately 50 % 50\% improvement in SNR \mathrm{SNR} over an STA baseline, while exhibiting enhanced robustness to parameter drifts. Simulation results demonstrate the efficacy of reinforcement learning in optimizing longitudinal readout pulses. The optimized protocol attains substantial performance gains and yields smooth, hardware-compatible waveforms governed by an interpretable “saturate-and-hold” mechanism. I INTRODUCTION Fast, high-fidelity, single-shot readout is a prerequisite for scalable quantum information processing, particularly for implementing quantum error correction and measurement-based feedback 51 ; 20 . In quantum electrodynamics (QED), dispersive readout provides the canonical route to quantum nondemolition (QND) measurement 4 ; 56 ; 35 ; 3 ; 49 ; 21 ; 53 . By operating in the large-detuning regime, the qubit imparts a state-dependent shift to the resonator frequency; this response is subsequently extracted via homodyne detection of the cavity field. However, dispersive readout is constrained by a trade-off between faster signal-to-noise ratio (SNR) acquisition and the suppression of measurement-induced qubit transitions 28 ; 55 ; 47 ; 42 ; 27 ; 57 . In particular, increasing the drive strength to improve the SNR often excites the system beyond the critical photon number, leading to non-adiabatic transitions that compromise the QND nature of the measurement 6 ; 11 . To overcome the above limitation, longitudinal readout has been proposed as a promising alternative 25 ; 46 . Specifically, longitudinal readout relies on a \sigma_{z} qubit–resonator interaction. Its coupling strength acts as a state dependent drive that displaces the cavity field, thereby encoding the qubit state into the amplitude of the output field 25 ; 9 . In the ideal limit, this interaction constitutes a QND measurement because it commutes with the qubit Hamiltonian, enabling faster information extraction with relaxed bandwidth constraints compared to dispersive readout 37 ; 35 . Recent advances 59 ; 19 ; 58 ; 8 ; 54 ; 29 ; 10 have solidified this paradigm. In particular, the quarton coupler demonstrates ultrafast, purcell-free readout enabled by potential engineering 59 . A unified Floquet framework reveals the intrinsic link between longitudinal and dispersive mechanisms through the driven qubit’s AC Stark response, and clarifies how longitudinal modulation can offer faster, more QND-like signal extraction 19 . Realizing the full potential of longitudinal readout requires precise pulse engineering 54 ; 31 ; 44 . Numerical optimal control methods, such as GRAPE 33 and Krotov 45 method, offer the flexibility to explore broad parameter spaces. However, enforcing multiple simultaneous rigid constraints remains challenging for gradient-based optimal control. In particular, strict saturation bounds on the coupling strength impose rigid amplitude limits on the control field 40 ; 39 . In addition, upper bounds on the instantaneous intracavity photon number make the optimization landscape highly nonconvex, which often leads to poor convergence or experimentally infeasible pulses. Reinforcement learning (RL) has recently emerged as a powerful tool for quantum control, capable of optimizing nonconvex objectives under rigid constraints 5 ; 26 ; 36 ; 50 ; 38 ; 1 . However, in pulse-shaping problems the action space is extremely complex 41 ; 52 . Without a structured exploration space, the agent often expends many updates on unphysical or hardware-infeasible waveforms, leading to slow convergence and unstable training. In practice, RL needs a physics-based starting point (and a constrained parameterization) so that exploration stays inside the feasible region from the beginning. In this work, we employ RL to optimize longitudinal readout pulses based on a single mode effective model. Building on shortcuts to adiabaticity (STA) and inverse engineering 8 ; 30 ; 16 ; 18 ; 15 ; 60 ; 32 ; 43 ; 16 , we start from an STA-derived analytical seed pulse 7 . This inverse-engineering parameterization guarantees smooth boundary conditions by construction 14 , enabling the agent to focus exclusively on shaping the pulse to maximize the SNR. Coupled with the physics-based initialization, this focused exploration drastically reduces the number of training iterations required to reach convergence. Our optimization framework utilizes Proximal Policy Optimization (PPO) 48 to search for feasible pulse shapes, integrating hardware constraints directly into the control loop. Our simulation results compare the proposed approach with (i) an STA-only baseline 8 and (ii) an RL baseline without a physics-based initialization. The proposed method achieves higher final SNR and improved robustness to parameter drift, highlighting the benefit of combining RL with a physically grounded starting point. We further test all methods under several hardware constraint settings (e.g., different limits on the coupling amplitude and the intracavity photon number). Across these settings, our approach consistently achieves the best SNR while remaining within the allowed operating range. II Effective model and control parameterization II.1 Inverse Engineering Control Model for Longitudinal Readout A QED system consisting of a qubit coupled to a single-mode readout resonator is considered 2 ; 24 ; 34 . To achieve fast and high-fidelity readout, the longitudinal coupling mechanism is utilized, which employs the computational basis states of qubit to directly drive the displacement of the resonator field. Upon truncating the qubit to its lowest two energy levels ( \{|g\rangle,|e\rangle\} ), the system Hamiltonian is given by: H(t)=\omega_{r}\hat{a}^{\dagger}\hat{a}+\frac{\omega_{q}}{2}\sigma_{z}+g_{z}(t)\,\sigma_{z}\,(\hat{a}+\hat{a}^{\dagger}), (1) where \hat{a} ( \hat{a}^{\dagger} ) is the annihilation (creation) operator of the resonator mode with frequency \omega_{r} , \omega_{q} is the qubit transition frequency, \sigma_{z} is the Pauli- Z operator, and g_{z}(t) represents the time-dependent physical longitudinal coupling strength. The physical model illustrate in the Fig. 1 (a). This effective Hamiltonian can be physically realized in superconducting circuit architectures by employing Josephson-junction-based couplers 46 ; 25 . Figure 1: Schematic of the physics-based reinforcement learning framework for optimizing longitudinal qubit readout. (a) Physical implementation of the longitudinal readout. A qubit (central sphere) is coupled to a resonator mode with frequency \omega_{r} via a time-dependent longitudinal interaction g_{z}(t)\sigma_{z}(\hat{a}+\hat{a}^{\dagger}) . Depending on the qubit state |e\rangle (red) or |g\rangle (blue), the cavity field is displaced to symmetric conditional pointer states +\alpha and -\alpha in the phase space, spanned by the expectation value of the annihilation operator \langle\hat{a}\rangle . (b) The closed-loop optimization control flow. The PPO agent outputs a set of coefficients \mathbf{c}=\{c_{k}\} to construct the auxiliary control trajectory g_{c}(t) using cubic B-spline basis functions B_{k}(x) . The physical control pulse g_{z}(t) is then derived via inverse engineering constraints to ensure smooth boundary conditions. The system performance is evaluated to generate a reward R , which maximizes the signal-to-noise ratio (SNR) at the readout time t_{f} while penalizing physical constraint violations. This Hamiltonian describes a state-dependent displacement of the oscillator. The qubit state determines the trajectory of the cavity field in phase space, creating the separation required for