Importance sampling for data-driven decoding of quantum error-correcting codes
Evan Peters · 2025
Read Importance sampling for data-driven decoding of quantum error-correcting codes by Evan Peters (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22741.txt.
Introduction
Evan Peters explains why teaching machines to decode error correcting codes from data is trickier than it looks, in a 2025 paper. Such decoders read damage patterns and infer the original message. Their training data has odd traits that standard learning handles badly.
Peters shows the task equals a noisy classification job with lopsided classes. A popular trick, training on data with extra errors, trades class balance against label noise. Guided by that theory, neural decoders trained at higher error rates improved clearly. Heuristics help pick the best training error level. The analysis extends to quantum codes with repeated checks. Better decoders matter for real quantum hardware.
Catalog record
| CREATOR | Evan Peters |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-22741
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Importance sampling for data-driven decoding of quantum error-correcting codes Evan Peters Abstract Data-driven decoding ( DDD \DDD ) – learning to decode syndromes of (quantum) error-correcting codes by learning from data – can be a difficult problem due to several atypical and poorly understood properties of the training data. We introduce a theory of example importance that clarifies these unusual aspects of DDD \DDD : For instance, we show that DDD \DDD of a simple error-correcting code is equivalent to a noisy, imbalanced binary classification problem. We show that an existing importance sampling technique of training neural decoders on data generated with higher error rates introduces a tradeoff between class imbalance and label noise. We apply this technique to show robust improvements in the accuracy of neural network decoders trained on syndromes sampled at higher error rates, and provide heuristic arguments for finding an optimal error rate for training data. We extend these analyses to decoding quantum codes involving multiple rounds of syndrome measurements, suggesting broad applicability of both example importance and turning the knob for improving experimentally relevant data-driven decoders. 1 Introduction Data-driven decoding for error-correcting codes poses a peculiar learning problem: You might run a large error correction experiment to generate millions of decoding examples, only to find that most of these training data are useless. Regardless, you push ahead and manage to train a neural network that achieves 99.99% test accuracy, but later realize that this is strikingly bad performance for the task at hand. The challenge for neural decoders – algorithms that learn how to map syndromes of a (quantum) error-correcting code into correction operations to restore the encoded information – is that most syndromes correspond to low-weight errors, which existing baseline decoders can easily handle. To be useful, a neural decoder must outperform baseline decoders for syndromes that might appear once (or never) in a large training dataset. Despite this, neural decoders are demonstrably better than state-of-the-art baseline decoders in some classical and quantum error correction experiments [ 6 , 32 , 21 , 15 , 37 , 56 ] . Data-driven decoding therefore deserves special attention to better understand its peculiarities and design techniques to further improve neural decoders. In this work, we first formalize data-driven decoding ( \DDD ), the problem of learning to decode from training examples. We develop a theory of example importance that explains challenges that are seemingly unique to \DDD in terms of more standard machine learning phenomena. This theory motivates a rarely used data augmentation technique for improving neural decoders: turning the knob to increase the dataset error rate. We argue that the mechanism behind this technique is to generate additional important examples and that in a simple decoding problem this technique results in a tradeoff between label noise and class imbalance. Fig. 1 depicts example importance in training data and how/when turning the knob improves accuracy for \DDD of a classical repetition code. After characterizing \DDD for a simple decoding problem, we show that these empirical observations hold for more complex decoding problems involving quantum error-correcting codes (QECCs). We provide empirical evidence that this technique robustly improves decoders for multiple rounds of syndrome measurement. We show that multiple rounds of decoding with a single logical qubit is formally equivalent to an imbalanced, binary classification problem, and we propose a heuristic for finding a good error rate for generating training data. The broad applicability of both sample importance and turning the knob suggests room for improvements in both our theoretical understanding and experimental implementations of neural decoders. Figure 1: (left) Important examples in the repetition code have weight close to n/2 , and are much rarer than unimportant examples. Turning the knob increases a training dataset’s support on both important examples and bad examples . An example error distribution p_{E}[p=0.15,\alpha=0.33] with n=22 is mostly supported on unimportant errors that are correctly decoded by a minimum-weight baseline decoder. The dashed line shows that the training distribution p_{E}[\beta p,\alpha] has greater support on important examples after turning the knob . (right) Turning the knob robustly improves neural decoder performance. Each point (dash) represents the best (median) test error from 150 repetition code \DDD experiments per \beta with N=2000 and different initializations and hyperparameters, for three different architectures ( \sim 4000 neural decoders total). Shading denotes IQ range and \star denotes outperforming a lookup table on the training dataset. The vertical red line predicts when turning the knob becomes harmful (Eq. 8 ), resulting in a “U”-shaped graph of logical error probability vs \beta . 2 Decoding quantum error-correcting codes While promising, quantum computers are prone to failure due to device imperfections, thermal noise, and spurious coupling with their environment. It is widely accepted that useful quantum computing will require error correction, which involves encoding relatively fragile quantum information into a higher-dimensional system that is more robust to errors. We focus on stabilizer QECCs: Let \hat{\mathcal{P}}_{n}:=\langle\{I,X,Y,Z\}^{\otimes n}\rangle/\{\pm I,\pm iI\} be the n -qubit Pauli group mod phase, and define the weight \wt(e) of e\in\hat{\mathcal{P}}_{n} to be the number of non-identity terms in e . An [[n,k,d]] stabilizer code defines a partitioning of \hat{\mathcal{P}}_{n} into \mathcal{L}\times\mathcal{S}\times\mathcal{T} , where \mathcal{S} denotes the stabilizer group generated by n-k commuting elements of \hat{\mathcal{P}}_{n} with -I\notin\mathcal{S} , \mathcal{L} is the centralizer (mod \{\pm I,\pm iI\} ) of \mathcal{S} with \min_{x\in\mathcal{L}:x\neq I}\wt(x):=d , and \mathcal{T} is the span of n-k destabilizer generators each anticommuting with exactly one generator of \mathcal{S} . Thus, |\mathcal{L}|=2^{2k} , |\mathcal{S}|=|\mathcal{T}|=2^{n-k} , and every e\in\hat{\mathcal{P}}_{n} is uniquely written e=\ell(e)s(e)t(e) for \ell(e)\in\mathcal{L} , s(e)\in\mathcal{S} , and t(e)\in\mathcal{T} . See Appendix A for additional background. In the context of stabilizer codes, an error in a quantum device can be modeled by sampling an operator e\in\hat{\mathcal{P}}_{n} from some distribution of errors p_{E}:\hat{\mathcal{P}}_{n}\rightarrow\mathbb{R}^{+} . The error’s syndrome \sigma(e)\in\{0,1\}^{n-k} is a bitstring description for t(e) that can be determined via measurements. A characteristic of QECCs is that the errors in \mathcal{S} do not affect the encoded quantum information, so \ell(e) is the only salient component of e . Thus, the goal of degenerate decoding of a QECC is to determine \ell(e) given \sigma . However, for some codes (e.g. classical codes) the more relevant task of non-degenerate decoding is to determine e given \sigma . If we denote a set of labels as \mathcal{Y} , then for degenerate decoding \mathcal{Y}=\{0,1\}^{2k} specifies all possible values of y(e):=\ell(e)\in\mathcal{L} , for nondegenerate decoding \mathcal{Y}=\{0,1\}^{2n} specifies possible errors y(e)=e\in\hat{\mathcal{P}}_{n} , and for classical codes \mathcal{Y}=\{0,1\}^{n} is sufficient to represent bitflip errors in \langle\{I,X\}^{\otimes n}\rangle . Either way, we write the conditional distribution of y(e) given \sigma(e) induced by p_{E} as p_{Y|\Sigma} . A maximum likelihood decoder ( \MLD ) is any function that outputs the most likely value for y given \sigma , and does either degenerate or non-degenerate decoding depending on the context. The \MLD may not be unique; for each code and p_{E} we denote a fixed choice of \MLD by f^{*} satisfying \displaystyle f^{*}(\sigma) \displaystyle\in\argmax_{y\in\mathcal{Y}}p_{Y|\Sigma}(y|\sigma). (1) 2.1 Data-driven decoding We can now formalize data-driven decoding ( \DDD ) as a learning problem. An instance of \DDD is specified by a particular code along with a dataset D_{N} of N examples , i.e. (syndrome, label) pairs (\sigma,y) . Each label