Consistency Flow Model Achieves One-step Denoising Error Correction Codes
Haoyu Lei, Chin Wa Lau, Kaiwen Zhou, Nian Guo, Farzan Farnia · 2025
Read Consistency Flow Model Achieves One-step Denoising Error Correction Codes by Haoyu Lei, Chin Wa Lau, Kaiwen Zhou, Nian Guo, Farzan Farnia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01389.txt.
Introduction
Haoyu Lei and co-authors build a fast decoder for error correction codes. Those codes guard digital messages from noise. New diffusion-based decoders are sharp but slow. They need many rounds of sampling to clean a message. That lag hurts low-delay uses.
Their model uses consistency flow to decode in one step. It keeps a transformer core for strength. One-step decoding cuts delay by a large margin. If accuracy holds, the method could serve in fast links like mobile and satellite systems where each delay counts. One-step decoding also cuts energy use per message, which counts for battery-powered links in phones, sensors, and small satellites.
Catalog record
| CREATOR | Haoyu Lei, Chin Wa Lau, Kaiwen Zhou, Nian Guo, Farzan Farnia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-01389
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Consistency Flow Model Achieves One-step Denoising Error Correction Codes Haoyu Lei, Chin Wa Lau, Kaiwen Zhou, Nian Guo, Farzan Farnia Abstract Error Correction Codes (ECC) are fundamental to reliable digital communication, yet designing neural decoders that are both accurate and computationally efficient remains challenging. Recent denoising diffusion decoders with transformer backbones achieve state-of-the-art performance, but their iterative sampling limits practicality in low-latency settings. We introduce the Error Correction Consistency Flow Model (ECCFM) , an architecture-agnostic training framework for high-fidelity one-step decoding. By casting the reverse denoising process as a Probability Flow Ordinary Differential Equation (PF-ODE) and enforcing smoothness through a differential time regularization, ECCFM learns to map noisy signals along the decoding trajectory directly to the original codeword in a single inference step. Across multiple decoding benchmarks, ECCFM attains lower bit-error rates (BER) than autoregressive and diffusion-based baselines, with notable improvements on longer codes, while delivering inference speeds up from 30x to 100x faster than denoising diffusion decoders. 1 Introduction Error Correction Codes (ECC) play a central role in modern digital communications and have been essential in a wide range of applications, including wireless communication and data storage. The core task of an ECC decoder is to recover a message from a received signal corrupted by noise during transmission. Recently, inspired by the great success of deep neural networks in domains such as computer vision [ 17 ] , generative modeling [ 15 , 19 , 45 ] , and natural language processing [ 48 , 3 ] , neural network-based ECC decoders were introduced, which have been shown to be capable of improving the performance scores of conventional, problem-specific algorithms such as Belief Propagation (BP) [ 38 ] and Min-Sum (MS) [ 13 ] . The existing neural decoders can be categorized into two groups. Early model-based approaches [ 29 , 32 , 49 , 11 , 22 ] achieved successful results by integrating neural networks into conventional decoding algorithms. However, their reliance on problem-specific structures can limit their applicability as a general-purpose decoder. To address this limitation and train a general-purpose decoder, model-free decoders enable the extension of a general neural bet architecture without prior knowledge of the decoding algorithm. While the early proposals applying fully connected neural net architectures [ 16 , 4 , 21 ] could lead to overfitting, the preprocessing techniques that utilize magnitude and syndrome vectors [ 1 ] have been effective in reducing the error. These improvements have led to efficient transformer-based decoders [ 7 ] , which leverage the self-attention mechanism to improve the numerical performance on short block codes. The auto-regressive method in transformer-based decoders has been improved in several recent works [ 9 , 10 ] . Notably, the recent work by [ 36 ] integrates cross-attention between magnitude and syndrome, resulting in the state-of-the-art performance in the decoding task. Figure 1: Illustration of our proposed Error Correction Consistency Flow Model (ECCFM). ECCFM learns to map received signals from the trajectories to a single, consistent codeword prediction \mathbf{x}_{0} , represented by a \delta function. In parallel, the remarkable success of diffusion generative models [ 19 , 45 ] across various domains [ 39 , 18 , 27 , 5 , 34 ] has inspired a new direction for deep learning-based ECC. Diffusion models train a noise estimator to gradually denoise a noisy input data and reverse a forward noise manipulation process, generating high-quality samples by an iterative application of a neural net denoiser to an input Gaussian noise. The DDECC method [ 6 ] extends the denoising diffusion framework to ECC, naturally modeling the AWGN channel as a forward diffusion process. In this setup, a time-dependent transformer learns to denoise the received signal iteratively, recovering the original codeword. This framework provides complementary gains over auto-regressive methods and establishes a new state-of-the-art in terms of Bit Error Rates (BER), particularly for long codes and low SNR, due to its iterative refinement denoising process. However, the iterative denoising of DDECC has introduced a new challenge: the multi-step sampling process incurs significant computational overhead and high latency, reducing the practicality of the approach in real-world applications. This motivates the following question: Can a decoder maintain the performance achieved by the denoising diffusion frameworks at a lower latency that meets the latency requirements of several communication settings? In this work, we aim to address this question by proposing Error Correction Consistency Flow Models (ECCFM), an architecture-agnostic training framework designed to construct high-fidelity, one-step denosing decoders. Inspired by recent advances in consistency models [ 42 ] , we formulate the decoding process as a Probability-Flow Ordinary Differential Equation (PF-ODE), which seeks to learn an optimal trajectory from the noisy signal distribution to the clean codeword distribution as shown in Figure 1 . However, a key challenge in the ECC setting is that the noise level cannot be measured by a continuous timestep as in image generation; instead, it is indicated by the sum of syndrome error in [ 8 ] . A direct adaptation of consistency models struggles to learn this highly non-smooth decoding trajectory. To overcome the mentioned challenge, we propose a differential time condition, using a soft-syndrome formulation from [ 24 ] to regularize the reverse ODE process. This ensures the decoding trajectory is smooth for single-step mapping. Building upon this theoretical foundation, the ECCFM decoder is trained directly with a consistency objective and a soft-syndrome regularization term, enabling it to map any noisy received signal to the estimated original codeword in a single, efficient inference step. We demonstrate the effectiveness of ECCFM through several numerical experiments on a diverse set of standard codes, including BCH, Low-Density Parity-Check (LDPC), Polar, MacKay, and CCSDS. The results show that ECCFM can improve Bit-Error-Rate (BER) compared to leading auto-regressive methods, exhibiting particularly strong gains on longer codes with code lengths above 200. Notably, it achieves an inference speedup of 30x to 100x over the existing iterative denoising diffusion methods in a single step, while maintaining comparable decoding performance. In our numerical evaluation, ECCFM offers a model-free training diagram for building ECC decoders that achieves near state-of-the-art performance with low latency, and requires only a single-step inference suited for most real-world applications. 2 Related Works Neural Network-based ECC Decoders. Neural network-based decoders are broadly categorized into model-based and model-free approaches. Model-based decoders augment conventional algorithms, such as Belief Propagation (BP) [ 38 ] and Min-Sum (MS) [ 13 ] , by using neural networks to learn the message-passing process. This paradigm has been extensively explored across various architectures and code types [ 11 , 22 , 23 , 29 , 32 , 33 , 30 , 49 ] , consistently achieving superior performance over conventional algorithms [ 31 ] . However, they are often limited by challenges in capturing long-range dependencies and the reliance on the underlying decoding algorithm. In contrast, model-free decoders treat decoding as a learning problem without depending on problem-specific algorithms. While early fully-connected architectures [ 16 , 4 , 21 ] struggled with overfitting, [ 1 ] proposes the pre-processing by decomposing the magnitude and syndrome vector to address overfitting issues for model-free decoders. Inspired by the recent breakthrough of Transformers [ 48 ] , ECCT [ 7 ] pioneered by applying self-attention