Reinforcement-Learned Unequal Error Protection for Quantized Semantic Embeddings
Moirangthem Tiken Singh, Adnan Arif · 2026
Read Reinforcement-Learned Unequal Error Protection for Quantized Semantic Embeddings by Moirangthem Tiken Singh, Adnan Arif (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00186.txt.
Introduction
Moirangthem Tiken Singh and coauthor Adnan Arif protect meaning, not just bits, when bandwidth is tight. Their 2026 system sends quantized semantic embeddings over a noisy channel. Plain uniform protection treats every dimension alike. Meaning, though, is not spread evenly. Some dimensions carry entities that must survive. Their framework learns where extra care pays off.
A reinforcement learning agent assigns repetition coding per dimension. A composite score guides it during training. That score balances whole embedding closeness with entity level survival. Tests beat uniform protection by clear margins. Text quality and entity keeping both rise at low signal strength. Classic codes cannot match this fine grained fit. Their structure ignores semantic granularity by design. The authors aim at edge and sensor networks. There, bandwidth is scarce but meaning still matters.
Catalog record
| CREATOR | Moirangthem Tiken Singh, Adnan Arif |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-00186
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reinforcement-Learned Unequal Error Protection for Quantized Semantic Embeddings Moirangthem Tiken Singh, Adnan Arif Abstract This paper tackles the pressing challenge of preserving semantic meaning in communication systems constrained by limited bandwidth. We introduce a novel reinforcement learning framework that achieves per-dimension unequal error protection via adaptive repetition coding. Central to our approach is a composite semantic distortion metric that balances global embedding similarity with entity-level preservation, empowering the reinforcement learning agent to allocate protection in a context-aware manner. Experiments show statistically significant gains over uniform protection, achieving 6.8% higher chrF scores and 9.3% better entity preservation at 1 dB SNR. The key innovation of our framework is the demonstration that simple, intelligently allocated repetition coding enables fine-grained semantic protection- an advantage unattainable with conventional codes such as LDPC or Reed-Solomon. Our findings challenge traditional channel coding paradigms by establishing that code structure must align with semantic granularity. This approach is particularly suited to edge computing and IoT scenarios, where bandwidth is scarce, but semantic fidelity is critical, providing a practical pathway for next-generation semantic-aware networks. 1 Introduction Conventional communication paradigms, designed to ensure bit-level fidelity, are increasingly inadequate for next-generation intelligent systems. Applications ranging from 6G networks to large-scale IoT deployments generate information where semantic meaning is paramount, demanding a shift from exact bit recovery to reliable conveyance of intent over resource-constrained, noisy channels. Traditional approaches, based on Shannon’s separation theorem [ 26 ] , optimize for bit reconstruction and are thus suboptimal when the objective is to preserve meaning [ 3 ] . Semantic communication addresses this by directly encoding and recovering semantic content, offering enhanced robustness and spectral efficiency [ 30 ] . This paradigm is particularly relevant for ultra-reliable low-latency communication (URLLC) and massive IoT, where it provides both theoretical and practical advantages over classical methods. Deep joint source-channel coding (JSCC) has achieved notable success in image and speech transmission [ 3 ] . For text, pre-trained language models produce compact, high-dimensional embeddings that capture sentence-level semantics [ 23 , 14 ] . However, transmitting these embeddings efficiently remains a challenge. The semantic importance varies significantly across different dimensions, yet current methods typically apply uniform quantization and protection. This uniform treatment is inefficient, as it fails to prioritize more critical dimensions, resulting in wasted resources and degraded preservation of meaning. This highlights two critical gaps in existing literature. First, current systems lack adaptive unequal error protection (UEP) mechanisms that dynamically adjust protection based on the semantic importance of each dimension. Most methods employ uniform or heuristic redundancy allocation, ignoring dimension-specific vulnerability [ 4 , 19 ] . Consequently, semantically crucial dimensions remain as exposed to channel noise as less important ones. Second, while reinforcement learning (RL) has been applied to resource allocation in JSCC, prior work focuses on continuous modulation or coarse rate control, rather than fine-grained, per-dimension discrete protection decisions with direct semantic feedback [ 18 , 36 ] . Thus, no existing framework can dynamically allocate protection at the dimension level based on both semantic content and channel conditions. To address these gaps, we propose an RL-driven framework that dynamically allocates discrete repetition counts to individual quantized embedding dimensions. We employ simple repetition coding not for its classical optimality, but for its structural property of enabling fine-grained, per-dimension adaptation—a critical feature that block codes, such as Reed-Solomon and LDPC, lack under strict bandwidth constraints. Training incorporates gradient clipping and entropy regularization, with formal convergence guarantees provided via two-timescale stochastic approximation analysis. The principal contributions of this work are: 1. A reinforcement learning framework for adaptive, per-dimension unequal error protection via discrete repetition count allocation. 2. A composite semantic distortion metric balancing global embedding similarity and entity-level correctness. 3. Empirical demonstration that policies trained at moderate (8-bit) quantization generalize effectively to aggressive (4-bit) quantization, maintaining high fidelity while halving bandwidth. 4. The insight that code structure must match semantic granularity: repetition coding enables per-dimension adaptation where conventional block codes fail or prevent it. 5. A robust actor-critic algorithm with entropy regularization and formal convergence guarantees. 6. Comprehensive evaluation on the AG News dataset across SNR regimes, quantization levels, and channel models. The remainder of this paper is organized as follows: Section 2 reviews related work; Section 3 details the methodology; Section 4 presents experimental results; Section 5 discusses implications; and Section 6 concludes. 2 Related Work This study operates at the intersection of semantic communication, representation compression, adaptive error protection, and reinforcement learning. The following review establishes relevant foundations and explicitly identifies the research gaps that our framework is designed to address. The communication paradigm has evolved from strict bit-level fidelity to the preservation of meaning. Foundational models such as DeepSC introduced end-to-end joint source-channel coding (JSCC) using transformers, optimizing semantic similarity metrics rather than bit-error rates [ 28 ] . Subsequent surveys outline the progression toward intelligence-driven semantic systems for 6G, incorporating large language models and knowledge bases [ 9 , 29 , 33 ] . A consistent limitation of these studies is the treatment of semantic embeddings as indivisible units. This monolithic approach overlooks the heterogeneous importance of the individual latent dimensions. Under aggressive bandwidth constraints, dimensions carrying critical semantic information receive no more protection than those carrying less significant information, creating a fundamental performance bottleneck. Efficient communication requires the compression of high-dimensional semantic embeddings. Techniques such as 4-bit quantization have been successfully applied to vector embeddings in retrieval systems, reducing the memory footprint with minimal loss of accuracy [ 13 ] . More complex learned quantization methods preserve the semantic structure but often at a high computational cost [ 8 , 16 ] . This highlights the need for low-complexity quantization suitable for integration into communication pipelines. Error protection strategies have historically employed Unequal Error Protection (UEP), allocating redundancy based on data priority. Classical applications include video streaming [ 15 ] and federated learning [ 37 ] . However, these schemes operate on coarse data blocks (e.g., image frames and model parameter segments). They are not designed for the fine-grained, context-dependent importance structure inherent in linguistic embeddings. A significant gap exists in achieving adaptive per-dimension protection aligned with semantic salience. Furthermore, the co-optimization of such protection with practical quantization remains largely unexplored. Classical channel codes, such as Reed-Solomon (RS) [ 22 ] and Low-Density Parity-Check (LDPC) codes [ 7 ] , are engineered for efficient error correction within data blocks. Although powerful, their integration into a dynamic, per-dimension UEP framework is non-trivial. Their fixed block lengths and complex encoding/decoding algorithms make it difficult to assign a unique, dynamically chosen code rate to each of the hundreds or thousands of embedding dimensions within a lean, trainable system. In this context, simple repetition coding, despite its spectral inefficiency in classical information theory, offers distinct practical advantages for the research problem. It provides a discrete set of protection levels defined by the integer repetition count n . This structure creates a tractable action space for a reinforcement learning agent tasked with the per-dimension allocation. Its decoding mechanism (e.g., majority voting) is computationally trivial and can be parallelized across dimensions. Therefore, we consider repetition coding not as an optimal channel code, but as a flexible and minimalistic primitive that allows us to isolate and study the problem