Tube-Structured Incremental Semantic HARQ for Generative Video Receivers
Xuesong Wang, Xinyan Xie, Runxin Zhang · 2026
Read Tube-Structured Incremental Semantic HARQ for Generative Video Receivers by Xuesong Wang, Xinyan Xie, Runxin Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09897.txt.
Introduction
Wang, Xie and Zhang study video delivery where the receiver rebuilds pictures from compact meaning using a generative model, rather than receiving every pixel. Errors then snowball over time, useful clues are correlated across frames, and each retry costs budget, so the receiver must choose retransmissions wisely. Past work focused on representation or compression, while existing error-resilient schemes retransmit encoder-chosen frame blocks.
Their proposal makes temporally local packages the retransmission unit: packages are sent, dropped, received and committed as whole units, at the receiver's request. Under matched backbones, budgets and channel models, this package-native scheme beat block baselines on time-weighted recovery cost in moderate to harsh channels. It won mainly by stabilising recovery earlier, while final quality ended up broadly comparable and the edge faded in near-clean channels.
Catalog record
| CREATOR | Xuesong Wang, Xinyan Xie, Runxin Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09897
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tube-Structured Incremental Semantic HARQ for Generative Video Receivers Xuesong Wang, Xinyan Xie, Runxin Zhang Abstract Generative semantic communication uses receiver-side generative priors to reconstruct visual content from compact semantics, making it attractive for bandwidth-limited multimedia delivery. For video, reliable recovery remains difficult because errors accumulate over time, useful evidence is temporally correlated, and the receiver must make decisions under limited interaction, retransmission, and reconstruction budgets. Existing generative semantic communication studies mainly emphasize representation, compression, or generative reconstruction, while recent error-resilient and semantic-HARQ methods still largely operate on encoder-defined or frame-block retransmission units. This paper studies receiver-driven semantic HARQ for generative video reconstruction under a budget-constrained AoIS-AUC objective and argues that the retransmission primitive is itself an important system design variable. We propose tube-structured package-native requests, in which temporally local packages are the channel-visible HARQ objects and are transmitted, dropped, received, and committed at package granularity. Under a controlled comparison protocol with matched backbone, budgets, and channel model, this primitive yields lower time-weighted recovery cost than competitive block-based baselines in practically relevant moderate-to-harsh regimes, while the gap naturally shrinks in near-clean channels. The gain mainly appears as earlier stabilization of the recovery trajectory, while final-quality endpoints remain broadly comparable, and it persists even against a tube-aware block-ranking baseline. † † aftertitle: I Introduction Semantic communication shifts the focus of wireless systems from bit-level fidelity toward task-oriented and meaning-aware transmission [ 16 ] . Within this paradigm, generative semantic communication utilizes receiver-side priors to reconstruct high-fidelity content from highly compact latent representations [ 10 , 13 ] . While diffusion-based models have successfully enabled progressive recovery for images [ 2 , 14 ] , video transmission introduces distinct complexities beyond simple compression. Specifically, the inter-frame persistence of missing evidence and subsequent temporal error accumulation necessitate a shift in focus from representation to interaction [ 12 , 8 ] . In these scenarios, the mechanism for requesting and delivering the incremental evidence emerges as a critical yet under-explored component of system design. Advances in generative models have established the feasibility of high-quality video delivery and restoration even from partial observations [ 17 , 7 , 8 ] . Building upon these generative backbones, recent research has explored various error-resilient mechanisms, including packetization with generative recovery under loss [ 6 ] , semantic-aware hybrid automatic repeat request (HARQ) design [ 4 , 9 ] , semantic-aware and QoE-guided resource allocation [ 18 , 15 ] , and receiver-side adaptive refinement [ 14 ] . However, these methods typically optimize encoder-defined semantic units or network-level control variables while presupposing a fixed channel-visible transport object. Such constraints hinder generative video recovery, as the transport primitive governs the temporal distribution of evidence arrival. Isolated frame-block transport fails to exploit temporal coherence, leaving the receiver semantically starved and stalled in an incorrect state until enough spatiotemporal support has trickled in to resolve the reconstruction. Therefore, this work identifies the retransmission primitive as a critical design variable for optimizing generative video, referred to as incremental semantic HARQ. To quantify the duration of such incorrect states, we adopt a budget-constrained Area-Under-the-Curve objective based on the Age of Incorrect Semantics (AoIS-AUC) to characterize delayed recovery in generative video reconstruction. Similar to the Age of Incorrect Information (AoII), this metric prioritizes the speed of transition from incorrect to reliable states over final reconstruction fidelity alone [ 11 , 3 , 1 ] . Furthermore, leveraging the intrinsic spatiotemporal correlations within video sequences, this paper proposes a tube-structured package as the channel-visible HARQ object. Then, we develop a receiver-side greedy request policy to minimize AoIS-AUC and evaluate the proposed framework across varying bandwidth and computational budgets to demonstrate its effectiveness in practical communication scenarios. The main contributions are summarized as follows: Fig. 1: System overview of receiver-driven semantic HARQ for generative video reconstruction. The receiver requests tube-structured packages, the forward link transports them as atomic HARQ objects, and successful deliveries are committed before diffusion inpainting and the next feedback decision. • Unlike traditional schemes relying on fixed frame-block units, we identify the retransmission primitive itself as a critical system design variable in generative video semantic communication. By projecting object regions onto the latent space, we aggregate spatiotemporal latent blocks into coherent tubes and propose tube-structured packages as the channel-visible HARQ objects. • To minimize the AoIS-AUC, we propose a greedy request strategy that prioritizes candidate packages by their uncovered ratios, mean support areas, and temporal spans. Coupled with a diffusion-based generative model, this approach facilitates more rapid stabilization of the video recovery trajectory. • Extensive simulations validate the effectiveness of the proposed scheme, achieving up to a 6-round recovery lead in moderate-to-harsh regimes. Moreover, we offer system-level design guidelines across diverse channel conditions and motion intensities for practical application. II System Design and Tube-Structured Package Transport We consider receiver-driven semantic HARQ for generative video reconstruction over an unreliable wireless link, as illustrated in Fig. 1 . After an initial semantic payload is transmitted, the receiver enters interactive HARQ rounds, tracks latent availability, optionally performs diffusion inpainting, evaluates a quality proxy, and feeds back the next package request. A transmitter-side dispatcher then sends the requested units through the erasure channel. The key design choice is the retransmission primitive that uses temporally local tube-structured packages as the channel-visible HARQ objects, instead of individual frame-blocks. II-A System Flow and Package-Native HARQ Let x_{1:T}=\{x_{t}\}_{t=1}^{T} denote a video clip, where each frame x_{t}\in\mathbb{R}^{C\times H\times W} . A pretrained encoder E(\cdot) maps each frame to a latent tensor z_{t}=E(x_{t})\in\mathbb{R}^{C_{L}\times H_{L}\times W_{L}} . Each latent tensor z_{t} is partitioned into N spatial blocks with resulting blocks denoted by \{z_{t,b}\}_{b=1}^{N} . The full spatiotemporal latent block set is \mathcal{U}\triangleq\{(t,b):t\in\{1,\dots,T\},\;b\in\{1,\dots,N\}\}. (1) For each clip, an offline tube-extraction stage constructs a fixed package catalog \mathcal{C}=\{p\}_{p=1}^{P} . Each package p is associated with a member set \mathcal{P}_{p}\subseteq\mathcal{U} , an owner tube index o(p) , a temporal span \ell_{p} equal to the number of frames covered by \mathcal{P}_{p} , and a package size in budget units c_{p}\triangleq|\mathcal{P}_{p}| . Tube packages are constructed once per clip from frame-wise object regions projected onto the latent grid, that is, each object first induces a spatiotemporal latent-block tube, which is then split into temporally local packages under fixed size constraints; overlap is resolved before finalizing the catalog, and background packages cover the remaining latent blocks. The final catalog is non-overlapping and complete: \mathcal{U}=\bigcup_{p\in\mathcal{C}}\mathcal{P}_{p},\qquad\mathcal{P}_{p}\cap\mathcal{P}_{p^{\prime}}=\emptyset,\ \forall p\neq p^{\prime}. (2) Hence, the receiver ultimately reconstructs from latent blocks, but the forward link operates on packages rather than individual blocks. Let \mathcal{A}^{\mathrm{init}}\subseteq\mathcal{U} denote the latent blocks made available by the initial semantic payload. In each interactive HARQ round r=1,\dots,R , the receiver feeds back a package request \mathcal{S}_{r}\subseteq\mathcal{C},\qquad\sum_{p\in\mathcal{S}_{r}}c_{p}\leq K, (3) where K is the per-round request budget. The feedback is assumed reliable and contains only package identifiers. The forward link is modeled as a packet-erasure channel over the requested channel-visible units. In the main experiments, we use a Gilbert-Elliott (GE) burst-erasure channel. Let e_{i}\in\{0,1\} denote the erasure indicator of the i -th transmitted unit in chronological order, where e_{i}=1 indicates erasure. The state evolution follows \Pr(e_{i}=1\!\mid\!e_{i-1}\!=\!0)\!=\!p_{01},~\Pr(e_{i}=0\!\mid\!e_{i-1}\!=\!1)\!=\!p_{10}. (4) To match a target packet erasure rate (PER) and burst length L , we nominally set p_{10}=\frac{1}{L},\qquad p_{01}=\frac{\mathrm{PER}}{1-\mathrm{PER}}\,p_{10}, (5) and reduce p_{10} accordingly if p_{01}\geq 1