ChronoSC: Task-Oriented Semantic Communication via Temporal-to-Color Encoding
Phuc H. Nguyen 1 , Trung T. Nguyen 1 , Quy N. Duong 1 , and Van-Dinh Nguyen 2 · 2026
Read ChronoSC: Task-Oriented Semantic Communication via Temporal-to-Color Encoding by Phuc H. Nguyen 1 , Trung T. Nguyen 1 , Quy N. Duong 1 , and Van-Dinh Nguyen 2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16388.txt.
Introduction
Nguyen and three others present ChronoSC, a task-focused semantic communication system for Video Question Answering. Existing video semantic communication focuses on pixel rebuilds or complex pipelines, wasting bandwidth and adding latency. ChronoSC encodes temporal video dynamics into a single static image via Chrono-Color Stacking, a lightweight lossless projection, then transmits it with a lightweight DeepJSCC transceiver. A pretrained BLIP model answers questions from noisy reconstructed chrono-images. On CLEVRER it achieves up to 192-fold bandwidth reduction versus raw video while keeping high VideoQA accuracy.
Catalog record
| CREATOR | Phuc H. Nguyen 1 , Trung T. Nguyen 1 , Quy N. Duong 1 , and Van-Dinh Nguyen 2 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29447 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16388
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ChronoSC: Task-Oriented Semantic Communication via Temporal-to-Color Encoding Phuc H. Nguyen 1 , Trung T. Nguyen 1 , Quy N. Duong 1 , and Van-Dinh Nguyen 2 Abstract Semantic communication (SC) aims to reduce transmission overhead by conveying task-relevant information rather than raw data. However, existing SC approaches for video largely focus on pixel-level reconstruction or rely on complex spatiotemporal pipelines, leading to excessive bandwidth usage and latency that are unsuitable for low-resource deployments. In this paper, we propose ChronoSC, a task-oriented semantic communication framework for Video Question Answering (VideoQA). ChronoSC introduces Chrono-Color Stacking, a lightweight and lossless projection scheme that encodes temporal video dynamics into a single static image, enabling extreme temporal compression before transmission. This compact semantic representation is transmitted using a lightweight Deep Joint Source-Channel Coding (DeepJSCC) transceiver and explicitly reconstructed at the receiver. Unlike latent-space methods, explicit visual reconstruction enables the direct reuse of pre-trained vision-language models; specifically, a pre-trained BLIP model is employed to infer answers from noisy, reconstructed chrono-images. Experiments on the CLEVRER dataset show that ChronoSC achieves up to 192 times bandwidth reduction compared to raw video transmission while maintaining high VideoQA accuracy. 1 1 1 I Introduction Video data currently dominates global internet traffic, driven by the rapid proliferation of Internet of Things (IoT) devices, unmanned aerial vehicles (UAVs), and autonomous systems. In many emerging applications, such as intelligent traffic monitoring, surveillance, and hazard detection, the primary objective is no longer to deliver visually appealing video streams for human consumption. Instead, the goal is for machines to extract actionable intelligence directly from visual data, such as object attributes, motion patterns, or causal events [ 6 ] . Despite this shift toward machine-centric video analytics, transmitting video from edge devices to a central server remains fundamentally challenging. In particular, two key constraints limit the practicality of large-scale deployments. First, transmitting full video sequences requires high data rates that often exceed the capacity of edge and wireless networks. Second, conventional video coding standards (e.g., H.264/AVC and H.265/HEVC) suffer from the well-known “cliff effect” [ 7 ] , where even a modest degradation in the signal-to-noise ratio (SNR) can cause catastrophic decoding failure, rendering the received video unusable for downstream analysis. These challenges expose a fundamental mismatch between traditional video communication systems, designed primarily for human viewing, and the requirements of machine-oriented inference tasks. To address this gap, semantic communication (SC) has emerged as a promising paradigm that aims to transmit only task-relevant semantic information rather than raw pixel data [ 5 ] . While recent works, such as VideoQA-SC [ 3 ] , have extended SemCom to video-based reasoning tasks, they typically rely on complex spatiotemporal processing pipelines built on 3D convolutional networks, object detectors, or graph-based reasoning modules [ 8 ] , [ 2 ] . Such architectures introduce substantial computational overhead and latency, making them impractical for resource-constrained edge devices. Building on this insight, we propose ChronoSC, an ultra-low-complexity video semantic communication framework for VideoQA. ChronoSC introduces Chrono-Color Stacking, a parameter-free projection method that deliberately leverages fundamental arithmetic operations (e.g., background subtraction and progressive hue shifting) to achieve near-zero computational overhead. By explicitly encoding temporal dynamics into spatial color trails within a single RGB image, we create a compact semantic representation that bypasses the need for intensive feature extraction at the edge. This representation is transmitted using the proposed Motion-Aware Swin Transceiver (MAST), a deep joint source-channel coding architecture that prioritizes dynamic regions for robust transmission. Unlike latent-space methods, MAST explicitly reconstructs a pixel-domain semantic image at the receiver, enabling direct reuse of pre-trained vision-language models, such as BLIP [ 4 ] , to infer answers from noisy reconstructions without retraining the transmitter. The main contributions of this paper are summarized as follows: • We propose ChronoSC, an ultra-lightweight projection scheme that compresses temporal video dynamics into a single static image. Unlike existing methods relying on heavy deep learning backbones, our parameter-free design eliminates the need for spatiotemporal feature extraction, resulting in near-zero computational overhead (measured in FLOPs) suitable for extreme edge deployments. • We develop a modular semantic interface via the proposed MAST transceiver. By introducing a motion-aware gating mechanism, MAST explicitly prioritizes dynamic regions for robust transmission. Furthermore, its pixel-domain reconstruction explicitly decouples the communication module from downstream reasoning models, enabling the ”plug-and-play” reuse of Foundation Models (e.g., BLIP). • Experimental results on the CLEVRER dataset [ 11 ] demonstrate that ChronoSC achieves a massive 192\times bandwidth reduction compared to raw video transmission. Remarkably, under extreme channel noise ( \text{SNR}=0 dB), ChronoSC maintains a high VQA accuracy of 76.2\% , significantly outperforming conventional digital codecs (H.264 + LDPC) which suffer from the cliff effect and drop to 35.2\% . II Related Work Traditional communication systems follow a strict separation between source coding for compression and channel coding for error protection. Deep joint source-channel coding (DeepJSCC) replaces this modular design with neural networks trained end-to-end, enabling more efficient and robust transmission over wireless channels. Bourtsoulatze et al. [ 1 ] first demonstrated that CNN-based JSCC can effectively mitigate the cliff effect in wireless image transmission. Building on this idea, SwinJSCC [ 10 ] incorporates Swin Transformers to better capture global contextual information, further improving reconstruction quality and robustness. These advances highlight the effectiveness of transformer-based JSCC for image transmission, which we adopt and extend in this work. Unlike conventional communication systems that aim for faithful signal reconstruction, task-oriented semantic communication focuses on maximizing the performance of a downstream task, such as classification or Visual Question Answering (VQA). MU-DeepSC [ 9 ] jointly encodes image and text semantics for VQA but is limited to static images and does not address temporal dynamics in video. VideoQA-SC [ 3 ] extends semantic communication to video but relies on computationally intensive spatiotemporal encoders that combine object detection, temporal modeling, and graph neural networks. In contrast, our approach shifts complexity away from the network architecture toward the data representation itself. By encoding temporal dynamics into a compact 2D Chrono-Color image, we enable the use of lightweight image-based models rather than heavy video processing pipelines. Representing motion within a single image has been explored in computational photography and computer vision. Yosef et al. [ 12 ] used coded exposure to enable video reconstruction from a single motion-blurred image, while VDM-MD [ 13 ] employed diffusion models to resolve temporal ambiguity from blurred inputs. These methods, however, are designed for high-fidelity video reconstruction for human viewing. In contrast, our work is fundamentally task-oriented: we do not seek to reconstruct the original video, but instead treat the stacked image as a semantic symbol that directly encodes motion information for machine interpretation. III System Model and Problem Formulation Fig. 1 : End-to-end SC framework for ChronoSC, where the input video is compressed into a single stacked semantic image and transmitted for VideoQA inference. Fig. 1 illustrates the proposed end-to-end SC framework for ChronoSC, designed for Video Question Answering (VQA) at the network edge. The system consists of a semantic transmitter, a wireless channel, and a semantic receiver, and aims to efficiently transmit task-relevant visual semantics under bandwidth and channel constraints. Transmitter : The input is a video sequence \mathbf{V}\in\mathbb{R}^{T\times 3\times H\times W} , where T denotes the number of frames, and