Seeing Radio: From Zero RF Priors to Explainable Modulation Recognition with Vision Language Models
Hang Zou 1 , Bohao Wang 1 2 , Yu Tian 1 , Lina Bariah 1 , Chongwen Huang 2 , Samson Lasaulce 3 , Mérouane Debbah 1 · 2026
Read Seeing Radio: From Zero RF Priors to Explainable Modulation Recognition with Vision Language Models by Hang Zou 1 , Bohao Wang 1 2 , Yu Tian 1 , Lina Bariah 1 , Chongwen Huang 2 , Samson Lasaulce 3 , Mérouane Debbah 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13157.txt.
Introduction
Hang Zou, Bohao Wang, and co-authors ask if vision language models can read radio waves as pictures. Such models join sight and text in one brain. Radio work, by old habit, builds a fresh net for each task, such as naming the mode of a signal.
The team turns wave forms into images and feeds them to such a model. They find that the model can learn to name modes from the pics, with no past radio skill. They also stress a clear read of why the model picks a mode. For radio teams, the path hints at one broad tool in place of many narrow ones.
Catalog record
| CREATOR | Hang Zou 1 , Bohao Wang 1 2 , Yu Tian 1 , Lina Bariah 1 , Chongwen Huang 2 , Samson Lasaulce 3 , Mérouane Debbah 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-13157
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Seeing Radio: From Zero RF Priors to Explainable Modulation Recognition with Vision Language Models Hang Zou 1 , Bohao Wang 1 2 , Yu Tian 1 , Lina Bariah 1 , Chongwen Huang 2 , Samson Lasaulce 3 , Mérouane Debbah 1 Abstract The rise of vision language models (VLMs) paves a new path for radio frequency (RF) perception. Rather than designing task-specific neural receivers, we ask if VLMs can learn to recognize modulations when RF waveforms are expressed as images. In this work, we find that they can. In specific, in this paper, we introduce a practical pipeline for converting complex IQ streams into visually interpretable inputs, hence, enabling general-purpose VLMs to classify modulation schemes without changing their underlying design. Building on this, we construct an RF visual question answering (VQA) benchmark framework that covers 57 classes across major families of analog/digital modulations with three complementary image modes, namely, (i) short time-series IQ segments represented as real/imaginary traces, (ii) magnitude-only spectrograms , and (iii) joint representations that pair spectrograms with a synchronized time-series waveforms. We design uniform zero-shot and few-shot prompts for both class-level and family-level evaluations. Our finetuned VLMs with these images achieve competitive accuracy of 90 % 90\% compared to 10 % 10\% of the base models. Furthermore, the fine-tuned VLMs show robust performance under noise and demonstrate high generalization performance to unseen modulation types, without relying on RF-domain priors or specialized architectures. The obtained results show that combining RF-to-image conversion with promptable VLMs provides a scalable and practical foundation for RF-aware AI systems in future 6G networks. I Introduction Large language models (LLMs) have evolved rapidly in both scale and capability, becoming increasingly versatile across diverse applications. Through scaling laws and instruction tuning, they have enabled outstanding general-purpose reasoning and strong few-shot learning performance across a wide range of tasks [ 4 ] . Building on this progress, multimodal LLMs have emerged, bridging vision and language by pairing frozen or jointly trained vision encoders with powerful LLM backbones to ground linguistic reasoning in visual context [ 9 , 1 , 17 ] . As this evolution accelerates, foundation models such as GPT-5 demonstrate robust multimodal comprehension and strong cross-domain generalization, integrating textual and visual knowledge to solve more complex reasoning tasks [ 11 ] . In a parallel race, the 6G research agenda anticipates AI-native networks that can orchestrate sensing, communications, computing, and control at unprecedented scales and latencies. Accordingly, existing surveys and position papers emphasize on the foundational integration of advanced AI technologies throughout the entire network stack, from radio access to core network automation, network slicing, and semantic communication [ 12 , 14 , 7 ] . Within this vision, LLMs emerge as unified interfaces for knowledge access, tool-use, reasoning and planning, supporting automated policy optimization, intelligent fault diagnosis, and intent-driven network operations for complex, heterogeneous infrastructures. Early researches on LLM4Telecom have explored LLM-driven network and service management assistants, domain-specialized instruction-tuned models, and agentic workflows that integrate LLMs into network tools and monitoring data [ 8 , 16 , 13 , 2 , 15 ] . These studies have showcased promising results in network troubleshooting, configuration generation, root cause analysis, and closed-loop operations. However, they mainly rely on language, in the form of text, tables or structured logs, as the primary modality. Within this direction, Telecom-specific LLMs have been developed, such as TelecomGPT [ 18 ] , to improve LLMs capabilities in telecom related tasks. Instead of relying on general-purpose LLMs or prompt engineering, telecom knowledge has been directly embedded into the LLMs to equip them with the needed operational intelligence, domain-grounded reasoning, and contextual understanding that are essential to reason over network scenarios and automate management tasks. However, despite all this progress in Telecom LLMs, currently their integration into telecom networks is largely text-centric. Hence, this prevents the exploitation of such powerful tools in more advanced network tasks that require that an LLM can process and generate different kind of data modalities, including radio frequency (RF) signals, images, spectrograms, or acoustic signals, among others. It is worthy to note that future networks will not be only conversation- and reasoning-dependent, but they will also enjoy advanced RF perception capabilities. Having said that, no existing vision language model (VLM) has been explicitly designed with spectrum intelligence, i.e., with capabilities to interpret or classify RF signal patterns. In telecom networks, such ability underpins a wide range of critical functions, including automatic modulation classification (AMC), interference detection, spectrum sensing, and signal quality analysis. These tasks are essential for dynamic spectrum access, cognitive radio, and autonomous network optimization, where understanding the underlying signal patterns enables adaptive communication. Traditional AMC models rely on domain-specific deep networks, which are trained on IQ samples or spectrograms [ 10 ] , but they often fail to generalize to unseen modulations and lack interpretability. On the other hand, VLMs have so far shown exceptional generalizability and multimodal-based reasoning capabilities, e.g., in audio spectrogram recognition [ 6 ] . Hence, the aim of our work is to explore the if RF understanding and perception can be directly linked to VLMs without redesigning model architectures or training them from scratch. Fig. 1: Proposed framework. Spectrograms are obtained through STFT while IQ segment are obtained by down conversion and chunking. The VLM will be provided with image illustrating magnitude of spectrogram, IQ segment, or both of them. This paper proposes a simple, practical pipeline to enable off-the-shelf VLMs to understand raw RF IQ data, by converting them into visual representations that are interpretable by existing VLMs. Specifically, we transform RF signals into spectrograms using short-time Fourier transform (STFT) and into and as chunked IQ time-series panels, in order to construct a visual-question-answering (VQA) dataset, comprising queries on fine-grained modulation classes or higher-level signal categories. With lightweight fine-tuning and no architectural changes, we show that a modern VLM fine-tuned only on these images can perform accurate modulation recognition while providing natural language explanations of their decisions . Our main contributions are summarized as follows: • We construct an efficient RF modulation classification benchmark covering spectrogram, time-series, and joint signal representations. • We demonstrate, to the best of the authors’ knowledge for the first time, that a general-purpose VLM can be adapted to classify RF modulations while producing concise, human-readable explanations. • We show that, after minimal fine-tuning, the model achieves strong data efficiency and robustness to noise and out-of-vocabulary (OOV) modulation classes, paving the way for RF-aware multimodal LLMs for 6G. II Benchmark Design for RF Modulation Classification To assess the capability of VLMs in RF signal understanding, we construct a reproducible benchmark that evaluates VLMs on recognition of digital and analog modulation types from rendered RF visualizations. We leverage TorchSig [ 3 ] which provides 57 different modulation schemes across different families as follows: • OFDM (12): Orthogonal Frequency–Division Multiplexing with different number of subcarriers M\in\{64,72,128,180,256,300,512,600,900,1024\} and \{1200,2048\} . • QAM (8): Quadrature Amplitude Modulation with constellation size M\in\{16,32,64,256,1024\} plus cross-constellations: \{32\_\text{cross},128\_\text{cross},512\_\text{cross}\} . • PSK (6): Phase Shift Keying with different number of phase states M\in\{2\,(\text{BPSK}),4\,(\text{QPSK}),8,16,32,64\} . • ASK (5): Amplitude Shift Keying with different number of amplitude levels M\in\{4,8,16,32,64\} . • FSK (4): Frequency Shift Keying with different number of distinct tones M\in\{2,4,8,16\} . •