RF-Analyzer: Can Vision-Language Models Learn RF Understanding from Synthetic Data?
Anis Bara, Lina Bariah, Hang Zou, Brahim Mefgouda, Merouane Debbah · 2026
Read RF-Analyzer: Can Vision-Language Models Learn RF Understanding from Synthetic Data? by Anis Bara, Lina Bariah, Hang Zou, Brahim Mefgouda, Merouane Debbah (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04676.txt.
Introduction
Anis Bara and four co-authors ask whether vision-language models can learn to read radio frequency spectrograms from synthetic training data alone. Spectrograms are the pictures engineers use to inspect wireless signals. Understanding the spectrum is essential for intelligent communications, but extracting physical attributes from a spectrogram is a skill traditional machine learning has not achieved.
They build a platform that pairs live spectrum captures from a software-defined radio with model interpretations. That allows direct tests on real over-the-air signals. A model trained only on synthetic spectrograms is compared with general-purpose baselines. The comparison uses a shared benchmark. It probes whether the synthetic skill transfers to the real radio environment.
Catalog record
| CREATOR | Anis Bara, Lina Bariah, Hang Zou, Brahim Mefgouda, Merouane Debbah |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.04676
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RF-Analyzer: Can Vision-Language Models Learn RF Understanding from Synthetic Data? Anis Bara, Lina Bariah, Hang Zou, Brahim Mefgouda, Merouane Debbah Abstract Understanding the wireless spectrum is a fundamental requirement for intelligent communication systems, however, interpreting spectrograms requires extracting multiple physical attributes and reasoning about signal structure, which is a capability that is not achieved by traditional ML approaches. Recent advances in vision-language models (VLMs) demonstrated the possibility of learning such interpretation capabilities directly from data. This paper investigates whether VLMs can learn this capability from synthetic data alone, and more importantly, whether such learned representations generalize to real over-the-air RF environments. To address this question, we introduce RF-Analyzer, an SDR-to-AI analysis platform that integrates live spectrum captures associated with the corresponding VLM-based interpretation, enabling direct evaluation of VLMs outputs on live over-the-air signals. Using this platform, we assess a model trained exclusively on synthetic spectrogram data with general-purpose baselines. To enable systematic analysis, we establish a benchmark framework comprising three metrics, Physical Attribute Extraction Score (PAES), Prompt Leakage Rate (PLR), and hallucination count, to assess signal understanding and grounding. The obtained results demonstrate that VLMs trained on synthetic spectrogram data can generalize to real RF environments, particularly for extracting physical signal attributes such as spectral occupancy, temporal behavior, and SNR. This indicates that synthetic data is sufficient for learning transferable representations of RF signal structure. However, this generalization is limited due to the fact that synthetic training does not provide reliable semantic grounding without contextual priors. In particular, generalization breaks under conditions that are not covered in the synthetic distribution, particularly low-SNR regimes. I Introduction Large language models (LLMs) have demonstrated strong performance across a broad range of reasoning and planning tasks, enabled by scale, instruction tuning, and retrieval augmented generation in telecom domains [ 1 , 10 , 9 ] . Despite these advances, LLMs remain fundamentally limited by their reliance on tokenized representations and lack the direct grounding in physical environments. This limitation is particularly critical in wireless networks, where decision-making depends not only on protocol-level knowledge but also on the instantaneous electromagnetic state of the radio spectrum. In particular, key features, such as signal presence, spectral occupancy, temporal behavior, and signal-to-noise ratio (SNR) levels, must be captured from raw RF observations rather than textual inputs. As a result, these signals must first be sensed and transformed into structured representations before they can be used by higher-level reasoning systems, motivating the need for physically grounded AI models for spectrum understanding. Before network-level decisions can be made, the electromagnetic environment must be observed, characterized, and represented in a form that higher-level models can process. Traditionally, this sensing function is realized through two main categories of tools. The first consists of dedicated hardware instrumentation, such as spectrum analyzers and signal monitoring receivers [ 6 , 3 ] , which provide calibrated, high-dynamic-range measurements. However, these systems rely heavily on manual configuration and expert interpretation, producing outputs that are not readily structured or machine-readable for integration into automated pipelines. The second category includes task-specific machine learning approaches, where convolutional and recurrent architectures, trained on labeled IQ datasets [ 5 , 2 ] , automate modulation classification. While these models achieve high accuracy within their training distributions, they are limited to predicting discrete labels from predefined label spaces, offering limited interpretability, no natural-language interface, and limited robustness to variations in SNR and channel conditions, that are not seen in the training datasets [ 7 , 8 ] . As a result, both paradigms are not sufficient to enable flexible and structured understanding of RF signals. Interpreting spectrograms requires extracting multiple physical attributes and reasoning about signal structure, rather than assigning a single class label. Recent advances in vision-language models (VLMs) have the potential to bridge this gap, as they can jointly process visual inputs and generate structured natural-language descriptions. However, their ability to operate on domain-specific representations such as RF spectrograms is still in its early stages. Recent research attempts were developed to address this gap by adapting VLMs to the RF domain. Earlier studies have shown that transforming IQ signals into spectrogram-based representations and applying parameter-efficient fine-tuning enables these models to capture RF signal patterns effectively [ 11 ] . Extensions such as RF-GPT [ 12 ] further demonstrate that VLMs can support a broader range of RF-related tasks, including wireless technology identification, signal analysis, and information extraction. These efforts demonstrate that VLMs can learn structured RF representations through targeted fine-tuning, particularly when combining spectral and temporal information. However, despite these advancements, the generalization of such representations beyond synthetic training data is not yet properly understood. In particular, it is unclear to what extent models trained exclusively on synthetic RF data can provide reliable performance when exposed to real over-the-air environments, where signal conditions, noise characteristics, and propagation effects differ significantly from simulated settings. It is worthy to highlight that real RF data are expensive to collect, difficult to label, location-dependent, and usually constrained by spectrum regulations. If synthetic-only training can support real spectrum understanding, then RF language models can be developed and further tuned more efficiently, compared to systems that rely on large-scale labeled over-the-air datasets. Synthetic datasets offer accessibility, scalability, controllability, and precise labeling, rendering them highly attractive for training large models. However, real-world RF environments exhibit unique characteristics that are difficult to fully replicate in simulation, including heterogeneous interference patterns, hardware-based impairments, and dynamic channel conditions. As a result, the ability of VLMs to transfer learned representations from synthetic to real domains becomes a key factor in determining their applicability to real-world spectrum analysis tasks. To study this gap, in this paper, we present RF-Analyzer , a GPU-accelerated spectrum analysis platform that connects an Ettus USRP B210 software-defined radio to multiple VLM backends, including domain-adapted and general-purpose models, such as RF-GPT, Qwen2.5-VL, and Llama 3.2 Vision. RF-GPT is a VLM fine-tuned on synthetic spectrogram data [ 12 ] . Unlike conventional spectrum analyzers, RF-Analyzer does not operate around predefined label spaces or fixed measurement procedures, but rather it functions as a reasoning engine, accepting a rendered waterfall display as input and producing structured natural-language descriptions of the signal’s physical attributes, including modulation family, spectral occupancy, temporal duty cycle, SNR class, and channel isolation, through a conversational interface. The main contributions of this paper are as follows: • We present RF-Analyzer , an integrated SDR-to-AI platform connecting a USRP B210 receiver to a locally hosted VLM backend, enabling evaluation of RF spectrogram interpretation on real over-the-air signals. • We provide a synthetic-to-real evaluation of RF-trained VLMs (such as RF-GPT), assessing whether models trained only on synthetic spectrogram data can generalize to live RF environments without any real-data fine-tuning. • We propose the Physical Attribute Extraction Score (PAES) , which is a structured evaluation framework assessing model outputs across five signal description dimensions, quantifying RF signal understanding beyond classification accuracy. • We introduce Prompt Leakage Rate (PLR) and hallucination counting to assess to what extent model outputs are grounded in the input spectrogram, rather than influenced by prompt metadata or unsupported claims. • We characterize training-set label bias, as a reproducible failure mode in domain-adapted VLMs, demonstrating that a model can correctly perceive signal geometry while misclassifying a technology label