Hamiltonian-Inspired Attention Mechanism for Scalable RF Transmitter Fingerprinting

Chitraksh Singh, Monisha Dhanraj, Akram Sheriff · 2026

Read Hamiltonian-Inspired Attention Mechanism for Scalable RF Transmitter Fingerprinting by Chitraksh Singh, Monisha Dhanraj, Akram Sheriff (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30364.txt.

Introduction

Chitraksh Singh, Monisha Dhanraj and Akram Sheriff propose the Hamiltonian Transformer, a physics-based way to spot radio senders that keeps signal size fixed in each head. It uses a skew-symmetric maker and a leapfrog step. Tests use raw radio signals from the WiSig set under four test types. The model hits about 99 percent right on same-day tests and about 62 percent with 150 senders, beating CNN and Transformer base models. A phase step at the input helps most.

Catalog record

CREATORChitraksh Singh, Monisha Dhanraj, Akram Sheriff
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42809
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30364

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hamiltonian-Inspired Attention Mechanism for Scalable RF Transmitter Fingerprinting Chitraksh Singh, Monisha Dhanraj, Akram Sheriff Abstract Radio-frequency (RF) fingerprinting identifies wireless transmitters using hardware-induced imperfections present in baseband I/Q signals. However, deep learning models often degrade under receiver and channel distribution shifts, particularly as transmitter populations grow. This work proposes the Hamiltonian Transformer , a physics-informed attention architecture that enforces norm-preserving value dynamics within each attention head using a learned skew-symmetric generator and a Störmer–Verlet leapfrog integration step. An additional phase-increment embedding exposes oscillator dynamics at the input layer. All experiments use non-equalized raw I/Q signals from the WiSig dataset under four protocols: same-day classification, cross-receiver generalisation, cross-day generalisation, and transmitter scaling up to 150 devices. The Hamiltonian Transformer achieves 99.12 % 99.12\% accuracy under same-day conditions and 61.64 % 61.64\% at 150 transmitters, consistently outperforming CNN and Transformer baselines across all scale points. A controlled ablation study identifies norm-preservation in the value update as the primary inductive bias driving the scaling advantage, with the phase-increment embedding providing the single largest per-component improvement. These results indicate that embedding physics-informed structural priors into attention mechanisms is an effective approach to large-scale transmitter identification on raw wireless signals. I Introduction The proliferation of low-cost wireless devices has made physical-layer security an increasingly important concern. Consumer-grade WiFi chipsets, IoT sensors, and industrial transceivers are deployed at scale in environments ranging from hospital networks to critical infrastructure. Despite this growth, device identity is typically established through software-layer credentials such as MAC addresses or protocol-level handshakes, both of which can be cloned or spoofed without physical access to the hardware. A rogue transmitter that successfully impersonates a legitimate node can inject traffic, exhaust network resources, or silently exfiltrate data while remaining indistinguishable at the network layer. Radio-frequency (RF) fingerprinting addresses this problem by exploiting the unintentional hardware imperfections introduced during semiconductor manufacturing. Even transmitters from identical production runs exhibit measurable variations in carrier frequency offset (CFO), phase noise spectral density, and I/Q imbalance. These deviations are stable over time and detectable in the baseband waveform, making them a practical basis for hardware-level authentication [ 16 ] . Deep convolutional neural networks (CNNs) significantly advanced RF fingerprinting performance. Architectures such as ORACLE [ 18 ] and the large-scale study of Jian et al. [ 11 ] demonstrated that a CNN trained end-to-end on raw I/Q samples can exceed 95\% classification accuracy for a controlled transmitter set under a fixed channel. However, both training and evaluation in those studies were performed using the same receiver within a single recording session. When either the receiver or the capture day changed, accuracy dropped sharply. Al-Shawabka et al. [ 1 ] systematically characterised this fragility, showing that a model trained on one day’s captures can degrade to near-random performance when evaluated on the following day. In such cases the model has effectively learned channel characteristics rather than the transmitter fingerprint. The release of the WiSig dataset [ 9 ] enabled systematic investigation of this problem at scale. WiSig provides approximately ten million WiFi preamble captures from 174 commercial transmitters across 41 USRP receivers and four recording days on the ORBIT testbed [ 15 ] . Its pre-packaged subsets isolate distinct sources of variability: receiver identity, capture day, and transmitter population size. This structure has made WiSig a standard benchmark for receiver- and channel-agnostic RF fingerprinting, motivating subsequent work on open-set authorisation [ 8 ] , data augmentation for channel resilience [ 20 ] , and receiver-agnostic fingerprinting via generative adversarial networks [ 24 ] . Despite these advances, a structural limitation persists across existing architectures. CNNs capture short-range amplitude and phase patterns through local convolutional filters, while standard Transformers [ 22 ] capture long-range dependencies through unconstrained attention weights. Neither architecture incorporates prior knowledge about the physical process generating the I/Q signal. The baseband waveform of a WiFi preamble evolves approximately as a rotation in the complex plane, driven by oscillator CFO and phase noise — dynamics that are energy-conserving by construction. Because attention mechanisms are unconstrained, models can freely attend to channel-dependent amplitude variations that do not generalise across receivers or capture days. This is the fundamental source of distributional failure under shift. To address this limitation, this paper introduces the Hamiltonian Transformer , a neural architecture that embeds an energy-conservation prior directly within the attention mechanism. Inspired by Hamiltonian neural networks [ 6 ] and symplectic integration theory [ 3 , 7 ] , the proposed model partitions value vectors within each attention head into position and momentum components and evolves them via a Störmer–Verlet leapfrog step governed by a learned skew-symmetric generator. Because skew-symmetric matrices generate orthogonal flows, the resulting value updates are norm-preserving by construction, aligning the model’s internal dynamics with the rotational behaviour of oscillator phase evolution. An explicit phase-increment embedding additionally exposes oscillator dynamics at the input representation level. The model is evaluated on the WiSig dataset across four experimental protocols using non-equalized raw I/Q signals throughout no channel preprocessing is applied at any stage. Under same-day conditions all architectures achieve high and comparable accuracy. The Hamiltonian Transformer achieves 99.12\% on same-day classification and 52.94\% on cross-receiver generalisation, the highest among all models in both settings. In the transmitter scaling experiment, the Hamiltonian Transformer maintains stable performance across all scale points and reaches 61.64\% at 150 transmitters, consistently outperforming both baselines. A controlled ablation study further demonstrates that norm-preserving value dynamics whether implemented via Hamiltonian leapfrog or Cayley orthogonal parameterisation [ 10 ] consistently outperform unconstrained attention at large transmitter counts, identifying norm-preservation as the key inductive bias for large-scale transmitter identification on raw signals. To the best of our knowledge, this is the first work to embed norm-preserving value dynamics into a Transformer attention mechanism for RF fingerprinting, and the first to systematically evaluate such constraints on the WiSig ManyTx subset using non-equalized signals. On this setting, our best-performing variant reaches 79.72\% at 150 transmitters, representing the highest published accuracy on non-equalized WiSig ManyTx in the literature. The contributions of this work are: • We introduce the Hamiltonian Transformer , a physics-informed attention architecture that constrains value vector dynamics to be norm-preserving through a Störmer–Verlet leapfrog update governed by a learned skew-symmetric generator, motivated by the rotational behaviour of oscillator-driven I/Q signals. • We propose an I/Q phase-increment embedding that exposes transmitter oscillator dynamics directly at the input representation level, providing the single largest per-component accuracy improvement in our ablation study. II Related Work Early efforts in RF fingerprinting relied on hand-crafted features derived from transient signals or spectral estimates. The landscape shifted when convolutional neural networks demonstrated that raw I/Q waveforms contain sufficient discriminative information to identify transmitters without explicit feature engineering. O’Shea et al. [ 14 ] showed that convolutional architectures could classify modulation schemes directly from baseband samples, establishing a paradigm later adopted by fingerprinting systems. Riyaz et al. [ 16 ] extended this approach to transmitter identification, demonstrating that a multi-layer CNN trained end-to-end on raw I/Q data achieves high accuracy on controlled datasets while offering practical advantages over classical feature-based pipelines. Subsequent work refined CNN-based RF fingerprinting architectures. ORACLE [ 18 ] performed extensive ablation studies over network depth, filter width, and input representations. Sankhe et al. [ 17

Read the complete text