Optimizing IoT Intrusion Detection with Tabular Foundation Models for Smart City Forensics

Asma Al-Dahmani 1,∗, Abdulla Bin Safwan 1,∗, Mohammad Obeidat 2, Belal Alsinglawi 1,∗∗ · 2026

Read Optimizing IoT Intrusion Detection with Tabular Foundation Models for Smart City Forensics by Asma Al-Dahmani 1,∗, Abdulla Bin Safwan 1,∗, Mohammad Obeidat 2, Belal Alsinglawi 1,∗∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11394.txt.

Introduction

Al-Dahmani and three colleagues evaluate TabPFNv2.5, a transformer-based tabular foundation model, for IoT intrusion detection in smart cities. On the TON IoT dataset it runs 40 times faster than Random Forest while holding 97 percent binary classification accuracy. This supports a hybrid pipeline where the foundation model screens threats rapidly and ensembles handle detailed classification. Scanning attacks prove hardest to catch, at 69.8 percent F1. Cross-device generalization hinges on feature similarity.

Catalog record

CREATORAsma Al-Dahmani 1,∗, Abdulla Bin Safwan 1,∗, Mohammad Obeidat 2, Belal Alsinglawi 1,∗∗
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21028
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11394

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimizing IoT Intrusion Detection with Tabular Foundation Models for Smart City Forensics Asma Al-Dahmani 1,∗, Abdulla Bin Safwan 1,∗, Mohammad Obeidat 2, Belal Alsinglawi 1,∗∗ Abstract Security operations in smart cities demand detection systems that balance accuracy with response time. While ensemble methods like Random Forest achieve high accuracy, their computational overhead impedes real-time forensic triage. We present the first systematic evaluation of TabPFNv2.5, a transformer-based foundation model, against traditional ensemble classifiers for IoT intrusion detection. Using the TON_IoT dataset, we demonstrate that TabPFNv2.5 achieves 40 × \times faster inference than Random Forest while maintaining 97% binary classification accuracy. We propose a hybrid pipeline in which TabPFNv2.5 performs rapid threat screening, while ensemble models handle detailed classification. Our analysis reveals that scanning attacks remain the hardest to detect (F1: 69.8%) and cross-device generalization depends critically on feature similarity. These findings establish foundation models as viable components for time-sensitive IoT security operations. 1 Introduction The expansion of Internet of Things (IoT) devices in urban infrastructure has fundamentally altered the cybersecurity landscape. Modern smart cities integrate millions of interconnected sensors, actuators, and controllers that manage transportation networks, energy grids, and public services [ 1 ] . This inter-connectivity, while enabling operational efficiency, creates expansive attack surfaces where adversaries can compromise multiple subsystems within minutes of initial breach [ 2 ] . Security analysts face a critical operational challenge: they must rapidly assess diverse telemetry streams from heterogeneous devices while maintaining classification accuracy sufficient for forensic documentation. Current machine learning approaches, particularly ensemble methods such as Random Forest and Gradient Boosting, deliver excellent accuracy but impose computational overhead that conflicts with real-time investigation requirements [ 3 ] . This tension between speed and accuracy represents a fundamental barrier to effective IoT security operations. Existing intrusion detection research has extensively validated ensemble methods for IoT environments, consistently demonstrating accuracy exceeding 99% on benchmark datasets [ 4 ] [ 5 ] ; however, three critical gaps persist in the literature. First, the computational cost of ensemble training and inference has received limited attention despite its operational significance, as Security Information and Event Management (SIEM) systems process thousands of events per second, and models that require hundreds of milliseconds per inference can create bottlenecks that delay threat identification. Second, foundation models—pre-trained architectures that generalize across tasks without retraining—have transformed natural language processing and computer vision, yet their application to cybersecurity tabular data remains largely unexplored; TabPFNv2.5 [ 6 ] [ 7 ] represents a promising candidate by delivering millisecond-level inference using frozen weights, thereby eliminating training overhead entirely. Third, existing evaluations rarely quantify the speed–accuracy tradeoff in terms meaningful to security practitioners, leaving unclear how much accuracy must be sacrificed to achieve real-time capability and whether hybrid architectures can mitigate this tradeoff. This paper addresses these gaps through a comprehensive empirical study. Our contributions are: (1) a first systematic comparison of TabPFNv2.5 against ensemble methods for IoT intrusion detection, evaluating binary and multi-class classification across seven device categories using 3.6 million telemetry records; (2) quantification of the speed–accuracy tradeoff, demonstrating that TabPFNv2.5 achieves 40 \times faster inference than Random Forest with only a 2.3% reduction in binary accuracy, thereby establishing concrete parameters for deployment decisions; (3) a hybrid forensic investigation pipeline that utilizes TabPFNv2.5 for rapid threat triage while preserving ensemble accuracy for detailed classification, aligning with SIEM-driven workflows; (4) a cross-device generalization analysis revealing that model transferability depends critically on feature similarity, with implications for heterogeneous IoT deployments; and (5) an attack-specific detection analysis identifying scanning as the most challenging category (F1: 69.8%) due to its behavioral similarity to benign reconnaissance. The remainder of this paper proceeds as follows. Section 2 reviews IoT security challenges and relevant machine learning approaches. Section 3 describes our dataset, proposed pipeline, and experimental configuration. Section 4 presents classification performance, computational efficiency, and generalization results. Section 5 discusses practical implications and limitations. Section 6 concludes with future research directions. 2 Background and Literature Review 2.1 Smart City IoT Security Landscape Smart city environments all depend on IoT and Industrial IoT (I-IoT) interconnectedness to support urban services such as transportation systems, energy distribution, healthcare, and community safety [ 8 ] . Implementation refines efficiency and automation, expanding the attack surface across multiple devices, protocols, and network layers. The use of 5G increases complexity and connectivity density, allowing attackers to gain access to multiple devices quicker once a backdoor has been found [ 9 ] . Realistically, smart cities are exposed to various high-impact threats such as DDoS attacks, brute-force attacks, injection activity (e.g., XSS and SQL), and large-scale surveillance scanning [ 1 , 2 ] . The vulnerability lies in how quick an attacker can gain lateral access through an interconnected system, leading to disruptions of critical services. 2.2 Machine Learning fort Intrusion Detection Machine learning-based intrusion detection has become the dominant approach for detecting anomalous network behavior, replacing signature-based methods that struggle to identify novel threats [ 3 ] . Ensemble techniques have proven particularly effective. Random Forest combines multiple decision trees trained on bootstrap samples, improving accuracy while maintaining interpretability through feature importance analysis. Gradient Boosting sequentially refines models by correcting residual errors, often achieving higher accuracy at the expense of increased computational complexity [ 10 ] . Prior studies validate ensemble methods in IoT environments. Ashraf et al. [ 1 ] proposed a scalable IDS for smart city networks capable of handling heterogeneous, high-volume traffic. Alhowaide et al. [ 4 ] showed that ensemble decision trees provide strong baselines for cloud-based IDS by balancing detection performance and inference latency. Despite their effectiveness, ensemble models typically require task-specific training, leading to increased computational cost and reduced efficiency in dynamic environments requiring frequent updates. 2.3 Foundation Models for Tabular Data Foundation models have revolutionized machine learning by demonstrating that pre-trained architectures can generalize effectively across diverse downstream tasks. While transformers have dominated text and image domains, their application to tabular data has emerged more recently. TabPFN [ 6 ] introduced a prior-data fitted network that performs Bayesian inference through forward passes, eliminating the need for task-specific training. TabPFNv2.5 [ 7 ] [ 11 ] extends this approach with improved scalability, achieving competitive accuracy on datasets up to 10,000 samples while maintaining millisecond-level inference using frozen weights. The cybersecurity implications of this capability are significant. In forensic contexts, analysts frequently encounter novel attack patterns that traditional models have not seen during training. Foundation models’ ability to generalize without retraining offers potential for rapid assessment of emerging threats. However, empirical validation of this capability for intrusion detection remains limited, motivating our systematic evaluation. 3 Methodology 3.1 Dataset Description We employ the TON_IoT dataset [ 12 ] , a comprehensive telemetry collection designed for IoT intrusion detection research. The dataset comprises network traffic from seven device categories spanning consumer IoT (smart refrigerator, garage door controller, GPS tracker, etc.) and industrial IoT (Mod bus controller), totaling 3,606,134 records. Table 1 presents device-level statistics and attack type distributions. Table 1: Dataset composition: device categories and attack type distribution Device Category Records Normal Attack Attack Rate Smart Refrigerator 587,076 500,827 86,249 14.7% Garage Door 591,446 515,443 76,003 12.9% GPS Tracker 595,686 513,849 81,837 13.7% Modbus (IIoT) 287,194 222,855 64,339 22.4% Motion Light 452,262 388,328 63,934 14.1%

Read the complete text