Large-Scale (Semi-)Automated Security Assessment of Consumer IoT Devices – A Roadmap
Pascal Schöttle Matthias Janetschek Florian Merkle Martin Nocker Christoph Egger · 2025
Read Large-Scale (Semi-)Automated Security Assessment of Consumer IoT Devices – A Roadmap by Pascal Schöttle Matthias Janetschek Florian Merkle Martin Nocker Christoph Egger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06712.txt.
Introduction
Pascal Schöttle and co-authors chart a road to automated security testing for consumer smart devices in a paper from 2025. Thermostats, cameras, and plugs now fill homes by the million. Their easy flaws make them favorite targets for attackers. Mandatory certification is coming, but hand testing cannot scale to the flood.
The paper reviews today's testing efforts and names the gaps. Manual audits are deep but slow and costly. A universal, large-scale assessment method does not yet exist. Semi-automated pipelines would let certifiers check many models repeatably. The roadmap lays the steps toward that machinery. Safer gadgets depend on testing that keeps pace with the market.
Catalog record
| CREATOR | Pascal Schöttle Matthias Janetschek Florian Merkle Martin Nocker Christoph Egger |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-06712
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large-Scale (Semi-)Automated Security Assessment of Consumer IoT Devices – A Roadmap Thanks: The financial support by the Austrian Federal Ministry of Labour and Economy, the National Foundation for Research, Technology and Development and the Christian Doppler Research Association is gratefully acknowledged. Pascal Schöttle Matthias Janetschek Florian Merkle Martin Nocker Christoph Egger Abstract The Internet of Things (IoT) has rapidly expanded across various sectors, with consumer IoT devices - such as smart thermostats and security cameras - experiencing growth. Although these devices improve efficiency and promise additional comfort, they also introduce new security challenges. Common and easy-to-explore vulnerabilities make IoT devices prime targets for malicious actors. Upcoming mandatory security certifications offer a promising way to mitigate these risks by enforcing best practices and providing transparency. Regulatory bodies are developing IoT security frameworks, but a universal standard for large-scale systematic security assessment is lacking. Existing manual testing approaches are expensive, limiting their efficacy in the diverse and rapidly evolving IoT domain. This paper reviews current IoT security challenges and assessment efforts, identifies gaps, and proposes a roadmap for scalable, automated security assessment, leveraging a model-based testing approach and machine learning techniques to strengthen consumer IoT security. I Introduction The Internet of Things (IoT) has become an integral part of modern society, with applications in various sectors such as smart manufacturing [ 1 ] , transport and logistics [ 2 ] , agriculture [ 3 ] , or healthcare [ 4 ] . In addition to these commercial use cases, consumer IoT (CIoT) devices, such as smart thermostats [ 5 ] , security cameras [ 6 ] , and connected home appliances [ 7 ] , are experiencing particularly rapid growth. A study published by Data Bridge Market Research estimates a global Compound Average Growth Rate for CIoT of 17.43% in the forecast period of 2021 to 2028 [ 8 ] . Connectivity of these devices facilitates automation, convenience, and efficiency, but also introduces new attack surfaces and security challenges [ 9 ] . Compared to traditional IT systems, IoT devices face distinct security challenges: Generally, IoT devices are resource-constrained, limiting the feasibility of implementing robust security mechanisms [ 10 ] . Additionally, the Open Web Application Security Project (OWASP) IoT Project has identified several critical issues in their Top 10 list, making these devices vulnerable to unauthorized access [ 11 ] . Their integration with critical infrastructure [ 12 ] and the handling of personal data [ 13 ] further make IoT devices an attractive attack target for malicious actors. High-profile incidents, such as the Mirai botnet and several breaches in industrial control systems [ 14 ] have displayed the high risk associated with insecure IoT devices. Automated security assessment and certification could address these security implications by providing transparency to customers and forcing manufacturers to apply good security practices. Accordingly, governments and regulatory organizations, including the EU, European Union Agency for Cybersecurity (ENISA), European Telecommunications Standards Institute (ETSI), and US National Institute of Standards and Technology (NIST), are introducing IoT security frameworks to mitigate emerging risks. However, no security assessment standard currently exists that systematically evaluates IoT security at scale. Several challenges arise in defining such a standard, including the scope of testing – whether it should cover hardware, software, or the entire system. The responsibility for security assessment is also unclear, as it could fall to manufacturers, independent IT security labs, or regulatory bodies. Additionally, the highly heterogeneous IoT landscape introduces an additional challenge regarding the scalability of security assessment efforts. Manual security assessment processes are slow, costly, and impractical given the scale and diversity of IoT devices. To address this, the industry requires semi- or fully automated security evaluation techniques that enable scalable, repeatable, and objective assessments. Initial efforts in this direction have already been made [ 15 ] . Further, machine learning has been applied to software testing [ 16 ] and web application security testing [ 17 ] , and may contribute to increasing security test automation. In this work, we review the current state of the art on IoT security challenges and security assessment efforts. We identify research gaps between security requirements, real-world vulnerabilities, and existing testing initiatives. By doing so, we are able to propose a roadmap outlining future research directions to address the key challenges of scalable IoT security assessment for consumer IoT devices. The remainder of this work is structured as follows: The subsequent sections II and III introduce the relevant background on the IoT in general and its security properties specifically. In Section IV , we present open challenges and our proposed roadmap before we conclude this work in Section V II The Internet of Things A key goal of digitalization is to link real-world objects, also called things, with the digital world of the Internet. These things transfer data to the Internet, which usually represent physical or chemical variables measured by sensors. This eliminates the strict separation between the real world and virtual worlds. Physical objects can have a virtual equivalent, which offers a wide range of new possibilities but also new threats. In the scientific literature, several IoT definitions appear, capturing different viewpoints. A rather general definition from Lee and Lee [ 18 ] , describes IoT as “a new technology paradigm envisioned as a global network of machines and devices capable of interacting with each other”. Dorsemain et al. [ 19 ] define the IoT as “a group of infrastructures, interconnecting connected objects and allowing their management, data mining and the access to data they generate” where the connected objects are “sensor(s) and/or actuator(s) carrying out a specific function that are able to communicate with other equipment”. All definitions include the connection of devices that collect environmental data and transfer them to other devices or central IT systems. This environmental data is usually collected via sensors and includes, for example, humidity, temperature, pressure, CO2 emission, and proximity. Other widespread sensors include gyroscopes, accelerometers, and location (e.g., GPS coordinates). The data can further be processed, remotely or directly on the device, and decisions can be derived, which are executed by actuators. II-A Industrial and Consumer Internet of Things IoT can be divided into several streams, primarily industrial IoT (IIoT) and consumer IoT (CIoT). The key distinction lies in their application contexts. IIoT builds upon the concept of the Industrial Internet, first introduced by General Electric, emphasizing the interconnection of industrial machines, sensors, and actuators within broader industrial networks. It is particularly relevant to industrial production [ 20 ] . CIoT, in contrast, focuses on consumer products, ranging from simple devices to sophisticated smart home systems [ 21 ] . Examples include smart bulbs and robot vacuums. Consumers typically choose from various comparable products, which often rely on WiFi connectivity. A home WiFi setup usually involves a router provided by an Internet service provider. In most cases, consumers cannot select the router model, and routers themselves qualify as IoT devices. CIoT encompasses numerous formerly standalone devices now integrated with network connectivity, such as smart locks, smart watches, robot vacuums, washing machines, smart meters, (semi-) autonomous cars, and more. Additionally, smartphones and tablets, equipped with various sensors, fall within the broader IoT category. Despite differing use contexts, IIoT and CIoT share fundamental