Protecting On-Device AI Inference: A Systematic Review of Attacks and Defence Mechanisms Journal: Nuclear Physics B
Zisis Tsiatsikas, Alexandros Fakis, Georgios Karopoulos, Vasileios Kouliaridis, Marios Anagnostopoulos · 2026
Read Protecting On-Device AI Inference: A Systematic Review of Attacks and Defence Mechanisms Journal: Nuclear Physics B by Zisis Tsiatsikas, Alexandros Fakis, Georgios Karopoulos, Vasileios Kouliaridis, Marios Anagnostopoulos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29450.txt.
Introduction
Zisis Tsiatsikas presents the first review of threats and defence tools for on device inference. Many defence tools exist, including secure runs, homomorphic encryption, hiding, and privacy. Past surveys focus on edge intelligence, which covers training, and miss issues in on device runs. The review finds the attack and defence uneven. About one quarter of papers focus on IP attacks, whereas half of fixes tackle it. Some attack groups have no paper, such as attacks at roughly one third of papers.
Catalog record
| CREATOR | Zisis Tsiatsikas, Alexandros Fakis, Georgios Karopoulos, Vasileios Kouliaridis, Marios Anagnostopoulos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 114004 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29450
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Protecting On-Device AI Inference: A Systematic Review of Attacks and Defence Mechanisms Journal: Nuclear Physics B Zisis Tsiatsikas, Alexandros Fakis, Georgios Karopoulos, Vasileios Kouliaridis, Marios Anagnostopoulos Abstract The need for secure and private Artificial Intelligence (AI) and Machine Learning (ML) on edge and mobile devices has increased the necessity of protecting the architecture of these systems from threats to both security and privacy. With an ever-increasing number of pre-trained AI models being used on mobile platforms for client-side inference, there are rising concerns about the risks associated with the theft/extraction of AI models, adversarial attacks on AI models, and data breaches. As a result of this trend, a variety of defence mechanisms have been proposed to protect against these threats. These include Trusted Execution Environments (TEEs), homomorphic encryption, obfuscation, and differential privacy, among others. However, current surveys largely focus on edge intelligence, which includes distributed training, and thus overlook security and privacy issues that are specific to on - device AI inference. To the best of our knowledge, this paper presents the first comprehensive review of threats and corresponding defence mechanisms targeting on - device inference. Our results show that the attack and defence literature are unbalanced: approximately one quarter of the surveyed attack papers focus on Intellectual Property (IP) attacks, whereas half of the defence solutions tackle the same issue. More importantly, some attack categories have no defence paper associated to them, such as adversarial attacks that account for roughly one third of the attack literature. This asymmetry between known attacks and available mitigations highlights clear opportunities for future research on securing on-device AI inference. 1 Introduction Over the last decade, we witness a rapid evolution in Artificial Intelligence (AI) technology, beginning with Machine Learning (ML) models, including k-Nearest Neighbors (k-NN), Random Forests, Support Vector Machines (SVM) [ 29 ] to today’s Large Language Model (LLMs), which are equipped with billions of parameters and can be used to complete numerous complex tasks [ 88 ] . Some examples of AI models currently leading the way, include LLaMA, Claude, and ChatGPT, each of which has been widely adopted by individuals and organisations, and has a major impact on how content is created [ 87 ] . Beyond text-based processing, modern models are also now capable of performing a wide variety of additional common tasks, such as image and object recognition, as well as transcription and summarisation of various forms of data; these are some of the cornerstones of the emerging Generative AI (GenAI) paradigm. This rapid progress has created strong demand for AI - enabled services across many industries [ 24 ] . Modern AI architectures depend heavily on cloud-based systems to provide the most efficient use of resources and reach maximum scalability [ 2 ] . In addition to providing flexible usage to their clients (i.e., the ability to scale up or down), the pay-as-you-go subscription model also provides all of the “under-the-hood” details about how many requests will have access to a service and how AI models are deployed or upgraded. Additionally, the majority of consumers choose to go through cloud vendors because they provide a large variety of selection and provisioning options for each type of AI model and adhere to the most common security principles and frameworks, including ISO 27001 [ 11 ] and ISO 27017 [ 40 ] . Although cloud-based AI services provide a high level of security to the user, they create significant barriers to entry for privacy-sensitive applications (e.g., healthcare and finance), where regulatory requirements typically limit the transfer of sensitive data from local devices to external servers [ 97 ] . These constraints prevent users from capitalising on cloud-based AI services and restrict the GenAI features available to users. To satisfy security, privacy, latency, and bandwidth requirements, practitioners are increasingly deploying AI models that run entirely on the edge device. This family of AI models covers a wide range of applications, from browser - based LLM inference for privacy - preserving text processing [ 67 ] to intelligent vehicle perception tasks, such as vehicle and pedestrian detection, passenger counting, and road - anomaly sensing [ 31 ] . The mobile-oriented AI ecosystem is expanding rapidly, supported by numerous public repositories that provide easily accessible open-source pre-trained models [ 44 ] . These solutions are deliberately small, energy - aware, and tuned to the computational limits of smartphones, wearables, and Internet of Things (IoT) nodes. Running inference locally gives users direct control over both the model and the data, reduces exposure to network - based attacks, and narrows the attack surface to the device itself. Existing deployments are typically isolated either in software (e.g., WebAssembly modules [ 28 ] ) or in hardware enclaves, such as Trusted Execution Environments (TEEs) [ 68 ] . However, although isolation raises the bar for attackers, numerous studies have demonstrated techniques for bypassing these protections [ 46 ] . Our Contribution: Several recent surveys have examined AI inference on edge and mobile platforms, yet only a few address security and privacy concerns explicitly [ 3 , 56 , 61 ] . Moreover, existing defence strategies for protecting AI models on edge devices remain fragmented, and no comprehensive framework exists for comparing them. To fill this gap we performed a systematic literature review of 71 peer - reviewed works published between 2019 and 2025. To the best of our knowledge, this is the first study that focuses exclusively on security threats and corresponding defence mechanisms for on - device edge AI. Our contributions are threefold: • Survey assessment: We analyse all existing review articles on edge and on-device AI inference dealing with security and privacy issues, identifying gaps in coverage. • Attack taxonomy: We provide a taxonomy of the major attack families targeting on - device AI, describe their inter - relationships, and relate them to the current threat landscape. • Defence taxonomy and mapping: Based on the attack taxonomy analysis, we offer a multidimensional mapping of state - of - the - art defensive mechanisms, indicating which attack categories each method aims to mitigate, representative attack scenarios, and the impact of each defence on the confidentiality and integrity of on - device AI models. The remainder of the paper is organised as follows. In the following section, we outline background concepts and the scope of this research. Section 3 analyses relevant surveys from the literature related to AI inference on mobile and edge devices. In Section 4 , we present the methodology applied for searching and selecting the literature analysed in this survey. Following that, Section 5 presents the attacks against on-device AI models, highlighting their dependencies and how they are interconnected. Next, Section 6 provides a thorough evaluation of defence solutions against edge AI deployment threats. Finally, in Section 7 , we discuss our findings, whereas in Section 8 we analyse the challenges of edge AI, provide suggestions for addressing them, and suggest areas for future research. We conclude our paper in Section 9 . 2 Background and scope AI deployments can be classified into two broad categories: cloud-based (or centralised) and edge intelligence [ 56 ] . In the more traditional centralised paradigm, all of the data that was either collected or processed by