From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents

Liangxuan Wu 1 , Chao Wang 1 , Tianming Liu, Yanjie Zhao and Haoyu Wang 🖂 · 2025

Read From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents by Liangxuan Wu 1 , Chao Wang 1 , Tianming Liu, Yanjie Zhao and Haoyu Wang 🖂 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12981.txt.

Introduction

Liangxuan Wu, Chao Wang, Tianming Liu, Yanjie Zhao, and Haoyu Wang give, in a 2025 paper, the first broad security study of AI agents that run tasks on phones. Such agents break tasks into steps and tap through apps on their own. Their risks had not been mapped in full. The team sorts agents into three types: those built by phone makers, open agents from third parties, and new agent frames from tech firms.

They trace how agents work and find 11 attack surfaces across thought, screen taps, and system acts. To test the risks, they built a semi-auto tool, AgentScan, and ran it on nine live agents. Each agent fell to at least one attack. The worst cases showed flaws in eight of the test scenes. The work gives makers a map of what to fix first.

Catalog record

CREATORLiangxuan Wu 1 , Chao Wang 1 , Tianming Liu, Yanjie Zhao and Haoyu Wang 🖂
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-12981

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents Thanks: 🖂 Corresponding authors. 1 Equal contribution. Liangxuan Wu 1 , Chao Wang 1 , Tianming Liu, Yanjie Zhao and Haoyu Wang 🖂 Abstract The growing adoption of large language models (LLMs) has led to a new paradigm in mobile computing—LLM-powered mobile AI agents—capable of decomposing and automating complex tasks directly on smartphones. However, the security implications of these agents remain largely unexplored. In this paper, we present the first comprehensive security analysis of mobile LLM agents, encompassing three representative categories: System-level AI Agents developed by original equipment manufacturers (e.g., YOYO Assistant), Third-party Universal Agents (e.g., Zhipu AI AutoGLM), and Emerging Agent Frameworks (e.g., Alibaba Mobile Agent). We begin by analyzing the general workflow of mobile agents and identifying security threats across three core capability dimensions: language-based reasoning, GUI-based interaction, and system-level execution. Our analysis reveals 11 distinct attack surfaces , all rooted in the unique capabilities and interaction patterns of mobile LLM agents, and spanning their entire operational lifecycle. To investigate these threats in practice, we introduce AgentScan , a semi-automated security analysis framework that systematically evaluates mobile LLM agents across all 11 attack scenarios. Applying AgentScan to nine widely deployed agents, we uncover a concerning trend: every agent is vulnerable to targeted attacks . In the most severe cases, agents exhibit vulnerabilities across eight distinct attack vectors. These attacks can cause behavioral deviations, privacy leakage, or even full execution hijacking. Based on these findings, we propose a set of defensive design principles and practical recommendations for building secure mobile LLM agents. Our disclosures have received positive feedback from two major device vendors. Overall, this work highlights the urgent need for standardized security practices in the fast-evolving landscape of LLM-driven mobile automation. † † aftertitle: I Introduction Large Language Models (LLMs) have demonstrated remarkable capabilities in understanding and executing complex tasks [ 1 ] , which drives the emerging of mobile AI agents [ 2 , 3 , 4 ] that can improve user experiences and provide intelligent assistance to daily tasks. The integration of LLMs into mobile devices marks a pivotal shift in human-smartphone interaction [ 5 , 6 , 7 ] . Instead of navigating through multiple apps and menus, users can now express their intentions naturally, with LLM-powered agents automatically decomposing and executing complex tasks. These agents are implemented in different forms, ranging from system-level assistants deeply integrated into mobile operating systems (e.g., YOYO Assistant [ 8 ] on Honor smartphones), to third-party applications leveraging accessibility services for automation (e.g., Zhipu AI AutoGLM [ 9 ] ). This evolution has significantly simplified user interaction, as complex tasks that required multiple manual steps and app interactions can now be initiated with a simple voice command [ 10 , 11 ] . However, while enhancing user experience, mobile LLM agents open doors to new kinds of targeted attacks. On-device LLM agents typically operate with elevated permissions or system privileges. Unlike traditional software components that exhibit deterministic behavior after rigorous verification, LLM agents operate with inherent probabilistic decision-making processes and execute tasks based on unstructured natural language instructions. Prior studies have uncovered security risks in web-based LLM agents, including trajectory optimization flaws [ 12 ] , prompt-based web exploitation [ 13 ] , and novel agent attack vectors [ 14 ] . Other works highlight backdoor vulnerabilities [ 15 ] , privacy leakage via environment injection [ 16 ] , and action manipulation in vision-language agents [ 17 , 18 ] . However, mobile environments present fundamentally different security challenges, characterized by unique UI interactions, system privileges, and hardware interfaces that necessitate distinct analytical and mitigation approaches. While mobile device manufacturers increasingly deploy on-device LLM agents, there lacks a standardized framework for systematically evaluating their security implications. Our analysis reveals that existing security analysis approaches fail to capture the unique challenges of mobile LLM agents, particularly their complex interaction with system privileges, UI components, and multi-modal inputs. To our knowledge, this is the first systematic investigation into the diverse implementation mechanisms and associated security threats of mobile LLM agents . We analyze the complete agent pipeline, from instruction interpretation to task execution, and extract three core capabilities that underpin agent operation: language-based reasoning , GUI perception and interaction , and system-level execution . Based on these capabilities, we define three corresponding security analysis dimensions: the LLM layer , the GUI layer , and the System layer . While no prior work has systematically investigated the security risks of mobile LLM agents, each of these dimensions has been independently explored in related contexts, such as language model vulnerabilities, UI-based deception, and Android system exploitation. We draw inspiration from these established research threads and adapt their insights to the unique operational setting of mobile agents. In doing so, we bridge the gap between traditional security domains and this emerging agent paradigm. Furthermore, we extend our analysis by considering agent-specific attack surfaces introduced by capabilities such as multimodal screen interpretation and dynamic decision delegation. Through this combined analysis, we identify 11 distinct attack surfaces that span the entire operational lifecycle of mobile LLM agents, laying the foundation for systematic threat modeling and security evaluation in this emerging field. To support systematic security analysis of on-device LLM agents, we present AgentScan , a semi-automated testing framework designed to uncover security vulnerabilities across the agent’s end-to-end workflow. The framework systematically emulates adversarial behaviors across three core dimensions of agent interaction: language understanding, GUI perception and interaction, and system-provided capabilities. In each dimension, we injects crafted attack inputs or environmental disturbances at precise execution stages—for example, inserting misleading prompts into UI content, overlaying invisible interface components to hijack clicks, or redirecting app launches via fake apps. These scenarios are aligned with real-world threat models and implemented using lightweight third-party apps, overlays, or instruction manipulation. Using AgentScan , we empirically validated the feasibility and impact of a wide range of attacks in real-world settings. Our evaluation of 9 widely deployed mobile LLM agents reveals a troubling landscape: all agents exhibit vulnerabilities to targeted attacks , with varying levels of exposure across interaction layers. Most notably, UI manipulation attacks are universally effective —every tested agent fails to defend against Transparent Overlay and Pop-up Interference attacks, which can lead to behavioral deviation, privacy leakage, or full execution hijacking. These findings expose fundamental design flaws in current agent implementations and underscore the urgent need for security-aware development practices in the rapidly evolving ecosystem of LLM-powered mobile agents. We have reported our findings to the relevant vendors through responsible disclosure. At the time of writing, two OEMs have responded with acknowledgment and appreciation of our research contributions. Contributions. We make the following key contributions: • Systematic Characterization of Mobile LLM Agents. We conduct the first structured analysis of mobile LLM agents across different deployment forms. We decompose their typical workflow into three core dimensions—LLM interaction, GUI interaction, and system interaction—and identify 11 distinct attack surfaces that span these layers. • Security Analysis Framework for Mobile LLM Agents. We design and implement a semi-automated testing framework, AgentScan , to systematically identify security threats across the agent workflow. The framework supports extensible attack capabilities and releases to the public to

Read the complete text