Evil Vizier: Vulnerabilities of LLM-Integrated XR Systems
Yicheng Zhang University of California, Riverside, Zijian Huang ∗ * University of Michigan, Ann Arbor, Sophie Chen ‡ University of Michigan, Ann Arbor, Erfan Shayegani † \dagger University of California, Riverside, Jiasi Chen ‡ University of Michigan, Ann Arbor, Nael Abu-Ghazaleh † \dagger Universit · 2025
Read Evil Vizier: Vulnerabilities of LLM-Integrated XR Systems by Yicheng Zhang University of California, Riverside, Zijian Huang ∗ * University of Michigan, Ann Arbor, Sophie Chen ‡ University of Michigan, Ann Arbor, Erfan Shayegani † \dagger University of California, Riverside, Jiasi Chen ‡ University of Michigan, Ann Arbor, Nael Abu-Ghazaleh † \dagger Universit (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-15213.txt.
Introduction
Yicheng Zhang and five co-authors expose security holes where language models meet extended reality in a 2025 systems security paper. XR headsets increasingly call large language models to understand scenes and even generate executable content, and such AI glasses are reaching consumers. The integrated pipeline creates attack surfaces neither field faced alone.
The authors survey LLM-integrated XR systems in research and practice, sorting them along system dimensions to find a shared threat model. Proof-of-concept attacks then run on several platforms, including major headsets and smart glasses driving different underlying models. Though each integration differs, all share a weakness: an attacker who alters the public context around a legitimate query can corrupt what the user sees or hears. The demonstrations press vendors to treat context as untrusted input.
Catalog record
| CREATOR | Yicheng Zhang University of California, Riverside, Zijian Huang ∗ * University of Michigan, Ann Arbor, Sophie Chen ‡ University of Michigan, Ann Arbor, Erfan Shayegani † \dagger University of California, Riverside, Jiasi Chen ‡ University of Michigan, Ann Arbor, Nael Abu-Ghazaleh † \dagger Universit |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-15213
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evil Vizier: Vulnerabilities of LLM-Integrated XR Systems Yicheng Zhang University of California, Riverside, Zijian Huang ∗ * University of Michigan, Ann Arbor, Sophie Chen ‡ University of Michigan, Ann Arbor, Erfan Shayegani † \dagger University of California, Riverside, Jiasi Chen ‡ University of Michigan, Ann Arbor, Nael Abu-Ghazaleh † \dagger University of California, Riverside Abstract Extended reality (XR) applications increasingly integrate Large Language Models (LLMs) to enhance user experience, scene understanding, and even generate executable XR content, and are often called “AI glasses”. Despite these potential benefits, the integrated XR-LLM pipeline makes XR applications vulnerable to new forms of attacks. In this paper, we analyze LLM-Integated XR systems in the literature and in practice and categorize them along different dimensions from a systems perspective. Building on this categorization, we identify a common threat model and demonstrate a series of proof-of-concept attacks on multiple XR platforms that employ various LLM models (Meta Quest 3, Meta Ray-Ban, Android, and Microsoft HoloLens 2 running Llama and GPT models). Although these platforms each implement LLM integration differently, they share vulnerabilities where an attacker can modify the public context surrounding a legitimate LLM query, resulting in erroneous visual or auditory feedback to users, thus compromising their safety or privacy, sowing confusion, or other harmful effects. To defend against these threats, we discuss mitigation strategies and best practices for developers, including an initial defense prototype, and call on the community to develop new protection mechanisms to mitigate these risks. \onlineid 1996 \vgtccategory Research \vgtcinsertpkg keywords Extended Reality, LLMs, Security. 1 Introduction Extended Reality (XR) technologies, including Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), are reshaping how people interact with both digital content and the physical world. From immersive gaming ( e . g ., Beat Saber) to social platforms ( e . g ., VRChat) to industrial training and healthcare applications [ 2 , 23 ] , XR is evolving into a widely adopted computing paradigm. Releases of new hardware and software from major technology companies ( e . g ., Android XR, Apple Vision Pro) are evidence of this trend. In parallel, Large Language Models (LLMs) have become dominant interfaces for natural language reasoning and content generation, with tools such as ChatGPT [ 56 ] and Claude [ 4 ] integrated into our daily lives. These two trends are converging, enabling many exciting synergies: XR platforms integrate LLMs to enable conversational agents [ 11 ] , enhance scene understanding [ 51 , 12 ] , generate real-time interactive XR content [ 8 , 22 ] , and generally provide context-aware intelligence to XR users [ 9 ] . For example, Meta’s AI glasses (Ray-Ban Meta, Ray-Ban Display) include a built-in AI assistant that can understand a user’s voice queries, analyze the environment, and issue auditory feedback and device commands [ 61 ] . Academic prototypes also embedded LLMs into XR systems to enrich personalization and user interaction [ 33 , 21 ] . Figure 1 shows a general pipeline for such LLM-integrated XR systems. While LLM-integrated XR systems can enable impressive functionality, they also introduce new vulnerabilities and attack surfaces. Despite the growing number of prototypes of LLM-integrated XR systems that are available both from industry and academia, there has been little systematic examination of their security vulnerabilities. Existing works on XR security alone have focused on hardware, tracking, rendering, or multi-user vulnerabilities [ 18 , 35 , 70 , 30 , 49 ] and do not consider LLM integration, given the recency and experimental nature of these models. On the other hand, existing work on LLM security ( e . g ., prompt injection attacks [ 38 ] ) does not address downstream effects on the XR user or practical threat models in existing XR ecosystems. To close the gap between XR versus LLM security research, we ask: What new security risks emerge when LLMs are integrated into XR systems? In this work, we focus on the assumption that LLM-integrated XR systems provide correct responses to user queries. If an attacker could gain access to shared or public context surrounding legitimate LLM queries, whether at the software application level or by modifying the physical environment, it could manipulate the LLM’s generative behavior at the server. These outputs can then propagate downstream to other parts of the system that rely on them, triggering cascading effects. For instance, a malicious input might cause an LLM-based XR AI assistant to misidentify a real-world object and create a false UI menu, or generate unsafe navigation instructions, or inject unauthorized virtual elements. Because XR systems directly mediate users’ perceptions and physical actions, these errors or manipulations can cause significant risks for user safety and privacy. We call this an “evil vizier” approach, as the LLM, a seemingly trustworthy advisor in XR systems, now causes harm to unknowing users. Figure 1 : Threat model for LLM-integrated XR pipelines. To explore these issues, we first survey existing LLM-integrated XR systems and categorize them based on purpose and system attributes. Broadly speaking, the two main purposes we find are LLMs for XR user assistance, where LLMs support tasks such as interaction and interpretation, and LLMs for XR code generation, where LLMs generate executable XR logic for common XR game engines like Unity. From this survey, we select four commercially obtainable or open-source frameworks that span different system dimensions, and we design and demonstrate proof-of-concept attacks. These attacks are on off-the-shelf XR software and hardware platforms, including Meta Quest 3, Meta Ray-Ban AI glasses, Android-based XR, and Microsoft HoloLens 2. We focus on client-side (headset user) threats that do not require access to remote servers, and show that despite differing implementations, these systems share common vulnerabilities under a unified threat model. The key premise of the unified threat model is that an attacker, masquerading as a third-party library that provides legitimate functionality, often has access to public methods, objects, system events, or real/virtual environments that can be manipulated to indirectly influence the LLM’s responses. Finally, we discuss mitigation strategies and present an initial defense prototype. We hope that these contributions can help lay the foundation to secure the next generation of LLM-integrated XR systems. In summary, the contributions of this work are: • We provide a systematic categorization of how LLMs are integrated into XR frameworks along various system dimensions. • We experiment with commercial and open-source XR-LLM prototypes drawn from these categories, and develop a common and practical threat model. • We perform end-to-end proof-of-concept attacks on four LLM-integrated XR systems and demonstrate their efficacy and potential outcomes on users. • We provide best practice guidelines for developers and an initial defense prototype against malicious XR code generation attacks. The paper is organized as follows. Section 2 presents a systematic view of XR-LLM systems. Section 3 describes our threat model and experimental attacks on open- and closed-source LLM-integrated XR systems, Section 4 outlines potential mitigation strategies and best practices, Section 5 discusses related work, and Section 6 concludes the paper. 2 Systematic View of LLM-Integrated XR Systems In this section, we provide a systematic view of how LLMs are integrated with XR from a systems perspective. As prior surveys [ 28 , 55 ] focus on the interactions between