When Generative Artificial Intelligence meets Extended Reality: A Systematic Review
Xinyu, NING a , Yan ZHUO a , Xian WANG a , Chan-In Devin SIO a , and Lik-Hang LEE a · 2025
Read When Generative Artificial Intelligence meets Extended Reality: A Systematic Review by Xinyu, NING a , Yan ZHUO a , Xian WANG a , Chan-In Devin SIO a , and Lik-Hang LEE a (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-03282.txt.
Introduction
Xinyu Ning and colleagues survey how generative artificial intelligence is being paired with extended reality. Extended reality covers virtual and augmented settings where users see and shape digital scenes. The review screens work from 2023 to 2025 with a formal method and keeps twenty-six studies for close analysis.
Across those studies, the authors sort uses by field and by the core tricks that make each system work. They chart fast growth, uneven coverage, and clear gaps where testing or design lags behind claims. Open chances for later work include better content control and smoother live interaction. The survey gives builders and scholars a compact map of a young, fast-moving blend of two fields.
Catalog record
| CREATOR | Xinyu, NING a , Yan ZHUO a , Xian WANG a , Chan-In Devin SIO a , and Lik-Hang LEE a |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-03282
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Generative Artificial Intelligence meets Extended Reality: A Systematic Review Xinyu, NING a , Yan ZHUO a , Xian WANG a , Chan-In Devin SIO a , and Lik-Hang LEE a Abstract With the continuous advancement of technology, the application of generative artificial intelligence (AI) in various fields is gradually demonstrating great potential, particularly when combined with Extended Reality (XR), creating unprecedented possibilities. This survey article systematically reviews the applications of generative AI in XR, covering as much relevant literature as possible from 2023 to 2025. The application areas of generative AI in XR and its key technology implementations are summarised through PRISMA screening and analysis of the final 26 articles. The survey highlights existing articles from the last three years related to how XR utilises generative AI, providing insights into current trends and research gaps. We also explore potential opportunities for future research to further empower XR through generative AI, providing guidance and information for future generative XR research. keywords Generative Artificial Intelligence; Extended Reality; Human-Computer Interaction; Systematic Review; † † articletype: Review Article † † affiliation: a The Hong Kong Polytechnic University, Department of Industrial and Systems Engineering, Hong Kong SAR, China 1 Introduction Generative artificial intelligence (AI) and Extended Reality (XR) are among the most revolutionary innovations in today’s technologies ( 24 , 24 ). Generative artificial intelligence can create entirely new data, images, audio, or video content based on a given input through techniques such as machine learning and deep learning, thereby significantly broadening the boundaries of digital creation ( 17 , 17 ). XR technology, encompassing augmented reality (AR), virtual reality (VR), and mixed reality (MR), offers users an immersive and interactive experience that seamlessly blends the virtual and real worlds ( 42 , 42 ). With the increasing intersection of the two, the application of generative AI in XR is beginning to show tremendous potential, particularly in fields such as gaming, education, healthcare, and industry, among others, driving the emergence of numerous innovative applications ( 53 , 53 ; 60 , 60 ). However, despite the great potential of combining generative AI and XR technology, relevant research is still in its preliminary stage, and there has been a lack of systematic discussion in the research community on this field for the past few years. Most existing research focuses on a single application scenario or technical level and lacks a comprehensive review and analysis. To address this gap, this article employs the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) method to systematically review the application of generative artificial intelligence in XR ( 56 , 56 ). The aim is to summarise the current research results, identify the main research trends, and provide references for future research. Specifically, the main objective of this article is to offer a concise yet systematic review of emergent generative artificial intelligence applications in the field of XR. The majority of these works are collected from the databases of computer science and engineering (e.g., ACM & IEEE). Our statistics facilitate a discourse on their practical uses and possibilities across many sectors. Combining the existing literature, we identify different application scenarios generated by artificial intelligence and XR technology, as well as the challenges and opportunities associated with pattern design. A future research direction accordingly is proposed, aiming to address the shortcomings of the selected scope from the existing literature and therefore identify unexplored areas of research related to human-computer interaction, e.g., security and privacy, user autonomy, and child protection. We outline the three key findings of our study and the corresponding future directions, as follows. 1. Contemporary generative AI technologies primarily concentrate on producing text, images, and various graphical assets, thereby facilitating the creation and instantiation of objects within virtual environments. There is insufficient consideration for other input or output modalities, including more complex user behaviours. 2. The majority of the existing studies attempt to demonstrate the potential XR applications enabled by diverse generative AI models, e.g, education and training for content creation. Nonetheless, the connection between generative AI and the underlying principle of human-computer interfaces is often neglected. 3. Generative AI primarily functions as an enabler in XR, delivering unimodal output based on a snapshot of user inputs. We advocate additional research efforts for investigating how the future role of generative AI will transcend its existing capabilities, acting as a vital integrator of various modalities in XR and as a dedicated agent of user experiences in the forthcoming research agenda of human-computer interaction. The structure of this article is as follows. First, we introduce detailed PRISMA methods and the selection process of the literature. Then, we present the application status of generative artificial intelligence in XR, and analyse related technologies and cases; Afterwards, we summarise the main findings in the literature, and discuss the current application challenges and opportunities; Finally, our article puts forward some suggestions for future research. 2 Methodology To capture the most recent studies, our literature review employed a two-stage approach, with the first data extraction conducted in February 2025 and the second in April 2025. Complied with the systematic approach, namely PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses), we selected 26 articles (see the * symbol and [number] (refer to Figure 7) at the title of each selected entry in the reference list) for data extraction and further analysis. PRISMA is a set of standard guidelines for conducting systematic literature reviews and meta-analyses ( 49 , 49 ). The system can comprehensively, clearly, and thoroughly explain the research methods and research results in a particular field, and then accurately evaluate the reliability and practical application value of research in this field. To ensure the rigour and transparency of our literature review process, the review was conducted in collaboration with the (co-)first authors to proceed with a systematic review ( 47 , 47 ) and meta-analysis ( 41 , 41 ). Figure 1 depicts the complete PRISMA procedures and the key results. After completing the initial search, we identified 673 candidate articles. Then, we initiated a structu filter protocol, which resulted in the removal of 36 duplicate articles, leaving 637 articles for the subsequent screening process. We screened these articles by title and abstract, excluding 602 articles that did not meet our criteria. After full-text evaluation, a further nine articles were excluded. The specific inclusion and exclusion criteria are detailed in the following paragraphs. 2.1 Search Strategies Figure 1: PRISMA flow diagram for systematic review. 2.1.1 Keywords Keywords mainly reflect the application of the generative AI model, content creation, and XR technology in three dimensions. Taking into account the terms expressed in different contexts, we chose the following keywords to describe the XR environment supported by generative AI: “generative AI”, “intelligent”, “content generation”, “algorithm-driven”, “automated authoring”, “virtual synthesis”, and “digital world building”. Other essential keywords related to generative AI models include “GANs” (generative adversarial networks), “diffusion model”, “converter architecture” (such as transformer), “data-driven design”, “image generation”, “3D scene generation”, “automatic content generation”, “personalized content generation” and “real-time content update”, “depth learning”, “neural networks”. Keywords and acronyms related to XR technology include “virtual reality”, “augmented reality”, “mixed reality”, “VR”, “AR”, and “MR” ( 65 , 65 ) While the primary focus of this article differs