Augmented/Virtual Reality in Dermatology: A Digital Arsenal in Modern Era Authors: Soham R. Meghe, Raavi Ramapure, Sabiha Quazee, Adarshlata Singh, Sugat Jawade Published: 2024 ABSTRACT ABSTRACTIntroduction:Augmented reality (AR) refers to a group of technologies that capture, analyze, and superimpose digital information onto the real world. This information gives health care providers unique and useful perspectives that can enhance patient care.Materials and methods:AR has been utilized in selected scenarios in health care for several decades, notably laparoscopic surgery and vein finding. In recent years, improved wireless technologies, computing power, and analytics are leading to rapid growth in the AR industry. Novel health care specific use cases are rapidly being introduced with the potential to widely affect clinical care, particularly in dermatology because of the visual nature of the field.Results:In this article, we define AR, profile clinical and educational uses of AR in dermatology, and discuss key policy considerations for the safe and appropriate use of this emerging technology. INTRODUCTION The global health care augmented reality/virtual reality (AR/VR) market size is expected to quadruple from 2020 to 2025, and given the visual focus of most healthcare-related AR uses, dermatologists are likely to see more AR use cases, posing both opportunities and challenges. While AR has the potential to enhance dermatologists’ abilities to diagnose and manage cutaneous disease, incorrect use or overzealous early adoption could ultimately hinder clinical care. Furthermore, application of medical technologies that can distort reality might have the potential to exacerbate mental health conditions with cutaneous implications, such as body dysmorphic disorder and Munchausen syndrome.[1] Accordingly, as AR becomes more widespread in clinical and nonclinical settings, it will be important for dermatologists to be familiar with the technology’s strengths and weaknesses to ensure its appropriate use and to manage patient questions and concerns. Additionally, it is broadly important for dermatologists to understand new technologies, to appreciate where they are appropriate to be used in clinical care, and to engage in the societal narrative around the implications of these advances on dermatology, as has recently been discussed in the use of artificial intelligence in dermatology.[2] This article aims to provide an overview of AR technology, showcase current and near-term AR enabled tools pertinent to dermatologists, and discuss key policy considerations to ensure safe and reliable use of this powerful advancement for our field. METHODOLOGY For this review we performed a literature search using the Web of Science Core Collection and MEDLINE® databases. The descriptors used were “virtual environments,” “virtual reality,” “augmented reality,” “dermatology,” and “dermatological science”. We excluded the descriptor “skin” on purpose as we were not interested in haptics systems, but wanted to focus on the applications of augmented and virtual reality in dermatology only. Using these descriptors, the search was performed among “title,” “abstract,” and “author keywords”. We considered all publication years and document types. We did not exclude any “research areas”. We did not exclude any MeSH Qualifiers or MeSH Headings. We restricted our search to documents in the English language only. With such parameters, 70 articles were found, with 37 documents published in the last 5 years and 51 published in the research area “Dermatology” We manually went through the articles, selecting relevant ones via the title and abstract. CURRENT AND NEAR-TERM USES OF AR/VR IN DERMATOLOGY AR is currently being deployed across a spectrum of clinical scenarios within dermatology. These uses can be broadly categorized into procedure planning and real-time assistance, lesion measurement and tracking, and clinical and patient education [Table 1]. Table 1Current and near-term uses of AR/VR in dermatologyAR - categoryCategory descriptionSoftware example and target userReferenceLesion measurementPrograms digitally measure the size and other qualities of lesions and may include clinical decision support.Lesion Meter, a Smartphone application to measure skin lesions over time Target users: patientsLesion Meter[3]Lesion trackingPrograms measure the size and other qualities of lesions and may include clinical decision support.DermEngine’s full body imaging feature, a mobile or web-based image recognition program for identifying and tracking clinically relevant lesions. Target users dermatologistsDermEngine[4]The machine analyzes all photographs with ML-based segmentation and classification, looking for naevi and other cutaneous lesions. All naevi can be analyzed by artificial intelligence for their probability of being malignant. The information on these lesions is saved, with the position of each lesion on the body map, and upon repeated patient use of the Vectra device, changes are tracked over timeThe Canfield® Vectra WB360 device combines 2D photographs of 46 stereo-vision pods, resulting in a full-body VR reconstruction that can be turned and manipulated at will.Canfield® Vectra WB360 device[2]Procedure planningPrograms enhance surgical planning by creating rich 3D representations of patient anatomy.EchoPixel medical visualization software company undergoing clinical trials for procedural planning software use. Target users: physiciansEchoPixel[5]Real-time procedure assistancePrograms 1) superimpose digital information onto a patient through a headset or other devices or 2) create digital information displays with more robust information than standard monitorsMicrosoft HoloLens a headset display that superimposes digital information onto the users field of view, has been demonstrated to accomplish both real-time procedure assistance tasks Target users: physicians performing proceduresMicrosoft Hololens[6]Clinical educationPrograms create rich interactive clinical education experiences through 3D visualizations of disease, often superimposed on healthy individuals in unexpected ways, simulating real-life disease identification and management similar to medical standardized patientsmARble for medical student education a dermatology specific application with digital skin lesions superimposed on healthy individuals A wound care simulation for nursing students found enhanced performance on wound diagnostic parameters in the group that utilized AR Target users: health care traineesmARble[7]The app runs on standard Android smartphones, making it accessible to most students. A total of 100 patient vignettes can be solved by students, making it a unique learning opportunityVR app Virtual Derm, places students in a virtual practice for dermatologyVR app Virtual Derm[8]Patient educationPrograms in this category can enhance patient education across range of topics, including disease screening self-care disease management explaining imaging or other procedures, possible treatment outcomes, and any other existing patient education effortsClinical medicine application: SpellboundAR, a platform for creating AR patient education experiences that can be viewed through mobile devices, tailored to different clinical needs (eg. a simulation of sites and sounds of being in an MRI). Dermatology applications: Currently focus primarily on skincare and cosmetics, such as HiMirror and Samsung’s Lumini. Target users: patientsSpellboundAR[9] HiMirror,[10] and Samsung’s Lumini device[11] Current and near-term uses of AR/VR in dermatology CONCLUSION AR and VR have brought significant advances for dermatology in education—both for medical students and for patients and general public—in dermatological surgery, particularly for complex surgical operations and in diagnosis, particularly for naevi screening. Even though the technology has not revolutionized standard practice and is still rarely used in the field, the dramatic increase of the research performed during the last 5 years allows for optimism. There is more to come as the technology progresses and is democratized. However, we believe that VR will be replaced successively with AR approaches that allow users to directly interact with the clinical environment via dedicated haptics. Conflicts of interest There are no conflicts of interest.