Holographic Transmission for Real-time Education and Medical Care Authors: Giselle Coelho Resende Caselato, William D Freeman Published: 2026 ABSTRACT AbstractHolographic transmission represents a transformative convergence of advanced imaging, augmented reality, and extended reality technologies for real-time education and medical care. We reviewed the current state of holographic transmission, emphasizing its applications in intraoperative guidance, telementoring, teleteaching, and telesupervision. By enabling real-time, life-sized 3-dimensional interaction across distances, holographic systems can democratize access to expertise, especially in underserved or remote areas. We analyzed technical enablers, including high-speed digital cameras, CoaXPress data transmission, graphics processing unit–based reconstruction, and 5G low-latency networks for their role in achieving near real-time fidelity. Two proof of concept demonstrations validate the technology’s feasibility: a transcontinental surgical telementoring session between Boston, MA, and São Paulo, Brazil, and a large-scale educational holographic transmission connecting Mayo Clinic (United States) and the G7 Summit (Brazil). Both achieved seamless, bidirectional volumetric communication without perceptible delay, showcasing immersive copresence for clinical and educational collaboration. Despite these advances, barriers persist, most notably high implementation costs, latency sensitivity, limited field of view, and the digital divide that restricts broadband and electrical infrastructure in low-resource regions. Ethical issues surrounding privacy, data ownership, and equitable access also require structured governance. Our discussion highlights holographic telemedicine’s potential to establish a borderless educational landscape where knowledge flows freely and health care equity is strengthened globally. Continued innovation, investment in infrastructure, and development of ethical and regulatory frameworks are necessary to create truly global, real-time, and immersive health care without borders. We provide a comprehensive analysis of the current state of holographic transmission technology and its applications in real-time or near real-time medical and surgical care. We focus on its utility for intraoperative guidance, telementoring, teleteaching, and telesupervision, emphasizing its potential to facilitate global knowledge sharing, especially for rural, remote, and underserved areas. Holographic transmission, an advanced form of augmented reality (AR) and extended reality, is rapidly moving beyond conceptual stages. Systems with US Food and Drug Association clearance now enable interactive 3-dimensional (3D) visualization for complex medical procedures.1 Its applications include enhancing surgical precision, revolutionizing medical education, and facilitating remote patient care.2 This progress relies on a sophisticated, tightly integrated ecosystem of high-speed hardware; efficient data standards; powerful computing; and robust, low-latency network infrastructure. The ability to achieve true real-time experiences depends on the quality of the weakest link in this interdependent chain. Although offering unprecedented opportunities to democratize health care access by extending specialized care and training across geographic boundaries, considerable technical, economic, infrastructural, and ethical hurdles necessitate strategic development and policy. Successful implementation of holographic telemedicine, for instance, depends on overcoming foundational infrastructure challenges, such as limited broadband access and unreliable electricity, which contribute to the digital divide. Furthermore, a critical consideration is the paradox where the technical elements designed to enhance precision, such as real-time 3D overlays, can, if imperfect or poorly optimized, introduce new risks or negate intended benefits. The convergence of high-speed data transfer, advanced computing, and holographic display technologies positions the field of holography as a cornerstone for future precision medicine and global health equity. Realizing this potential, however, requires overcoming existing barriers and fostering interdisciplinary collaboration. In October 2021, National Aeronautics and Space Administration reported the first holoportation of humans into space. Using HoloLens technology (Microsoft) and AEXA Aerospace software (Aexa Aerospace LLC), flight surgeon Dr Josef Schmid, AEXA Chief Executive Officer Fernando De La Peña Llaca, and their team were holoported to the International Space Station, where they appeared as life-sized 3D holograms and interacted with astronaut Thomas Pesquet in real-time (Figure 1). National Aeronautics and Space Administration described this event as “the first time in history that humans have been holoported from Earth to space.”3 Advances in 3-dimensional holographic communication for space missions and surgical training. In October 2021, NASA flight surgeon Dr Josef Schmid, AEXA Aerospace Chief Executive Officer Fernando De La Peña Llaca, and their team were the first humans holoported from Earth into space. Copyright to ESA/T. Pesquet. This demonstration showed how mixed reality telepresence can allow specialists to provide real-time medical consultation, telementoring, and remote supervision across vast distances. National Aeronautics and Space Administration emphasized that this technology could support future long-duration missions to the Moon and Mars by enabling Earth-based experts to beam into spacecraft or planetary habitats, with potential applications for remote medicine and education in underserved or inaccessible regions on the Earth. Holographic Transmission in Health Care The common perception of holographic technology often aligns with depictions from science fiction—free-standing, interactive 3D projections visible to all without specialized equipment. However, the reality in medicine frequently involves advanced AR or extended reality systems that use holographic principles for enhanced 3D visualization, which still require the use of headsets. This gap between public expectation and current medical holographic systems can lead to disconnection in user acceptance. Even highly functional AR headsets, despite their advanced capabilities, may have limitations such as a restricted field of view or focal rivalry, where the human eye struggles to simultaneously focus on real and virtual images. This discrepancy underscores the importance of accurately representing the current state of the technology and fostering realistic adoption strategies within health care. Foundational Principles and Evolution in the Medical Field Holography uses laser beams split into a reference beam and an object beam. These beams record interference patterns that are reconstructed into a 3D image. This process captures comprehensive light field information, allowing the image to be viewed from multiple angles. The evolution of holographic imaging has been driven by a demand for superior 3D visualization, detailed anatomic information, and the capacity to digitally store and access vast amounts of patient data. Modern holographic imaging systems enhance medical technology by using light instead of ionizing radiation, offering gentle yet precise insights into tissue structures. This contemporary approach is multifunctional, integrating imaging, analysis, and data evaluation in real-time workflows. Technical Advancements Enabling Real-Time Performance Achieving real-time or near real-time holographic transmission in medical applications is a complex engineering challenge that relies on a sophisticated and tightly integrated system of hardware, software, and network infrastructure. The system’s performance and its ability to deliver true real-time experiences depend on the quality of the weakest link in this interdependent chain. Therefore, future advancements and successful widespread adoption must involve comprehensive development across all domains, rather than isolated improvements in a single area. High-Speed Digital Cameras High-speed digital cameras are essential for capturing the intricate morphologic and dynamic temporal details required for real-time holographic reconstruction. For instance, the Phantom S710 camera (Vision Research Inc) can capture a 512×512-pixel (12-bit) image at an astonishing rate of over 20,000 frames per second. This rapid acquisition capability is crucial for capturing transient biologic phenomena, such as blood flow dynamics. CoaXPress (JIIA) Standard for Data Transmission CoaXPress digital interface standard manages the transfer of high-volume image data at very high speeds in real-time without loss of information. It is specifically chosen for its robustness in handling the ever-increasing size and speed of optical sensor data. Implementation of multiple Coaxlink Octo cards (Euresys), each offering 8 CoaXPress CXP-6 connectors, is necessary to achieve the required digital data transfer capabilities while guaranteeing data integrity and precise timing. Graphics Processing Units The advent of powerful graphics processing units has greatly enhanced signal processing capabilities, which are vital for real-time reconstruction of precise holographic images from raw interference patterns. Their parallel processing architecture is ideally suited for the computationally intensive algorithms involved in digital holography, enabling rapid image rendering. Direct Memory Access Direct memory access allows synchronized acquisition data from multiple sources, such as 2 Coaxlink Octo cards, to be reconstructed in real-time into a single global image. This image is then made directly available in the computer’s memory without delay, minimizing latency in the data pipeline. 5G High-Speed Data Networks 5G high-speed data networks are crucial for creating seamless, crystal-clear 3D holograms with minimal delays during surgeries, as showed by the National University Hospital in Singapore. 5G’s low-latency and high bandwidth are indispensable for remote real-time applications, facilitating smooth interaction and visualization. Advanced Light-Shaping Techniques Advanced light-shaping techniques are advancing the development of high-resolution, minimally invasive medical imaging. They enable the use of single, hair-thin glass fibers (0.1 mm in diameter) to visualize abnormalities deep within the brain. This is particularly important for detecting and understanding diseases such as Alzheimer disease and Parkinson disease without invasive tissue sampling. Start-ups such as DeepEn GmbH, a spin-off from Leibniz Institute of Photonic Technology, are actively optimizing image quality and data analysis for both research and clinical use, aiming for subcellular resolution and light-based biopsies. Telementoring, Teleteaching, and Telesupervision Holographic systems enable expert surgeons to virtually join operations occurring in other parts of the world, providing a comprehensive 3D view of the entire operating room. This allows for superior remote assistance and guidance than traditional video calls. Telementorship is a method by which a mentor interactively guides a mentee at a different geographic location in real-time using technologic communication devices. Augmented reality technology has been widely incorporated into these telementoring systems across global health care environments. Holoeyes (Holoeyes Inc) integrates metaverse technology to facilitate spatial conferencing and training scenarios,4 where avatars can replicate the hand and eye movements of actual surgical procedures, providing a realistic remote collaboration experience. Augmented reality enables high-quality remote training by allowing surgical trainees to connect seamlessly with mentors and specialists across the globe. Learners can interact directly with industry experts who provide real-time guidance, clarify questions, and address challenges step-by-step. This creates an immersive experience that closely replicates the sense of working side-by-side, even across great distances. SimX’s multiplayer virtual reality technology allows multiple learners to work as a team in the same virtual space,5,6 supporting intersite, interstate, and international practice and fostering global collaboration in medical education. The benefits of AR telementoring systems include a documented reduction in skill errors, improved task completion time and accuracy, and consistently positive feedback from users.7 It enhances access to information and facilitates expert guidance across diverse health care settings. Holographic transmission, particularly through its advanced telementoring, teleteaching, and telesupervision capabilities, acts as a powerful catalyst for the democratization of expertise in health care. By enabling real-time, immersive 3D collaboration and direct guidance across vast geographic boundaries, it effectively transfers highly specialized medical knowledge and skills to remote, rural, and underserved areas globally.8 This fundamentally changes traditional models of medical education and care delivery, promising to substantially reduce health disparities stemming from unequal access to specialized medical professionals. Bridging The Digital Divide: Global Access and Knowledge Sharing Potential of Holographic Telemedicine to Reach Rural, Remote, and Underserved Areas Holographic telemedicine is a promising solution to address 2 critical challenges in health care in rural, remote, and underserved areas: the shortage of doctors and limited opportunities for medical training. This advanced form of telehealth can greatly reduce the challenges patients encounter in rural areas, such as transportation issues related to traveling for specialty care. Telehealth allows rural clinicians to provide high-quality care within their own communities, often at reduced costs, by enabling patients to receive virtual consultations instead of traveling long distances. This approach expands access to essential services while minimizing geographic and financial barriers. Moreover, telehealth enhances overall care quality by giving rural providers the ability to consult with specialists who may not be locally available. Through real-time collaboration and shared decision making, clinicians can manage a wider range of medical conditions and deliver more comprehensive patient care. Augmented reality technology provides accessibility and flexibility for training, allowing modules to be delivered in underserved or remote areas where specialized spaces or faculty are limited. This democratizes access to high-quality medical education. Holographic technology allows doctors to offer treatment or consultation to patients who are geographically distant or unable to travel, directly addressing barriers to care. Addressing Challenges of Geographical Barriers and Specialist Shortages Telementoring, a subcategory of telemedicine, provides real-time remote guidance for health care procedures or skills. It plays a crucial role in granting remote access to care and expertise, facilitating the sharing of specialized knowledge and education across distances.9 It offers a direct solution to providing professional assistance and training at a distance, supporting expert medical professionals in guiding less-experienced practitioners in remote locations. The ability to consult with specialists virtually alleviates the burden of specialist shortages in rural communities, which is particularly critical in fields such as neurology and psychiatry, where access to providers is often limited. Telehealth, including holographic applications, can improve clinical decision making in real-time and reduce unnecessary patient transfers to larger hospitals, thereby ensuring timely and appropriate care locally. Although holographic telemedicine holds great promise for bridging the digital divide and promoting health equity by extending specialized care and training to rural, remote, and underserved areas, its successful implementation is dependent on overcoming foundational infrastructure challenges. The pervasive digital divide in health care, characterized by limited broadband access, unreliable electricity, and inadequate network infrastructure, represents a critical and often overlooked bottleneck. Without targeted investment and strategic development in these basic digital determinants of health, the transformative potential of holographic solutions in these regions will remain largely unfulfilled, perpetuating existing disparities rather than alleviating them (Table). TableBenefits and Challenges of Holographic Telemedicine in Underserved AreasCategory/aspectDetailBenefits Access to careIncreased access to specialists and timely care for rural and remote residents, reducing travel burdens for patients Cost savingsDecreased direct and indirect costs for patients (eg, travel and lost work hours) and providers (eg, staffing and lower onsite resource use) Training and educationAlleviates specialist shortages, improves continuity of care, and provides professional assistance and training at a distance, democratizing access to high-quality medical education Enhanced collaborationEnables rural providers to consult with specialists virtually, addressing a broader range of conditions and improving clinical decision makingChallenges InfrastructureLimited broadband access, costly deployment in low-density/difficult terrain areas, and inadequate basic services (eg, electricity and telephone) Economic costsHigh cost of applications, installation, maintenance, and broadband services may outweigh savings, especially in settings with low patient volume; high cost of devices (eg, $500-$1000 for high-end virtual reality headsets) and application development ($30,000-$300,000+) Digital divideExacerbated by limited broadband, low digital literacy, and cultural mismatches in technology design for underserved populations Technical limitationsLatency, limited field of view, tracking accuracy issues, and challenges in maintaining stable network connections Regulatory and ethicalData privacy concerns (eg, collection, storage, and sale), lack of clear data ownership guidelines, need for robust cybersecurity, and issues of informed consent User acceptanceDiscomfort and distraction from wearable devices, steep learning curves, potential for overreliance, and focal rivalry issues Benefits and Challenges of Holographic Telemedicine in Underserved Areas Transcontinental Holoportation for Surgical Telementoring A pioneering transcontinental holoportation experiment was conducted between Boston, United States, and São Paulo, Brazil, marking the first global demonstration of holographic telementoring in a simulated surgical environment. In this setup, Dr Benjamin Warf (Boston) and Dr Giselle Coelho (São Paulo) simultaneously occupied a shared 3D holographic operating room (Figure 2). The system transmitted bilateral volumetric 3D data in real-time, allowing both participants to appear as life-sized holograms in each other’s environment without noticeable latency. Advances in 3-dimensional (3D) holographic communication for surgical training. Dr Benjamin Warf (Boston) and Dr Giselle Coelho (São Paulo) were simultaneously immersed in a shared 3D holographic operating room. The system transmitted bilateral volumetric 3D data in real-time, allowing both participants to appear as life-sized holograms in each other’s environment without perceptible latency. Both physicians wore Microsoft HoloLens headsets, which enabled natural interaction within their own field of vision. Dr Coelho performed a simulated neurosurgical procedure (endoscopic third ventriculostomy and tumor biopsy) on a hydrocephalus baby model, and Dr Warf provided real-time intraoperative guidance. Remarkably, Dr Warf’s holographic projection was able to move around the operating table, creating the impression that he was physically present in Brazil, where Dr Coelho could see his holographic presence as she worked. This proof of concept showed the feasibility of holographic telesupervision and telementoring across continents and was considered highly disruptive, setting a precedent for global surgical training and remote collaboration in health care. Holographic Education at International Conferences A second proof of concept extended holographic transmission into large-scale medical education. A link was established between 2 major events held simultaneously on different continents: the Florida Healthcare Simulation Alliance conference at Mayo Clinic in Jacksonville, FL (United States) and the G7 Summit in São Paulo (Brazil). Through holographic transmission, Dr Giselle Coelho and Dr W. David Freeman were projected live on stage as 3D holograms in Brazil, while interacting with audiences at both venues (Figure 3). The system achieved real-time bidirectional communication without any perceptible delay, underscoring the maturity of the technology. Real-time holographic telepresence connecting global audiences. (A) Dr Giselle Coelho and Dr W. David Freeman projected live on stage as 3-dimensional holograms in Brazil with moderator, while maintaining full interaction with audiences at both venues. (B) Magnified image of Drs Coelho and Freeman showing immersive holographic experience being delivered without the need for headsets, showcasing advanced visualization technology across countries. The impact of this demonstration was substantial; the Brazilian audience included 675 in-person attendees and an additional 5000 online, all of whom experienced seamless engagement with the holographically transmitted speakers. This large-scale, delay-free implementation of holographic teaching revealed the transformative potential of the technology in medical education, allowing experts to engage with global audiences as if they were physically present. These 2 proof of concept experiences validate holographic transmission as a disruptive technology for telementoring, telesupervision, and teleteaching in health care, bridging continents and enabling unprecedented collaboration in both hands-on surgical training and global-scale medical education. Discussion Holographic transmission, encompassing advanced AR and extended reality systems, is poised to revolutionize medical and surgical patient care. Its current capabilities show remarkable real-time or near real-time visualization. This evolution promises profound benefits in intraoperative guidance, telementoring, teleteaching, and telesupervision, fundamentally enhancing surgical precision, reducing cognitive load for practitioners, and supporting remote clinical decision making. Beyond direct patient care, the implications for global education are transformative. Holographic telepresence allows experts to overcome geographic limitations, bringing world-class training directly into classrooms, operating theaters, and simulation centers worldwide. Through immersive projection and real-time interaction, learners in underserved regions can receive the same quality of mentorship and teaching as those in leading academic hubs. This democratization of knowledge creates a shared educational space where specialists can guide, supervise, and teach across continents, effectively dissolving the barriers imposed by distance, travel, or infrastructure constraints. When considering holographic transmission using fan-based (Light-Emitting Diode hologram fan) or lightweight projection systems, the cost barrier is substantially lower compared with volumetric or cabinet-based telepresence platforms. For the receiving site (low- and middle-income settings), holographic fan displays represent one of the most cost-accessible solutions currently available. Commercial devices are widely available for approximately US$100 to $500 per unit for entry-level holographic fan displays and US$200 to $1000 for higher-quality multiblade or synchronized fan systems. These systems can project floating 3D visuals without requiring headsets, making them particularly suitable for education and demonstration purposes in low-resource environments. The potential to create globally networked learning ecosystems positions holographic transmission as a cornerstone for equitable medical education. Such platforms can foster multidisciplinary collaboration, promote inclusivity by giving voice to educators and learners from diverse cultures, and ensure that the latest advances in surgical and medical practice are rapidly disseminated to all regions. This vision of education without borders elevates training standards and addresses critical workforce shortages by empowering practitioners in low- and middle-income countries with continuous access to expertise. However, realizing this transformative potential depends on overcoming an array of challenges. Technical limitations such as latency, restricted field of view, and tracking accuracy are hurdles that can paradoxically undermine the precision these systems aim to deliver. The high costs associated with development, acquisition, and maintenance pose considerable barriers, risking the exacerbation of existing health care inequities. Furthermore, the pervasive digital divide, characterized by inadequate infrastructure, is a major obstacle for deployment in the very regions that would benefit most. Ethical concerns regarding data privacy, ownership, patient-physician dynamics, and the potential for negative training or overreliance on technology also require careful consideration and proactive regulatory frameworks. Ensuring that holographic education and telemedicine platforms are accessible, culturally sensitive, and ethically governed is essential for maintaining their role in reshaping health care education and practice. Conclusion Holographic transmission offers unparalleled opportunities to enhance patient care and establish a borderless educational landscape, where knowledge flows freely, expertise is shared globally, and learners everywhere have access to high-quality mentorship. By eliminating geographic barriers, this technology enables widespread delivery of cutting-edge health care and dissemination of medical knowledge. Its dual role as a clinical tool for precision and an educational medium for equity positions holography as a transformative force in the future of global health. Realizing this potential will require continued innovation to overcome technical and ergonomic limitations, strategic investment to bridge the digital divide, and robust ethical and regulatory frameworks to safeguard equity, safety, and trust. If these challenges are addressed, holographic transmission could redefine both the practice of medicine and the training of future generations, truly achieving education and health care without borders. Potential Competing Interests Both authors report that this study was supported by Mayo Clinic, EDUCSIM, Massachusetts Institute of Technology, and G7 Summit Brazil. Declaration of Generative AI and AI-Assisted Technologies in the Writing Process During the preparation of this work, the authors used ChatGPT in order to support the writing process by providing English language corrections, grammar refinement, and stylistic improvements. After using this tool, the authors reviewed and edited the content as needed and takes full responsibility for the content of the publication. Acknowledgments We would like to express our sincere appreciation to G7 Summit Brazilian Team and to EDUCSIM (www.educsim.com.br), the MIT.nano Acceleration Program, and the Mayo Clinic Media Support Team in Jacksonville, FL, for their invaluable scientific support and collaborative contributions throughout the development of this project. The Scientific Publications staff at Mayo Clinic provided copyediting, proofreading, administrative, and clerical support. The authors confirm that no new data were generated or analyzed for this study. The work consists of a narrative review of the existing literature and descriptive accounts of previously performed demonstrations. Data sharing is therefore not applicable. Both authors contributed to all aspects of this work and approved the final manuscript. Footnotes Data Previously Presented: The technology was demonstrated at the G7 Summit in São Paulo, Brazil, showcasing the world’s first real-time 3D holographic transmission in medicine and highlighting collaboration between the G7 Summit and the Florida Healthcare Simulation Alliance. The demonstration integrated a physical stage with advanced telepresence for real-time medical interaction. References