Practice Makes Perfect: A Study of Digital Twin Technology for Assembly and Problem-solving using Lunar Surface Telerobotics Journal: Advances in Space Research

Xavier O’Keefe, Katy McCutchan, Alexis Muniz, Jack Burns, Daniel Szafir · 2025

Read Practice Makes Perfect: A Study of Digital Twin Technology for Assembly and Problem-solving using Lunar Surface Telerobotics Journal: Advances in Space Research by Xavier O’Keefe, Katy McCutchan, Alexis Muniz, Jack Burns, Daniel Szafir (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13722.txt.

Introduction

Xavier O'Keefe and co-authors test virtual training for moon rover drivers in 2025. Rovers with arms will build and tend gear on the Moon, but full autonomy is not ready. Human drivers must train for the task and recover from snags live.

Their virtual twin mirrors a real rover in a mock lunar task: planting radio antennas. Twenty-four operators took part, some training first in the twin. Twin-trained drivers cut a key error measure by about twenty-eight percent, the truncated report shows. The authors pitch the twin as a cheaper stand-in for scarce physical test yards.

Catalog record

CREATORXavier O’Keefe, Katy McCutchan, Alexis Muniz, Jack Burns, Daniel Szafir
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13722

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Practice Makes Perfect: A Study of Digital Twin Technology for Assembly and Problem-solving using Lunar Surface Telerobotics Journal: Advances in Space Research Xavier O’Keefe, Katy McCutchan, Alexis Muniz, Jack Burns, Daniel Szafir Abstract Robotic systems that can traverse planetary or lunar surfaces to collect environmental data and perform physical manipulation tasks, such as assembling equipment or conducting mining operations, are envisioned to form the backbone of future human activities in space. However, the environmental conditions in which these robots, or “rovers,” operate present challenges towards achieving fully autonomous solutions, meaning that rover missions will require some degree of human teleoperation or supervision for the foreseeable future. As a result, human operators require training to successfully direct rovers and avoid costly errors or mission failures, as well as the ability to recover from any issues that arise on-the-fly during mission activities. While analog environments, such as JPL’s Mars Yard, can help with such training by simulating surface environments in the real world, access to such resources may be rare and expensive. As an alternative or supplement to such physical analogs, we explore the design and evaluation of a virtual reality digital twin system to train human teleoperation of robotic rovers with mechanical arms for space mission activities. We conducted an experiment with 24 human operators to investigate how our digital twin system can support human teleoperation of rovers in both pre-mission training and in real-time problem solving in a mock lunar mission in which users directed a physical rover in the context of deploying dipole radio antennas. We found that operators who first trained with the digital twin showed a 28% decrease in mission completion time, an 85% decrease in unrecoverable errors, as well as improved mental markers, including decreased cognitive load and increased situation awareness. 1 Introduction Space missions are increasingly dependent on robotic systems to achieve critical mission goals. Mobile manipulation robots in particular can offer a wide-range of mission support. For example, rovers like Curiosity and Perseverance have already demonstrated the value of sample data collection and analysis for scientific goals, with future systems envisioned to aid in tasks such as assembly (e.g., constructing habitats in advance of human missions or science facilities), infrastructure repair, equipment deployment, and mining. Such future rovers will play a critical role as the global space community has shifted its focus back to the Moon, with recent missions such as the United States’ NASA Commercial Lunar Payload Services (CLPS) Intuitive Machine’s Odysseus ( Burns et al. 2021 ) , India’s Chandrayaan 3 ( Rajasekhar et al. 2024 ) and China’s Chang’e 6 ( Zeng et al. 2023 ) . Moon missions are expensive and challenging, and even small errors can have major consequences. For example, the Odysseus lander cost $118 million and landed on its side due to stale telemetry, rendering some payloads unusable. Due to the challenging nature of the lunar environment, future rover missions are not currently envisioned as fully autonomous, but will instead rely on some degree of human oversight and intervention. To achieve a seamless integration of human-robot systems and to mitigate the risks of high consequence errors for these operations, human operators will need to train comprehensively and have the ability to adapt to unforeseen issues and solve problems in real-time. How to best effect such training remains an open question as the operational environments of the Moon and Mars are not easily simulated physically on Earth. JPL’s Mars Yard (see Fig. 1 ), a state-of-the-art facility for large-scale physical simulations of other planetary environments, presents a compelling approach ( Robotics n.d. ) . However, certain aspects, such as differences in gravity, cannot be easily simulated in the Mars Yard and access to its facilities is limited and costly. Moreover, in order to conduct testing and operator training in this facility, rovers must be transported to the Mars Yard, which can put hardware at risk, introducing unneeded cost. We are interested in exploring how to develop easier, cheaper, and more generalizable solutions for troubleshooting rovers and training operators to support upcoming space missions and keep pace with the growth of the commercial space economy, which may exceed the capacity of the Mars yard and other facilities like it. Fig. 1 : A mobility test of a rover in the NASA Mars Yard. The Mars Yard was created to physically simulate terrain on Mars and the Moon. Our approach is to develop a high-fidelity virtual environment and digital twin model that mimics an extraterrestrial setting, allowing for and more repeatable simulation of mission scenarios. Digital twin simulations also enable system operators to train on a less expensive yet accurate digital re-creation of the physical system and its environment, allowing operators to gain more applicable experience solving problems when compared to Earth-based physical simulations. In this research, we develop a physical rover and its digital twin to experimentally evaluate whether training and troubleshooting in a virtual environment enhances operator performance when controlling the physical rover during a simulated lunar mission. 2 Background and Related Work Robotics has become a key enabling tool for both autonomous and crewed space missions, where robots have served pivotal roles in missions across low Earth orbit (LEO), the Moon, and Mars ( Gao & Chien 2017 ) . In this work, we focus on planetary rovers, robots that can operate on a planetary or lunar surface to collect environmental data, assemble equipment and infrastructure, and perform other physical manipulation tasks (e.g., mining). While substantial advancements in robotics technologies are continuing to push the envelope of autonomous robot capabilities, rovers and other systems still require substantial human oversight and intervention due to the complex and often uncertain nature of space mission environments and tasks ( Nesnas et al. 2021 ) . Thus, it is essential that human team members are able to rapidly diagnose, respond to, and recover from any challenges that may arise during robot operations. While this process is not yet fully understood, the Robot Failure Human Information Processing (RF-HIP) model has been proposed as a way to describe the complex interplay of human cognitive, emotional, and behavioral responses to robot failures ( Honig & Oron-Gilad 2018 ) . This model emphasizes three major aspects: how robots and associated systems may communicate failures, how humans perceive and comprehend failures, and how human-robot teams may solve failures. For example, research has explored how robots might leverage non-verbal cues, such as gaze behaviors, to communicate failures ( Shiomi et al. 2013 ) and how emotional responses, such as frustration in response to failures, can influence the effectiveness of human-robot collaborations ( Weidemann & Rußwinkel 2021 ) . Likewise, failures are closely linked to human trust in robots ( Law & Scheutz 2021 ) , motivating recent research on robot proficiency self-assessment ( Conlon et al. 2022 ; Conlon et al. 2024 ) . Building on this body of research, we explore the development and evaluation of an interface for rover troubleshooting that leverages a digital twin , a virtual representation of the robot and its environment. Digital twins, which add to the success of modern virtual reality technologies, have become transformative tools across a variety of disciplines by creating precise virtual representations of physical objects, processes,

Read the complete text