Linearity, Time Invariance, and Passivity of a Novice Person in Human Teleoperation

David Black, Septimiu Salcudean · 2025

Read Linearity, Time Invariance, and Passivity of a Novice Person in Human Teleoperation by David Black, Septimiu Salcudean (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11653.txt.

Introduction

David Black and Septimiu Salcudean present a 2025 study of the human half of a guidance system where an expert steers a novice's hands through a mixed-reality display. Cheap teleguidance could bring skilled care to far towns. Past work showed the novice tracks the display about as well as a robot arm. The open half was the person's own dynamics, which any two-way controller must respect.

Through models and live tests, the follower proved near enough to linear and steady over time. Cross-axis bleed was small, and the follower's slack, its passivity, ran large at working speeds. A random-noise model of the follower caps the pass. Controller builders can now treat the person as a tame plant, with proof in hand.

Catalog record

CREATORDavid Black, Septimiu Salcudean
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11653

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Linearity, Time Invariance, and Passivity of a Novice Person in Human Teleoperation David Black, Septimiu Salcudean Abstract Low-cost teleguidance of medical procedures is becoming essential to provide healthcare to remote and underserved communities. Human teleoperation is a promising new method for guiding a novice person with relatively high precision and efficiency through a mixed reality (MR) interface. Prior work has shown that the novice, or “follower”, can reliably track the MR input with performance not unlike a telerobotic system. As a consequence, it is of interest to understand and control the follower’s dynamics to optimize the system performance and permit stable and transparent bilateral teleoperation. To this end, linearity, time-invariance, inter-axis coupling, and passivity are important in teleoperation and controller design. This paper therefore explores these effects with regard to the follower person in human teleoperation. It is demonstrated through modeling and experiments that the follower can indeed be treated as approximately linear and time invariant, with little coupling and a large excess of passivity at practical frequencies. Furthermore, a stochastic model of the follower dynamics is derived. These results will permit controller design and analysis to improve the performance of human teleoperation. I Introduction Human teleoperation enables remote control of medical procedures such as ultrasound exams in isolated or under-resourced communities [ 1 ] , as well as remote maintenance, hand-over-hand teaching, and many other applications. Compared to existing video teleguidance systems, for example as used in tele-ultrasound, it offers significantly improved efficiency and precision [ 2 ] , while it is more practical and accessible than robotic teleoperation due to lower cost, size, and complexity, and increased flexibility [ 3 ] . In human teleoperation, shown in Fig. 1 , a novice follower person aligns their tool with a 3D virtual one displayed to them through a mixed reality (MR) headset. The motion of the virtual tool is controlled in real time by a remote expert, who manipulates a 6 degree of freedom (DOF) haptic device and views a live stream of the ultrasound image [ 4 ] . Prior work has shown through tracking tests as well as step and frequency response measurements that the dynamics of the follower person in attempting to align their real tool with the virtual one resemble a second-order linear system and the performance can be compared to telerobotic systems [ 5 , 6 ] . By tracking the follower’s position and orientation (pose) [ 7 ] and force [ 8 ] , it is possible to develop a bilateral teleoperation system to shape the follower’s behavior and provide haptic feedback to the expert [ 9 ] . To choose and design appropriate controllers, it is important to understand whether the follower’s dynamics in response to an MR input can be treated as a linear, time invariant (LTI) system. As linear control theory is easier and more developed than nonlinear control [ 10 , 11 ] , having an accurate linear model would greatly simplify the design and analysis of the controller. Moreover, most common methods assume a time invariant plant whereas time-varying systems require more careful and complex methods such as gain scheduling or adaptive control [ 12 , 13 ] . On first inspection, the human arm is a highly nonlinear system [ 14 ] . It forms a complex kinematic chain akin to a serial robotic manipulator, and has elastic actuation. Moreover, unlike mechanical systems, people are susceptible to distraction, fatigue, and random variance in their performance. Thus, a nonlinear, time-varying model is perhaps most appropriate. However, robotic manipulators can be controlled through feedback linearization using computed torque [ 15 ] or resolved-acceleration [ 16 ] methods. By feeding forward the dynamic model of the robot plus the desired trajectory wrapped in a PD controller, the robot’s nonlinear dynamics are effectively canceled out. Assuming a perfect model, this leaves linear, uncoupled error dynamics for which the PD gains can be tuned [ 17 ] . No robotic manipulator exists that can move with the same combination of speed, flexibility, and compliance of a human arm, so it may be that our own internal controllers also lead to LTI, uncoupled dynamics. Indeed some papers have modeled the human arm dynamics as a second order linear system given a desired position commanded by the central nervous system [ 18 ] . However, the question of whether the human dynamics in response to MR pose inputs are LTI and/or coupled remains unanswered. Importantly, the teleoperation system must also be made robust to time delays since there are communication lags and latency associated with the follower’s response time [ 6 ] . The problem of stable and transparent bilateral teleoperation in the presence of time delays has been very heavily studied [ 19 , 20 , 21 , 22 , 23 ] . Several of the most common methods for delay-robust bilateral teleoperation rely on the concept of passivity to guarantee stability. These include wave variables [ 24 , 25 ] and passivation of the communication channel [ 26 ] , the time domain passivity approach (TDPA) [ 27 , 28 ] , and many variations [ 29 , 30 , 31 ] . Fig. 1: Overview diagram and corresponding two-port network representing the human teleoperation system, showing the follower block in blue. (A) the haptic device, (B) MR headset, (C) follower’s instrumented tool and the virtual tool. The red arrow shows how the follower will move next to align the real tool to the virtual one. In this example, the system is used for teleultrasound. Passivity can be understood in analogy to electrical circuits, where passive elements such as resistors, inductors, and capacitors may store or dissipate energy but not create it. Indeed, a teleoperation system, like a circuit, can be represented as a network of one and two port elements [ 26 ] . An element that outputs no more energy than it receives as input is called passive. An element that dissipates energy is strictly passive, or dissipative. More generally, in controls, passivity is a characteristic of the input-output relationship and need not pertain to physical units of energy [ 32 ] . Consider a system with input \boldsymbol{u} and output \boldsymbol{y} such that \boldsymbol{y}=T\boldsymbol{u} . The generalized instantaneous power, or energy flow into and out of the system is p(t)=\boldsymbol{y}(t)^{\top}\boldsymbol{u}(t) . The usual convention treats energy flow into the system as positive, while out is negative. The system is passive if and only if E(0)+\int_{0}^{t}\boldsymbol{y}(\tau)^{\top}\boldsymbol{u}(\tau)d\tau\geq 0 (1) That is, the total energy including the initial state is non-negative at all times. A strict inequality here would lead to strict passivity. Note, there is no requirement for \boldsymbol{y}^{\top}\boldsymbol{u} to have physical units of power. In teleoperation, the operator’s hand and the robot’s environment are 1-port terminations to the 2-port network and are commonly considered to be passive [ 33 ] . Such a system is stable for any passive environment and operator blocks if and only if the structured singular value of the scattering operator, S , satisfies \sup_{\omega}\mu_{\Delta}(j\omega)\leq 1 and is BIBO stable [ 34 ] . It is straightforward to design passive controllers for the leader and follower robots. Thus, together, these factors make it relatively simple to

Read the complete text