Deformation of the panoramic sphere into an ellipsoid to induce self-motion in telepresence users
Eetu Laukka, Evan G. Center, Timo Ojala, Steven M. LaValle, Matti Pouke · 2025
Read Deformation of the panoramic sphere into an ellipsoid to induce self-motion in telepresence users by Eetu Laukka, Evan G. Center, Timo Ojala, Steven M. LaValle, Matti Pouke (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12925.txt.
Introduction
Eetu Laukka and co-authors test a visual trick meant to help people steer a remote robot, in a 2025 study. The robot carries a full-circle camera, which gives a wide view but adds delay over the internet. During that delay, the user has sent a move command but cannot yet see its effect, so control feels blind.
Their method warps the round view into an oval shape that creates a false sense of self-motion during the wait. Users then steered the robot under a half-second delay, with and without the trick. Task time and crashes did not improve with the trick. Some signs pointed to more sickness in the virtual view. The authors conclude that the method needs much more tuning before it can help in real telepresence work.
Catalog record
| CREATOR | Eetu Laukka, Evan G. Center, Timo Ojala, Steven M. LaValle, Matti Pouke |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-12925
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deformation of the panoramic sphere into an ellipsoid to induce self-motion in telepresence users Eetu Laukka, Evan G. Center, Timo Ojala, Steven M. LaValle, Matti Pouke Abstract Mobile telepresence robots allow users to feel present and explore remote environments using technology. Traditionally, these systems are implemented using a camera onboard a mobile robot that can be controlled. Although high-immersion technologies, such as 360-degree cameras, can increase situational awareness and presence, they also introduce significant challenges. Additional processing and bandwidth requirements often result in latencies of up to seconds. The current delay with a 360-degree camera streaming over the internet makes real-time control of these systems difficult. Working with high-latency systems requires some form of assistance to the users. This study presents a novel way to utilize optical flow to create an illusion of self-motion to the user during the latency period between user sending motion commands to the robot and seeing the actual motion through the 360-camera stream. We find no significant benefit of using the self-motion illusion to performance or accuracy of controlling a telepresence robot with a latency of 500 ms, as measured by the task completion time and collisions into objects. Some evidence is shown that the method might increase virtual reality (VR) sickness, as measured by the simulator sickness questionnaire (SSQ). We conclude that further adjustments are necessary in order to render the method viable. ©2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, including reprinting/republishing this material for advertising or promotional purposes, collecting new collected works for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. This work has been accepted for presentation at the 2025 IEEE Conference on Telepresence, to be held in Leiden, Netherlands. I INTRODUCTION Humans can feel present in an environment other than their current physical environment by leveraging immersive technologies. This concept is known as telepresence [ 1 ] . Telepresence often requires a camera that captures the remote location and streams the camera feed to the end-user. Furthermore, if the camera is attached to a mobile platform that the user can control by sending motion commands, the concept expands to robotics and can be called mobile robotic telepresence (MRP) [ 2 ] . There are different levels of technological immersion in mobile robotic telepresence. Traditionally, we can think of a tablet on wheels when talking about the common social telepresence robot [ 2 , 3 ] . With this type of robot, the user usually uses a computer screen to watch the camera stream, while controlling the robot with either a joystick, keyboard, or pointing toward the goal locations through an interface. However, a more immersive option is using a head-mounted-display (HMD) to render the camera stream from the remote location. The user tends to feel more present in the remote location when the immersion is higher [ 4 ] . Higher immersion can be achieved by using modern technology, such as panoramic or 360-degree cameras, to feel present in another environment than their current physical environment [ 5 ] . The 360-degree video is projected onto a spherical surface, and the user’s viewpoint is located at the center of that sphere. This enables the user to freely look around the 360-content rendered by the HMD. Fig. 1: Depiction of how the starting projection sphere is deformed into an ellipsoid with minor axis aligned with the direction of motion. Optical flow is arguably one of the most important sensory inputs that provides the perception of self-motion [ 6 ] . This flow comes from the moving features that the brain recognizes in the field of view (FOV) of vision [ 7 ] . This can also cause an illusory sense of self-motion called vection, which is a widely studied phenomenon [ 8 ] . While the general perception of self-motion relies on the integration of multiple sensory modalities, vection is predominantly driven by visual input. There are multiple types of vection that define the direction and type of movement. It is easiest to display them as a 2D rectangular vector field, as in Figure 2 , which is then projected onto a spherical surface, corresponding to the surface of the photoreceptors on the retina [ 8 ] . As interactive movement in a 360-degree photo or pre-recorded video is not possible, vection could be leveraged in telepresence systems that utilize 180 ∘ or 360 ∘ cameras together with an HMD to view and experience real remote environments. In addition, immersive telepresence systems, where the user can control the position of a remote robot, often suffer from significant latency, making it challenging to effectively control MRP systems [ 9 ] . Therefore, it is crucial to explore methods to mitigate the negative effects of latency. Fig. 2: Two-dimensional representation of forward vection prior to its projection onto the retinal photoreceptors. The arrows indicate the motion of visual features. In this paper, we introduce a novel approach in MRP that deforms the rendered panoramic video projection sphere to induce an illusory sense of self-motion. The goal is to give the user immediate feedback on the motions of the robot during the end-to-end latency of the telepresence camera. By gradually transforming the spherical projection into an ellipsoid, we can simulate the optical flow vector field based on the forward motion of the robot before the user sees the actual forward motion of the robot. Figure 1 illustrates this panoramic sphere projection deformation. The left sphere represents the standard projection, where a 360-degree equirectangular image is mapped to the user’s viewpoint at the sphere’s center. As the sphere gradually deforms into an ellipsoid, surface pixels stretch to fill the entire field of view of the HMD. This stretching creates a zoom-like effect, making visual features appear to move closer, thereby simulating the optical flow that occurs when moving forward. The zoom-like effect is shown in Figure 3 . The left image shows the view from the left eye before any movement occurs. The middle image represents the latency phase, during which the panoramic sphere is temporarily deformed into an ellipsoid to simulate the effect of viewpoint translation. The right image shows the final rendering from the left eye’s perspective after the movement has occurred and the panoramic sphere is no longer deformed. By comparing the middle and right images, one can notice that the method is not without limitations. In fact, objects close to the camera seem to not move close enough compared to the real case, and objects far away from the camera seem to move too close or stretch too much. Similarly to the technique proposed by Shimada et al. [ 10 ] , we aim to test the deformation of a panoramic sphere to create an illusion of self-motion in a general immersive MRP. We create a plausible scenario of a user piloting an immersive telepresence robot with a 500 ms latency, tasked to move around a cluttered office to complete simple navigation and