Quest2ROS2: A ROS 2 Framework for Bi-manual VR Teleoperation DOI: 10.1145/3757279.3788806 ISBN: 979-8-4007-2128-1/2026/03 Conference: Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction; March 16–19, 2026; Edinburgh, Scotland, UK Proceedings of the 21st ACM/IEEE Inte
Jialong Li, Zhenguo Wang, Tianci Wang, Maj Stenmark, Volker Krueger · 2026
Read Quest2ROS2: A ROS 2 Framework for Bi-manual VR Teleoperation DOI: 10.1145/3757279.3788806 ISBN: 979-8-4007-2128-1/2026/03 Conference: Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction; March 16–19, 2026; Edinburgh, Scotland, UK Proceedings of the 21st ACM/IEEE Inte by Jialong Li, Zhenguo Wang, Tianci Wang, Maj Stenmark, Volker Krueger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18289.txt.
Introduction
Jialong Li and co-authors present Quest2ROS2, an open-source frame for two-handed robot teleoperation in virtual reality. Their 2026 preprint builds on the earlier Quest2ROS. Robot data collection needs to scale, and human-guided robots are a main source of training data. The old frame's workspace limits held that back. Quest2ROS2 uses relative motion control: the robot's move is computed from changes in the VR controller's pose. That makes control intuitive and free of the user's exact stance.
Pose-independent control lets operators work from any position. Two hands at once suit tasks from assembly to care. An open frame lets labs share the same data tools. The work feeds the data engine behind robot learning.
Catalog record
| CREATOR | Jialong Li, Zhenguo Wang, Tianci Wang, Maj Stenmark, Volker Krueger |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18289
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Quest2ROS2: A ROS 2 Framework for Bi-manual VR Teleoperation DOI: 10.1145/3757279.3788806 ISBN: 979-8-4007-2128-1/2026/03 Conference: Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction; March 16–19, 2026; Edinburgh, Scotland, UK Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction (HRI ’26), March 16–19, 2026, Edinburgh, Scotland, UK CCS: Computer systems organization External interfaces for robotics CCS: Human-centered computing Haptic devices Jialong Li, Zhenguo Wang, Tianci Wang, Maj Stenmark, Volker Krueger Abstract . Quest2ROS2 is an open-source ROS2 framework for bi-manual teleoperation designed to scale robot data collection. Extending Quest2ROS, it overcomes workspace limitations via relative motion-based control, calculating robot movement from VR controller pose changes to enable intuitive, pose-independent operation. The framework integrates essential usability and safety features, including real-time RViz visualization, streamlined gripper control, and a pause-and-reset function for smooth transitions. We detail a modular architecture that supports "Side-by-Side" and "Mirror" control modes to optimize operator experience across diverse platforms. Code is available at: https://github.com/Taokt/Quest2ROS2 . † † cc-license: by 1. Introduction Figure 1. Example implementation of Quest2ROS2 framework on a bi-manual Kuka iiwa7 system. Top Left : Potential pose of the operator while teleoperating, the controllers can be grasped in any arbitrary pose. Top Right : Visualization of the commands being streamed from the controllers to the robot. Bottom : The block-stacking task being performed via teleoperation by the operator using the system. This is figure 1 Robot teleoperation technology has wide-ranging applications in many areas of robotics research, for examples, medical robotics ( 4 ) and manipulation in hazardous environments ( 11 ) . With the rise of robot learning methods, represented by vision-language-action models ( 1 ; 14 ; 7 ) , the robotics community has increasingly focused on the collection and quality of robot data ( 15 ; 8 ) , similar to the trends in natural language processing and computer vision. Intuitive methods such as kinesthetic teaching where the human moves the robot arm cannot be used for VLA as data generated in this way will have human in the image. Consequently, robot teleoperation methods specifically for robotic manipulation are receiving increasing attention, with advanced data augmentation techniques like Diffusion models being explored. However their effectiveness remains fundamentally limited by the quality and scale of the initial, reliable teleoperation data ( 18 ) . The ongoing effort in this field aims to explore simpler and more user-friendly robot teleoperation methods for data collection. A subset of these efforts focuses on establishing intuitive leader-follower systems like ALOHA ( 19 ) , attempting to make robot teleoperation straightforward and easy to operate. However, these systems require a custom setup of corresponding robotic hardware and are difficult to generalize to robots with complex configurations. Another set of works is dedicated to using teach pendants or joy-sticks for this task ( 13 ; 17 ) , but due to the difference between the robot’s degrees of freedom and configuration and those of a human, these control methods often lack intuitive alignment with the user’s expectations. Furthermore, some works adopt a 3D mouse to directly control the movement of the robot’s end-effector in Cartesian space ( 3 ; 9 ) . While this method is quite intuitive and cost-effective for operating a single arm, extending it to dual-arm manipulation places certain demands on the operator’s coordination skills. We attempt to establish a teleoperation system that is potentially usable for dual-arm robots. Based on this goal, we consider VR equipment to be a natural choice for this task due to its ease of operation and low cost. Previous work has explored the feasibility of VR in various robotic teleoperation tasks ( 10 ; 2 ; 16 ) . Among these, Quest2ROS ( 16 ) provides software that enables communication between Meta Quest 2/3 VR devices 1 1 1 https://en.wikipedia.org/wiki/Meta_Quest_3 and Robot Operating System(ROS). Its feature of transmitting VR controller data allows it to be applied to the control of robot end-effectors. However, although their work includes basic ROS-side code support, the functionality provided by the original code framework is quite limited and is confined to ROS 1, meaning that users still require considerable upfront development before undertaking a specific task. Recently, frameworks like OPENTEACH ( 5 ) and BEAVR ( 12 ) have utilized Quest-based hand tracking to enable low-cost teleoperation without the bulky leader-follower hardware required by ALOHA ( 19 ) . While similar in goal, our work prioritizes controller-based tracking to ensure superior stability and flexibility. Unlike hand-tracking systems that struggle with pose recognition at certain angles, native controllers offer robust tracking and "relaxed" usage conditions, allowing operators to work without wearing the HMD continuously. Furthermore, we maintain a modular software design by decoupling teleoperation logic from robot-specific IK solvers or remapping layers. By leveraging standard community controller modules instead of integrated solvers, our framework simplifies migration across diverse robotic platforms, offering a more adaptable solution for varied research environments. 2. Quest2ROS2 Building upon the Quest2ROS application, this work aims to provide a more functionally complete, easily extensible, and user-friendly open-source code framework on ROS 2 for dual-arm robots, which we name Quest2ROS2. Specifically, the original Quest2ROS architecture primarily consists of software running on the VR device and a middleware layer on the ROS side that processes the controller information fed back by the software to facilitate downstream tasks. Our work primarily focuses on providing a more functionally comprehensive and development-accelerating ROS 2 middleware framework, which now is currently developed based on controlling the end-effector movement in Cartesian space. While retaining the native Quest2ROS functionality, we primarily introduce the following additional key features: control based on the relative motion of the VR controller, end-effector command visualization, and minor functionalities such as gripper state toggle and pose stream state toggle. An example implementation of Quest2ROS2 can be seen at Figure 1 . 2.1. Relative-motion-based End-Effector control Figure 2. Conceptual demonstration of relative motion based control. Under this control logic, Movement 1 and Movement 2 produce equivalent effects on the End-Effector (EE), causing the EE to translate the same distance in the same direction, and Movement 3 will push the EE to move twice the distance in the same direction. Since robot configurations differ from those of humans, real-time, direct control of robot joint movements is often overly challenging for human teleoperation. To circumvent this issue, similar to Quest2ROS, we opt for direct control of the robot’s end-effector position with the assistance of other underlying robot controllers in community such as Cartesian impedance controller 2 2 2 https://github.com/idra-lab/kuka_lbr_control . Specifically, the basic control method provided in the Quest2ROS requires aligning the controller’s coordinate frame with the robot’s base frame before control begins, and subsequently makes the robot’s end-effector directly replicate the controller’s pose. While this operation logic is intuitive, we found that in practical applications, it is not sufficient for more flexible robot control and convenient human operation, and it suffers from the following drawbacks: Limited Workspace : Under the basic Quest2ROS control logic, the robotic arm attempts to replicate the controller’s actions, and thus the robot’s workspace is inherently constrained by the operator’s physical reach. For large-scale, high-reach manipulators such as the Kuka iiwa7, this significantly hinders the robot’s ability to complete complex manipulation tasks. Limited Action Feasibility