No Fuss, Just Function - A Proposal for Non-Intrusive Full Body Tracking in XR for Meaningful Spatial Interactions Conference: April 26 - May 01, 2018; Yokohama, JPN; CCS: Human-centered computing Mixed / augmented reality CCS: Human-centered computing Virtual reality CCS: Human-centered computing U

Elisabeth Mayer, Thomas Odaker, Dieter Kranzlmüller · 2025

Read No Fuss, Just Function - A Proposal for Non-Intrusive Full Body Tracking in XR for Meaningful Spatial Interactions Conference: April 26 - May 01, 2018; Yokohama, JPN; CCS: Human-centered computing Mixed / augmented reality CCS: Human-centered computing Virtual reality CCS: Human-centered computing U by Elisabeth Mayer, Thomas Odaker, Dieter Kranzlmüller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11987.txt.

Introduction

Elisabeth Mayer, Thomas Odaker, and Dieter Kranzlmüller propose body tracking for virtual worlds without worn gear, in a 2025 paper. Full body tracking lets users move and act with their whole body inside a virtual space. Classic setups need markers or trackers strapped to the user. New pose-guessing methods that read plain camera images promise a cheaper, gear-free path.

The authors argue such tracking could open virtual worlds to far more people. Users who struggle with hand controllers could act in natural ways instead. The paper is a concept piece meant to spark debate in the field. It weighs gains in access and comfort against the limits of camera-based tracking, and it asks designers to build for all bodies from the start.

Catalog record

CREATORElisabeth Mayer, Thomas Odaker, Dieter Kranzlmüller
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE13 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11987

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

No Fuss, Just Function - A Proposal for Non-Intrusive Full Body Tracking in XR for Meaningful Spatial Interactions Conference: April 26 - May 01, 2018; Yokohama, JPN; CCS: Human-centered computing Mixed / augmented reality CCS: Human-centered computing Virtual reality CCS: Human-centered computing User interface design Elisabeth Mayer, Thomas Odaker, Dieter Kranzlmüller Abstract . Extended Reality (XR) is a rapidly growing field with a wide range of hardware from head mounted displays to installations. Users have the possibility to access the entire Mixed Reality (MR) continuum. Goal of the human-computer-interaction (HCI) community is to allow natural and intuitive interactions but in general interactions for XR often rely on handheld controllers. One natural interaction method is full body tracking (FBT), where a user can use their body to interact with the experience. Classically, FBT systems require markers or trackers on the users to capture motion. Recently, there have been approaches based on Human Pose Estimation (HPE), which highlight the potential of low-cost non-intrusive FBT for XR. Due to the lack of handheld devices, HPE may also improve accessibility with people struggling with traditional input methods. This paper proposes the concept of non-intrusive FBT for XR for all. The goal is to spark a discussion on advantages for users by using a non-intrusive FBT system for accessibility and user experience. Figure 1 . Intrusive Full Body Tracking vs Non-Intrusive Full Body Tracking for XR: One user wearing marker-based FBT (left) and one user with a temporary motor limitation using non-intrusive FBT (right). Intrusive Full Body Tracking vs Non-Intrusive Full Body Tracking for XR: One user wearing marker-based FBT (left) and one user with a temporary motor limitation using non-intrusive FBT (right). 1. Introduction Over the course of the last few years, Extended Reality (XR) has been a rapidly developing field ( Lopes et al. 2023 ; Martín-Gutiérrez et al. 2017 ) . A wide variety of devices ranging from head-mounted-displays (HMDs) ( Anthes et al. 2016 ) to large-scale installations like CAVE systems ( Cruz-Neira et al. 1992 ) can be used to access the Mixed Reality (MR) continuum ( Milgram et al. 1995 ) . Devices like the Meta Quest 3 1 1 1 Meta Quest 3 Website (accessed last 28.02.2025) or Apple Vision Pro 2 2 2 Apple Vision Pro Website (accessed last 28.02.2025) have started to blur the line between Augmented Reality (AR) and Virtual Reality (VR), providing new use-cases and easier accessibility to MR. One key aspect of MR has always been interaction and a primary goal of human-computer-interaction (HCI) is to allow for natural and intuitive interaction techniques so users can focus on the experience provided ( Nielsen et al. 2004 ) . Interaction in XR often relies on the use of input devices like handheld controllers. While this method is well established, it may not be intuitive for everyone and may exclude people with disabilities who struggle with the use or of such devices. Another way to provide natural interaction is full body tracking (FBT), providing data about a user’s full body. In the past, FBT often required the use of body-mounted devices like markers or trackers. Recent advances in human pose estimation (HPE), however, seem a promising development to enable FBT without body-mounted devices or complex camera setups. HPE could provide a way to create a low-cost, non-intrusive tracking system for FBT ( Capece et al. 2018 ) . Due to the lack of handheld devices, HPE may also improve inclusivity and provide universal access to MR for people struggling with traditional input methods for various reasons. In this paper, we want to propose a concept for a non-intrusive full body tracking system based on HPE for the use with MR environments. The goal is to spark a discussion about accessibility in MR and move towards designing tracking systems and interactions suitable for everybody. 2. Related Work This paper focuses on the spatial affordance ( Vieira et al. 2024 ) , specifically in terms of interactions and movements within a 3D space. For spatial interactions 3D User Interfaces (3UI) are involved. 3DUIs are inherently spatial with tasks ranging from selection to navigation that require users and their input devices to interact within a 3D space ( Bowman et al. 2001 ) . In general, XR can be experienced through HMDs, like the Meta Quest 3. Interactions for headsets usually can be activated through controllers ( Zhang et al. 2024 ; Angelov et al. 2020 ) . These controllers are typically handheld and interactions are triggered through button presses ( Anthes et al. 2016 ) . However, these controllers can be unfamiliar for novice users and are dependent on users grip posture and finger movements which can be a challenge for some users ( Dudley et al. 2023 ) . Some headsets now offer hand tracking or gesture control ( Papadopoulos et al. 2023 ) . One natural way for users to interact in XR is through FBT, which enables tracking the position and orientation of a user’s body for interactions ( Theodoropoulos et al. 2023 ) . Input with FBT allows users to directly interact with the XR experience with their own body or body movement ( Kulik 2009 ; Yang et al. 2022 ) . One advantage of FBT is that users do not have to learn a new form of input as it can map their natural movement to the experience ( Steed et al. 2021 ) . FBT can help users to feel more immersed in an experience as they can focus on the experience itself over the controllers and interactions that they are required to perform ( Caserman et al. 2020 ) . Inman et al. found that by using FBT for learning how to drive a wheel chair in VR users praticed more and learnt faster ( Inman et al. 2011 ) . One form of FBT tracking for XR, e.g. AR ( Jun et al. 2010 ) and VR, is marker-based systems ( Caserman et al. 2019 ) . While marker-based systems can be very accurate, they can be expensive and by requiring external trackers or markers, users might feel uncomfortable and require a prolonged setup time ( Caserman et al. 2020 ) . In terms of accessibility in XR, any additional hardware can provide a challenge for people who need to wear hardware over eyeglasses or hearing aids ( Mott et al. 2019 ) . Markerless FBT systems do not require the users to wear any external devices ( Caserman et al. 2019 ; Comport et al. 2003 ) . Markerless systems are generally affordable and only require a simple setup ( Caserman et al. 2020 ) . Previously a term commonly used when describing eye-tracking ( Kim et al. 2004 ) , non-intrusive tracking describes a technology where users are not required to wear any devices, which marker-less systems offer. Non-intrusive tracking for FBT was identified as vital for HCI. Colombo et al. expand the term non-intrusive to encompass low-cost as an advantage of non-intrusive tracking ( Colombo et al. 2001 ) . Gabel et al. also iterate the importance of non-intrusive low-cost for movement analysis ( Gabel et al. 2012 ) . One form of low cost

Read the complete text