Navigating the Last Mile: Evaluating Head- and Cane-Mounted Cameras for Egocentric Spatial Awareness

Apurv Varshney University of California, Santa Barbara, Lucas Nadolskis University of California, Santa Barbara, Tobias Höllerer University of California, Santa Barbara, Michael Beyeler University of California, Santa Barbara · 2025

Read Navigating the Last Mile: Evaluating Head- and Cane-Mounted Cameras for Egocentric Spatial Awareness by Apurv Varshney University of California, Santa Barbara, Lucas Nadolskis University of California, Santa Barbara, Tobias Höllerer University of California, Santa Barbara, Michael Beyeler University of California, Santa Barbara (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19345.txt.

Introduction

Apurv Varshney and co-authors ask where a guide camera should sit to help blind walkers on the last stretch, in a study from 2025. Door hunts and cluttered halls beat cane and ear. Head gear and smart canes both now bear eyes; which perch serves best was untested.

Ten blind cane users told their ways and wants. Then a blind co-author walked five true sites with both mounts in sync, head and cane. Map and glow builds read the haul as probes. The trade is not head or cane: head views hold place best, cane views catch the near ground, and the pair tops each lone. Perch pairs, the team reads, are the build to back.

Catalog record

CREATORApurv Varshney University of California, Santa Barbara, Lucas Nadolskis University of California, Santa Barbara, Tobias Höllerer University of California, Santa Barbara, Michael Beyeler University of California, Santa Barbara
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-19345

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Navigating the Last Mile: Evaluating Head- and Cane-Mounted Cameras for Egocentric Spatial Awareness Apurv Varshney University of California, Santa Barbara, Lucas Nadolskis University of California, Santa Barbara, Tobias Höllerer University of California, Santa Barbara, Michael Beyeler University of California, Santa Barbara Abstract Robust navigational guidance is an important XR application for both sighted and non-sighted populations. In this paper, we mainly focus on blind pedestrians, who continue to face “last-mile” challenges such as locating entrances and navigating cluttered spaces. While smartglasses and wearables are maturing, a foundational design question remains underexplored: where on the body should cameras be placed to best support navigation? We present a mixed-methods investigation that focuses on the question of camera placement for generating spatial data supporting ego-centric navigation. A survey of 10 blind cane users surfaced practices for last-mile navigation and perceptions of body-mounted XR devices. A controlled case study with a blind co-author compared head- and cane-mounted cameras using synchronized Project Aria glasses while traversing five real-world environments. Using Simultaneous Localization and Mapping (SLAM) and Neural Radiance Fields (NeRFs) as diagnostic probes, we find the central trade-off appears to be not simply head versus cane but localization stability versus near-ground coverage, with the combined head+cane view providing complementary information for scene reconstruction. We translate these findings into architectural considerations for hybrid XR systems that extend the cane without interfering with tactile and auditory cues. \onlineid 0 \vgtccategory Research \vgtcinsertpkg \teaser Evaluating head- vs. cane-mounted camera placements for assistive XR navigation in a complex “last-mile” indoor environment. A) Simultaneous Localization and Mapping (SLAM) point cloud reconstructions demonstrate how head-mounted (blue) and cane-mounted (pink) camera vantages capture complementary spatial geometry (gray points denote unmapped regions). B) Head-mounted view: forward-facing and gaze-aligned, providing the visual stability necessary for robust localization. C) Cane-mounted view: dynamic, ground-level perspective that captures critical low-lying geometry beyond the cane’s tactile reach. D) Hybrid (head+cane) multi-view reconstruction via Neural Radiance Fields (NeRF) : integrating both vantages synthesizes a high-fidelity 3D scene representation, combining tracking stability with dense geometric coverage to support downstream spatial reasoning. Introduction keywords Accessibility, Assistive Technologies, Wearables, Orientation and Mobility Independent travel often breaks down for travelers at the “last mile”: the final few meters of a journey, such as locating a doorway in a plaza or identifying the right bus at a stop (also known as the “last 10-meters/yards” problem [ 52 , 15 , 40 ] ). These moments demand precise spatial awareness and robust environment tracking beyond the physical reach of the long cane or guide dog, remaining among the most challenging operational environments for assistive Extended Reality (XR) systems [ 44 , 21 , 11 , 19 , 23 ] . Recent advances in wearable sensing have brought camera-equipped smartglasses and compact body-worn devices into everyday use [ 13 , 12 ] . As this hardware matures, a foundational system design question remains underexplored: where on the body should cameras be placed to best support navigation for blind cane users? Prior work has explored head-, chest-, and cane-mounted configurations with distinct trade-offs: head-mounted cameras align with gaze and support landmarking [ 2 , 34 ] but can miss low-lying hazards; chest or belt placements offer stability and discretion [ 42 ] yet often duplicate head-level coverage; and cane-mounted sensors couple to tactile exploration [ 46 ] but their sweeping motion can blur images and disrupt pose estimation [ 4 ] . Despite decades of assistive system proposals, camera placement itself has rarely been isolated as an independent design variable evaluated under controlled spatial computing conditions. This paper treats camera placement as a first-class variable and examines its technical and experiential consequences for assistive XR navigation pipelines. We adopt a convergent mixed-methods design [ 10 ] , collecting qualitative (formative survey) and quantitative (controlled vantage study) data in parallel and integrating results at the interpretation stage. We establish system requirements through an initial formative survey ( n=10 ) probing blind cane users’ last-mile operational strategies, spatial information needs, and form-factor constraints for emerging wearables [ 50 , 28 , 14 , 20 ] . We then conduct a controlled vantage study with an experienced blind co-author, directly comparing synchronized head- and cane-mounted Project Aria devices [ 12 ] across five complex indoor and outdoor locations. Both studies were shaped through an iterative co-design process with the blind co-author [ 5 , 41 , 8 , 36 ] , an experienced independent cane user and long-time tester of assistive technologies. The co-design partner collaborated on survey question design, helped interpret and thematically code open-ended responses, and co-selected sites and landmarks for the vantage study to reflect authentic orientation and mobility (O&M) challenges. They were the sole participant in the data collection for the controlled Camera Vantage Study presented in Section 3 , but had only limited involvement in the analysis of the collected data (helping with outcome-independent questions regarding the interpretation). This co-design approach ensured that our technical evaluations foregrounded authentic user priorities and practical form-factor limitations, rather than relying solely on isolated bench-testing, while also shielding against preferential bias. We operationalize the effects of vantage using two core spatial computing pipelines widely used in XR navigation: Simultaneous Localization and Mapping (SLAM) as a proxy for maintaining a stable pose estimate and sparse geometric map, and Neural Radiance Fields (NeRF) as a proxy for generating high-fidelity, view-consistent 3D scene reconstructions suitable for downstream semantic reasoning. While coarse positioning (e.g., GPS) suffices for block-level guidance, last-mile decisions demand doorway-scale precision and robust indoor tracking [ 59 , 23 ] , requiring XR systems that can build and update persistent maps in situ. Our analysis surfaces a core trade-off: head-mounted views provide the stability necessary for reliable localization, cane-mounted views capture complementary ground-level geometry useful for obstacle avoidance, and fusing both perspectives yields improved scene reconstruction quality. A stationary-cane control further suggests that motion, rather than the cane viewpoint itself, is the primary contributor to the reduced SLAM metrics. In short, our contributions are threefold: • Community-grounded system constraints: a survey that surfaces operational barriers, spatial information needs, and form-factor requirements for assistive XR wearables. • Empirical characterization of vantage trade-offs: a synchronized head-cane comparison across multiple environments, including a stationary-cane control study that isolates the impact of sweeping dynamics on computer vision pipelines. • Architectural considerations for hybrid or adaptive systems: recommendations on multi-view integration and hybrid vantage strategies to balance localization stability with ground-level mapping for last-mile navigation. 1 BACKGROUND We discuss related work on Navigation Challenges for Blind Travelers, Wearable XR Navigation Systems, and Emerging Spatial Pipelines before identifying Knowledge Gaps and reiterating our three main research questions. 1.1 Navigation Challenges for Blind Travelers Navigating unfamiliar or complex environments remains persistently difficult for blind cane users, who rely primarily on tactile and auditory rather than visual strategies [ 50 , 44 , 62 , 52 , 22 ] . A long-running debate in assistive technology is whether systems should prioritize immediate obstacle avoidance or broader spatial awareness and destination finding . While early technical systems emphasized local obstacle detection [ 46 , 38 ] , Augmented Reality (AR) and XR are increasingly positioned as critical accessibility tools capable of delivering rich, global spatial context [ 9 ]

Read the complete text