Map-Mono-Ego: Map-Grounded Global Human Pose Estimation from Monocular Egocentric Video
Hiroyuki Deguchi 1,2 , Ryosuke Hori 1,2 , Kotaro Amaya 1 Tsubasa Maruyama 2 , Mitsunori Tada 2 , Hideo Saito 1 · 2026
Read Map-Mono-Ego: Map-Grounded Global Human Pose Estimation from Monocular Egocentric Video by Hiroyuki Deguchi 1,2 , Ryosuke Hori 1,2 , Kotaro Amaya 1 Tsubasa Maruyama 2 , Mitsunori Tada 2 , Hideo Saito 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20889.txt.
Introduction
H. Deguchi and five colleagues present Map-Mono-Ego, a map-grounded method for global human pose estimation from monocular egocentric video. One-camera egocentric pose estimation matters for activity monitoring, yet absolute location within an environment remains hard. Existing methods track relative motion from a start point and ignore absolute place. Scale ambiguity in one-camera vision also causes severe translational drift. Their method uses a pre-scanned 3D point cloud to achieve globally consistent poses from one camera alone, with tests on a new dataset.
Catalog record
| CREATOR | Hiroyuki Deguchi 1,2 , Ryosuke Hori 1,2 , Kotaro Amaya 1 Tsubasa Maruyama 2 , Mitsunori Tada 2 , Hideo Saito 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21885 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20889
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Map-Mono-Ego: Map-Grounded Global Human Pose Estimation from Monocular Egocentric Video Hiroyuki Deguchi 1,2 , Ryosuke Hori 1,2 , Kotaro Amaya 1 Tsubasa Maruyama 2 , Mitsunori Tada 2 , Hideo Saito 1 Abstract Monocular egocentric human pose estimation is essential for ubiquitous activity monitoring. However, understanding the user’s absolute location within the environment remains a challenge. Existing methods primarily focus on relative motion from an initial position, and tend not to account for the wearer’s absolute location within an environment. Furthermore, inherent scale ambiguity in monocular vision leads to severe translational drift, limiting long-term tracking without specialized multi-sensor hardware. To address this, we propose Map-Mono-Ego, a novel framework achieving globally consistent human pose estimation solely from a monocular camera by leveraging a pre-scanned 3D point cloud. We also introduce AIST-Living dataset, a new dataset pairing egocentric video with ground-truth motion in a scanned environment. Experiments demonstrate that our approach significantly outperforms the state-of-the-art baseline, proving its utility for practical monitoring tasks without specialized hardware. † † address: 1 Keio University 2 National Institute of Advanced Industrial Science and Technology 1 Introduction Estimating human pose using only a lightweight monocular wearable camera, which is common and minimal sensing setting, opens up scalable possibilities for AR/VR and ubiquitous activity monitoring. Figure 1: Overview of our proposed Map-Mono-Ego. To realize context aware applications, it is essential to understand not only the user’s body posture, but also their spatial relationship with the surrounding environment. In this paper, we propose Map-Mono-Ego, the framework that achieves spatially consistent human pose estimation from a monocular egocentric camera by leveraging a 3D map pre-scanned by a terrestrial laser scanner as a geometric prior. Fig. 1 shows the overview of Map-Mono-Ego. Despite its potential, current egocentric pose estimation methods focus on recovering relative body motion within a local coordinate system, typically initialized at the user’s starting position [ 7 , 12 ] . Consequently, these approaches often fail to account for the wearer’s absolute localization within a global map and lack geometric consistency with the environmental structure. Furthermore, accurate trajectory estimation of commmodity monocular wearable camera is inherently difficult due to scale ambiguity and motion blur, which leads to severe accumulation of translational errors over time [ 7 , 18 ] . While specialized multi-sensor hardware can mitigate these issues, reliance on them limits the applicability. To this end, we focus on monitoring scenarios in controlled environments, such as factories, offices, and residential spaces, where pre-scanning is feasible. In this paper, we propose a framework that leverages high-density 3D scanned point clouds as a geometric prior for estimating human pose. By referencing 3D geometry, our framework recovers a drift-mitigated, metric scale camera trajectory from monocular video, enabling precise global pose estimation. Our contributions are summarized as follows: 1) We propose a framework that estimates globally consistent human pose solely from a monocular egocentric camera by leveraging environmental geometry as a prior. 2) We introduce a robust trajectory tracking algorithm that fuses Hierarchical Localization [ 15 ] (HLoc) and Simultaneous Localization and Mapping [ 18 ] (SLAM), designed to incorporate environmental priors. 3) We constructed a new benchmark dataset comprising egocentric video, an environmental point cloud, and ground-truth motion data. Experiments on this dataset demonstrate the effectiveness of our method over the state-of-the-art baseline. We release the dataset and annotations at https://deguchihiroyuki.github.io/Map-Mono-Ego-Project/ . 2 RELATED WORKS 2.1 Human Motion Estimation from Egocentric Video Capturing human motion with wearable sensors has gained interest in various fields of application. Unlike traditional motion capture systems that consist of multiple external cameras, wearable sensor-based approaches don’t require costly equipment and are free from spatial restrictions. Among these, motion estimation solely from egocentric video with a front-facing camera device has gained attention due to its unique capability to capture environmental interactions and the ubiquity of consumer devices. Since the user’s body is often invisible in front-facing views, early approaches relied on interaction cues [ 10 ] or control policies [ 22 , 9 ] to infer pose. However, a significant paradigm shift occurred with the introduction of EgoEgo [ 7 ] , which demonstrated that head movement could be a condition for full-body pose. Following this, the field has largely shifted toward diffusion-based architectures conditioned on device trajectory [ 7 , 21 , 3 , 12 ] . This trend was accelerated by the availability of the standardized devices like Aria Glass [ 17 ] , and large-scale datasets containing paired egocentric video and motion ground-truth [ 8 ] . Despite these advancements, two critical limitations remain. First, the performance of these trajectory-conditioned approaches is heavily dependent on the accuracy of the input camera pose [ 7 ] . While high-end devices like Aria Glass provide robust localization, deriving accurate trajectories from standard monocular cameras remains challenging due to scale ambiguity and drift. Second, prior research has focused on evaluating relative motion starting from an initial position. Consequently, evaluation and discussion regarding global human placement within the world coordinate system have not been conducted in previous studies. In this work, we leverage 3D environmental point clouds to mitigate monocular drift and achieve spatially consistent human pose estimation. 2.2 Camera Pose Estimation Estimating the 6-DoF camera trajectory is fundamental for egocentric human pose estimation. While SLAM is traditionally adopted for this purpose, relying solely on a monocular camera still primarily suffers from scale ambiguity and accumulated drift caused by rapid motion and blur [ 18 ] . To address scale ambiguity, recent approaches often leverage multi-modal sensors like Aria Glass [ 17 ] . While effective, relying on specialized hardware limits the scalability to consumer-grade devices. Alternatively, EgoEgo [ 7 ] attempts to resolve scale from monocular video by learning the relationship between distance scale and optical flow. However, these methods often struggle to maintain geometric consistency over long sequences. Although standard SLAM systems incorporate loop closure to mitigate drift, they are often insufficient in scenarios where the user does not revisit previous locations frequently or in texture-less environments [ 18 ] . To address these limitations, we integrate HLoc [ 15 ] into the pipeline. Unlike pure SLAM or learning-based odometry, HLoc, which is a structure-based localization method [ 16 ] , leverages a pre-built 3D map to establish robust 2D-3D correspondences. By using these absolute poses as global anchors, our method ensures drift-mitigated, metric scale tracking using only a monocular camera, providing a reliable foundation for human motion estimation. 3 METHOD Figure 2: Overview of the Map-Mono-Ego framework. ① We estimate initial camera pose \hat{\mathbf{P}}^{\text{loc}} (Sec. 3.1 ). ② We filter \hat{\mathbf{P}}^{\text{loc}} for reliable camera poses and recover a smooth, drift-free trajectory \mathcal{P} via SLAM-based interpolation (Sec. 3.2 ). ③ We predict global human motion using the refined trajectory. \mathcal{P} (Sec. 3.3 ). Our goal is to recover the global human motion sequence X from T frames of an egocentric video I=\{I_{t}\}_{t=1}^{T} , and a pre-scanned 3D point cloud P^{scan} . As illustrated in Fig. 2 , Map-Mono-Ego operates in three stages: ① Localization via Synthetic Database: Estimating camera poses initially by matching the video frames against a synthetically rendered database from the point cloud. ② Trajectory Refinement by Inlier-based Filtering: Filtering for reliable camera poses based on geometric consistency and interpolating the trajectory