Motion Cues from Image-based Point Tracking for LiDAR Scene Flow Estimation

Youngdong Jang Gyeongrok Oh Jong Wook Kim Hyunju Ryu, [0.5em] Hyung-gun Chi SeungHyeon Kim Seungryong Kim Jonghyun Choi Sangpil Kim · 2026

Read Motion Cues from Image-based Point Tracking for LiDAR Scene Flow Estimation by Youngdong Jang Gyeongrok Oh Jong Wook Kim Hyunju Ryu, [0.5em] Hyung-gun Chi SeungHyeon Kim Seungryong Kim Jonghyun Choi Sangpil Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16922.txt.

Introduction

Jang's team offers TrackCue, a way to sharpen motion labels for LiDAR scene flow in self-driving cars. Self-taught flow methods sort points into still and moving groups, but sparse geometry and blocked views make those labels noisy and mislead training. TrackCue reuses image point tracking to get dense paths tied to LiDAR points, then compares them with paths caused by the car's own motion to isolate true object motion. The cleaned labels raise dynamic-label precision and scores, lifting self-taught flow performance.

Catalog record

CREATORYoungdong Jang Gyeongrok Oh Jong Wook Kim Hyunju Ryu, [0.5em] Hyung-gun Chi SeungHyeon Kim Seungryong Kim Jonghyun Choi Sangpil Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58028
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16922

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Motion Cues from Image-based Point Tracking for LiDAR Scene Flow Estimation Youngdong Jang Gyeongrok Oh Jong Wook Kim Hyunju Ryu, [0.5em] Hyung-gun Chi SeungHyeon Kim Seungryong Kim Jonghyun Choi Sangpil Kim Abstract LiDAR scene flow estimation is essential for autonomous driving, as it provides 3D motion for each point. Self-supervised approaches use static-dynamic classification to mitigate the imbalance between static and dynamic points, deriving targeted supervision. However, existing methods rely on sparse geometric observations for this classification, making them vulnerable to data sparsity and occlusions. The resulting noisy labels provide incorrect motion guidance and degrade scene flow learning. To address this, we introduce TrackCue , a tracking-guided framework for improving dynamic object representation in LiDAR scene flow estimation. In particular, TrackCue repurposes point tracking to obtain dense image-space trajectories anchored to LiDAR points, providing motion cues beyond sparse geometric observations. Furthermore, we present a visually consistent motion compensation strategy that compares the tracked trajectories with ego-induced rigid trajectories in the image plane, effectively isolating true object motion from ego-induced apparent motion. To transfer these isolated motion cues back to the LiDAR domain, we perform visual motion cue lifting, which associates ego-compensated image trajectories with LiDAR points for static-dynamic label refinement. As a result, TrackCue produces more accurate static-dynamic classification and provides more reliable supervision for scene flow learning. Experimental results show that TrackCue significantly improves the precision and F1 score of dynamic labels, leading to performance gains in self-supervised scene flow estimation. † † footnotetext: * Equal contribution. \dagger Corresponding author. 1 Introduction LiDAR scene flow estimation li2021neural ; li2023fast ; li2025uniflowzeroshotlidarscene ; zhang2026deltaflow is essential for autonomous driving, as it provides point-level 3D motion from consecutive point clouds and supports downstream tasks such as motion prediction, planning, and robust perception. However, accurate scene flow learning is challenging due to the high cost of ground-truth annotations. To reduce this reliance on manual labels, self-supervised approaches learn scene flow directly from point cloud sequences. Existing self-supervised approaches vedder2024neural ; hoffmann2025floxels ; zhang2025himo ; zhang2024seflow can be divided into optimization-based methods and feed-forward models. In this work, we focus on feed-forward self-supervised approaches, which are more suitable for practical deployment than optimization-based methods by avoiding costly per-scene optimization at test time. Figure 1: Analysis of dynamic auto-label quality for self-supervised LiDAR scene flow estimation. (Left) Visualization of the dynamic-awareness map. TrackCue suppresses static regions, such as walls, while retaining points that correspond to actual object motion. (Right) TrackCue reduces dynamic-point over-prediction compared with DUFOMap duberg2024dufomap , achieving higher Dynamic IoU. The dashed line indicates the ground-truth dynamic ratio. TP/FP decomposition shows that TrackCue filters LiDAR-induced false positives, improving precision and F1 score. A key challenge in the feed-forward self-supervised approaches lin2025voteflow ; zhang2025himo ; zeroflow is the severe imbalance between static and dynamic points. Most of the points in driving scenes belong to the static points. Without accounting for this imbalance, self-supervision biases the model toward predicting zero flow. To address this, existing approaches zhang2024seflow ; zhang2025himo first classify static and dynamic points, enabling different supervision strategies for each type of point. This static-dynamic classification typically relies on ray-casting-based dynamic-awareness mapping, such as DUFOMap duberg2024dufomap , which is constructed only from LiDAR point clouds. Specifically, ray-casting identifies regions traversed by rays as voids and classifies points later observed in those regions as dynamic. However, this procedure depends on dense and consistent LiDAR observations. In sparse or occluded regions, incomplete ray evidence leads to incorrect void region estimation, causing static points to be mislabeled as dynamic or moving points to be missed. These noisy labels provide inappropriate motion guidance and degrade scene flow learning. To overcome these limitations, we introduce TrackCue , a tracking-guided framework that improves the reliability of dynamic labels for self-supervised scene flow learning. Sparse and occluded LiDAR observations often make dynamic object traces discontinuous across frames, whereas dense image observations provide better visual continuity for tracking. To exploit this complementarity, TrackCue leverages image-based point tracking karaev2025cotracker3 ; harley2025alltracker ; zholus2025tapnext to obtain dense image-space trajectories as motion cues for static-dynamic classification. Specifically, TrackCue projects LiDAR points labeled by DUFOMap duberg2024dufomap onto the image plane and uses the projected pixels as tracking queries for a point tracker. The point tracker predicts image-space trajectories for these queries across consecutive frames. These trajectories enable the identification of dynamic points that are difficult to track from LiDAR alone, especially under sparse or partially occluded observations. Additionally, we present a visually consistent motion compensation strategy to distinguish true object motion from ego-induced apparent motion in the image plane. As shown in Figure 3 , even static points can exhibit image-space displacement due to ego-vehicle motion, making tracking trajectories insufficient for identifying independently moving objects. To resolve this, TrackCue compares tracked trajectories with ego-induced rigid trajectories. Points that consistently deviate from their rigid trajectories are then identified as independently moving objects. Finally, TrackCue lifts these ego-compensated trajectory cues back to the LiDAR domain. It associates their image-space locations with projected LiDAR points through nearest-neighbor search, thereby converting dense visual motion evidence into refined static-dynamic labels in the 3D point cloud. These refined labels complement LiDAR-only observations and provide more reliable supervision for self-supervised scene flow learning. Figure 1 shows that TrackCue produces more reliable dynamic labels than DUFOMap duberg2024dufomap . It reduces false-positive dynamic labels by 35.6%, while improving precision from 24.6% to 31.4% and F1 score from 36.7% to 42.4%. Our empirical results and analysis show that TrackCue improves dynamic label reliability and enhances scene flow performance compared to existing self-supervised baselines. Our primary contributions are summarized as follows: • We propose TrackCue , a tracking-guided framework for self-supervised LiDAR scene flow that leverages image-based point tracking to identify dynamic points with dense visual motion cues. • We introduce a visually consistent motion compensation strategy that compares tracked image-space trajectories with ego-induced rigid trajectories, enabling TrackCue to isolate independent object motion from apparent motion caused by ego-vehicle movement in the image plane. • Visual motion cue lifting process that transfers ego-compensated image-space trajectories back to LiDAR points, producing refined static-dynamic labels and improving the reliability of self-supervised scene flow supervision. 2 Related Works Scene Flow Estimation aims to estimate the 3D motion vector of moving objects in dynamic scenes. In autonomous driving, existing works have explored both supervised li2025uniflowzeroshotlidarscene ; zhang2026deltaflow ; jund2021scalable ; khatri2024can ; khoche2025ssf ; kim2025flow4d and self-supervised learning zhang2026teflow ; zhang2025himo ; zhang2024seflow ; lin2025voteflow ; zeroflow ; vedder2024neural ; hoffmann2025floxels ; lin2024icp ; li2021neural ; li2023fast paradigms. Recently, self-supervised approaches have gained increasing attention, as dense 3D annotations are costly and difficult to scale. One prominent line of work vedder2024neural ; hoffmann2025floxels ; li2021neural ; li2023fast adopts optimization-based methods that performs per-scene optimization during test time. While these approaches estimate accurate flow fields by exploiting long-term temporal context, their high computational overhead limits their applicability to real-time deployment. Another line of work zhang2026teflow ; zhang2025himo ; zhang2024seflow ; lin2025voteflow ; zeroflow uses feed-forward models pretrained on large-scale unlabeled datasets, enabling flow prediction with a single forward pass. Importantly, these self-supervised approaches highly depend on pseudo-labels based on dynamic object clustering. DUFOMap duberg2024dufomap is an efficient dynamic-awareness mapping framework that separates moving objects from the static environment. It facilitates providing

Read the complete text