DisFlow: Scene Flow from Distance Field for Object Pose, Velocity Tracking, and Dynamic Object Reconstruction
Lan Wu, Sheila Sutjipto, Jennifer Wakulicz, Teresa Vidal-Calleja · 2026
Read DisFlow: Scene Flow from Distance Field for Object Pose, Velocity Tracking, and Dynamic Object Reconstruction by Lan Wu, Sheila Sutjipto, Jennifer Wakulicz, Teresa Vidal-Calleja (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01824.txt.
Introduction
Wu and co-authors track moving objects in 3D from range data. Their DisFlow method works online, frame by frame. It finds an object's pose and speed as it moves. It also rebuilds the object's surface over time. The scene is stored as a smooth distance field.
Surface normals add slope facts to that field. Flow is read from how the field shifts in time. New point clouds are fit with a closed-form step. Fusion takes place in the object's own frame. In that frame, the object stays fixed in shape. The authors report dense shape, normals, and pose paths. The tight space-time link is the core of the design.
Catalog record
| CREATOR | Lan Wu, Sheila Sutjipto, Jennifer Wakulicz, Teresa Vidal-Calleja |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01824
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DisFlow: Scene Flow from Distance Field for Object Pose, Velocity Tracking, and Dynamic Object Reconstruction Lan Wu, Sheila Sutjipto, Jennifer Wakulicz, Teresa Vidal-Calleja Abstract We present DisFlow , a novel framework for online scene flow estimation from distance field that enables 6DoF dynamic object pose estimation , motion tracking , and surface reconstruction . The scene is represented by Gaussian Process Implicit Surfaces (GPIS), with surface normals serving as derivative constraints, enabling accurate signed distance computations near the surface and gradient queries with uncertainty. With this representation as a foundation, we compute a scene flow from the distance field that describes how surface points are transported over time in consecutive frames. Through our flow, we can estimate an object’s pose and motion by incrementally registering a new observed point cloud via an elegant closed-form optimisation. Unlike prior methods that operate in the camera or world frame, our approach performs probabilistic fusion directly in the object frame , where the object remains geometrically consistent over time. The tight coupling of the DisFlow method in space and time yields dense geometry, surface normals, object pose trajectories, velocities, and uncertainty, all at real-time rates. We evaluate DisFlow on dynamic object sequences and demonstrate that it achieves accurate pose and motion tracking while simultaneously reconstructing high-quality object surfaces. Code publicly available at https://github.com/LanWu076/disflow_ros2 I Introduction Estimating the pose and motion of dynamic objects is a fundamental capability for robotic perception. It enables a wide range of downstream tasks, including manipulation, handover, grasping, navigation, and human–robot interaction. While classical methods in simultaneous localisation and mapping (SLAM) or reconstruction have achieved remarkable results for static environments, dynamic objects remain challenging. The central difficulty lies in jointly reasoning about object motion and surface geometry from partial and noisy observations. (a) (b) (c) (d) (e) Fig. 1 : The output of DisFlow framework and the experimental setup (a). Subfigures show the fixed object reconstruction in the object frame on the left, and the same reconstruction overlaid with the rotating RGB stream on the right (b)-(e). Refer to the supplementary video for details. Recent works have explored real-time object tracking using either filtering based on optical flow [ 1 ] or learning based pipelines [ 2 ] . However, such methods focus primarily on pose tracking and estimating dense flow, but not on maintaining a dense surface reconstruction of the object itself. Therefore, they are limited to tasks that require detailed surface information, such as contact reasoning or manipulation. In addition, learning-based pipelines rely on large-scale training data and are typically trained on specific objects, which limits their generalisation to unseen categories. In contrast, dense reconstruction approaches such as TSDF fusion [ 3 ] or volumetric mapping [ 4 ] build explicit object surfaces but are typically designed for static scenes. Moreover, conventional volumetric fusion lacks a probabilistic representation and does not provide uncertainty, which is important for safety and planning. In this work, we present DisFlow , a novel framework for online scene flow estimation from distance field, enabling 6DoF object pose and velocity estimation with online surface reconstruction. Our method relies on an object-centric reference frame to perform object pose tracking and fusion in a temporally consistent manner (see Fig. 1 . We represent the object with Gaussian Process Implicit Surfaces (GPIS) [ 5 , 6 ] , trained with both surface points and normals as derivative constraints. The distance field from GPIS is accurate close to the surface, given a high frame rate. This enables accurate signed distance and gradient queries, along with uncertainty estimates. Grounded on this representation, we compute the scene flow [ 7 ] based on the distance field that describes how surface points are transported over time as the object moves. This notion of flow provides the conceptual link between pose tracking and surface reconstruction. Through our flow, we can estimate an object’s pose and motion by incrementally registering a new observed point cloud via an elegant closed-form optimisation. The estimated pose then projects new observations into the object frame, incrementally updating local GPs stored in an octree structure. This tight integration yields real-time outputs of object pose, velocity, dense surface reconstruction, and associated uncertainty. The key contributions of this paper are: • We propose DisFlow , a framework that leverages instantaneous distance fields to recover the scene flow, enabling 6DoF and linear and angular velocities with the probabilistic surface reconstruction in real-time. • We introduce an object-centric strategy that naturally handles dynamic objects, ensuring consistent geometry. • We demonstrate that DisFlow simultaneously delivers real-time pose trajectories, object velocities, and dense surface reconstructions , outperforming tracking-only or reconstruction-only baselines, and providing a foundation for downstream applications. II Related Work II-A Object Pose and Motion Tracking Estimating dynamic objects, including 6DoF pose and velocity, has been extensively studied in robotics and computer vision. Classical approaches such as Iterative Closest Point (ICP) and its variants [ 8 , 9 ] perform frame-to-frame alignment of point clouds, but remain sensitive to initialisation and partial views, limiting their robustness in dynamic scenarios. Flow-based formulations have long been explored as an alternative. Normal flow along image gradients provides a directly observable constraint [ 10 ] , while scene flow generalises this idea to RGB-D data to estimate dense 3D motion fields [ 7 ] . Recent works leverage dense flow for pose refinement, e.g., DeepIM [ 11 ] aligns rendered and observed images, and ROFT [ 1 ] formulates pose tracking as robust optical flow alignment to compensate for network latency. These methods highlight the utility of flow cues, but typically depend on strong learning priors or hand-crafted constraints, and seldom provide principled uncertainty estimates. Beyond flow-based methods, learning-driven systems such as PoseCNN [ 12 ] , PVNet [ 13 ] , and CosyPose [ 2 ] have demonstrated improved robustness across object categories. Other pipelines, such as Co-Fusion [ 14 ] address dynamic objects by fusing depth in the world frame. Despite these advances, most methods either prioritise tracking accuracy without maintaining dense and temporally consistent surface reconstructions or rely on heavy GPU computation, limiting their deployability in real-time robotic settings. II-B Volumetric Reconstruction Dense 3D reconstruction has been widely addressed using volumetric signed distance fields, starting from the work [ 3 ] . KinectFusion [ 15 ] demonstrated real-time surface reconstruction by fusing depth images into a global TSDF volume, inspiring numerous extensions such as Nvblox [ 4 ] . While these systems achieve high-quality reconstructions in static scenes, handling dynamics remains challenging. Approaches such as Co-Fusion [ 14 ] incorporate non-rigid alignment or segmentation to deal with moving objects, yet they still rely on rule-based filtering to discard inconsistent observations. Moreover, TSDF-based fusion does not provide uncertainty estimates, which are critical for safe interaction in robotics. II-C Probabilistic Implicit Representations To overcome the limitations of discrete volumetric grids, probabilistic implicit representations have been explored. Gaussian Process Implicit Surfaces (GPIS) [ 6 ] provide a continuous and differentiable model of object surfaces, capable of jointly predicting signed distances and gradients. Extensions incorporating normals as derivative constraints [ 16 ] improve surface fidelity and orientation consistency. Such models naturally provide uncertainty estimates, which have been exploited for active perception and safety-aware planning. However, prior GPIS-based works