No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videos
Matteo Balice Yanik Künzi Chenyangguang Zhang Matteo Matteucci, Marc Pollefeys Sungwhan Hong · 2026
Read No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videos by Matteo Balice Yanik Künzi Chenyangguang Zhang Matteo Matteucci, Marc Pollefeys Sungwhan Hong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22190.txt.
Introduction
Matteo Balice and co-authors present NoPo4D, the first feed-forward system for dynamic scenes with unknown camera poses. Dynamic methods need poses or monocular input, pose-free methods handle only static scenes, and per-scene optimization costs minutes to hours. NoPo4D splits Gaussian motion into image-plane shifts and depth changes, supervised from pseudo optical flow. A motion encoder and view-dependent opacity complete the system. On four dynamic benchmarks it beats prior feed-forward baselines, and with post-optimization it surpasses per-scene methods far faster.
Catalog record
| CREATOR | Matteo Balice Yanik Künzi Chenyangguang Zhang Matteo Matteucci, Marc Pollefeys Sungwhan Hong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42686 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22190
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videos Matteo Balice Yanik Künzi Chenyangguang Zhang Matteo Matteucci, Marc Pollefeys Sungwhan Hong Abstract Recent feed-forward 3D gaussian splatting methods have made dramatic progress on individual aspects of 3D scene reconstruction, but no existing method jointly addresses dynamic content, multi-view input, and unknown camera poses in a single feed-forward pass. Methods that handle dynamics either require accurate camera poses or accept only monocular input; pose-free multi-view methods address only static scenes; and per-scene optimization methods bridge some of these gaps but at minutes-to-hours cost per scene. We introduce NoPo4D, the first feed-forward system that addresses this empty quadrant. Building on a pretrained geometry backbone and recent 4D Gaussian frameworks, NoPo4D introduces a velocity decomposition that splits Gaussian motion into per-pixel image-plane shifts and depth changes, allowing direct supervision from pseudo ground-truth optical flow on the 2D component. This sidesteps both the differentiable rendering that couples prior posed methods to pose accuracy and the 3D motion ground truth that prior pose-free methods require. The system is rounded out by a bidirectional motion encoder for cross-view and cross-frame feature aggregation, and view-dependent opacity that mitigates cross-view and cross-timestep Gaussian misalignments. On four multi-view dynamic benchmarks, NoPo4D consistently outperforms prior feed-forward baselines, and with an optional post-optimization stage surpasses per-scene optimization methods, while running orders of magnitude faster. Code and the pretrained weights will be made publicly available. 1 Introduction Reconstructing dynamic 3D scenes from a handful of time-synchronized video streams, without known camera poses, without per-scene optimization, and in a single forward pass, would bring free-viewpoint rendering of everyday activities to practical scale. Applications range from sports and performance capture with minimal infrastructure, to egocentric scene understanding, to immersive content creation outside controlled studio environments. Yet achieving this in practice demands solving three problems simultaneously: modeling dynamic content, fusing information across viewpoints, and estimating geometry without known camera poses. Recent feed-forward methods have achieved remarkable progress along individual axes of this problem. Static reconstruction from unposed multi-view images can now be performed in under a second [ 23 , 37 , 50 ] , while feed-forward 4D methods have begun to tackle dynamic scenes from monocular video [ 58 , 62 ] . However, each existing approach relaxes only a subset of the target constraints, whether by requiring known camera poses, accepting only monocular input, restricting to specific domains such as driving, or relying on per-scene optimization that takes minutes to hours [ 56 , 51 ] . As shown in Tab. 1 , no existing feed-forward method jointly handles dynamic scenes from unposed, multi-view video of general environments. We present NoPo4D , the first feed-forward system that addresses this empty quadrant. Filling it requires solving three problems that none of the constituent settings face in isolation. First, motion supervision must operate without GT poses or 3D motion annotations, neither of which is available at scale. Prior feed-forward dynamic methods sidestep one constraint at the cost of the other: posed approaches supervise through differentiable rendering [ 58 ] , while pose-free approaches supervise velocities directly against 3D motion ground truth [ 62 ] . We avoid both by decomposing Gaussian motion into per-pixel image-plane shifts and depth changes, supervising the image-plane component directly with pseudo ground-truth optical flow. Second, motion must remain consistent across both cameras and consecutive frames, which we address with a bidirectional motion encoder that performs joint self-attention across views and timesteps. Third, geometric inconsistencies in pose-free reconstruction now compound across cameras and timesteps, a more severe problem than either monocular dynamic or static multi-view methods face; we mitigate this with view-dependent opacity. We evaluate NoPo4D on four multi-view dynamic benchmarks: ExoRecon [ 56 ] , Immersive Light Field [ 4 ] , Kubric [ 16 ] , and N3DV [ 35 ] . Across all four, NoPo4D consistently outperforms prior feed-forward baselines. With optional post-optimization, NoPo4D surpasses per-scene optimization methods. Ablations validate that each design choice contributes meaningfully. In summary, our contributions are as follows: • We identify the setting of feed-forward, pose-free, multi-view dynamic scene reconstruction and show via systematic comparison that no prior method addresses it. • We introduce NoPo4D, the first feed-forward system that operates in this setting. Our key technical contribution is a velocity decomposition that splits Gaussian motion into per-pixel image-plane shifts and depth changes, allowing optical flow to supervise the image-plane component directly. We complement this with a bidirectional motion encoder that aggregates features across views and frames, and adopt view-dependent opacity to handle cross-view and cross-timestep Gaussian misalignments. • We evaluate on four multi-view dynamic benchmarks, demonstrating that NoPo4D consistently outperforms feed-forward baselines and, with optional post-optimization, surpasses per-scene optimization methods while running orders of magnitude faster. Table 1 : Capability comparison of related methods. NoPo4D is the first feed-forward method that jointly handles dynamic scenes from unposed, multi-view video of general environments. FF : feed-forward inference. Unposed : no ground-truth camera poses required. MV : supports multi-view input. Dyn. : models dynamic scenes. General : not restricted to a specific domain. Method Type FF Unposed MV Dyn. General NoPoSplat [ 66 ] Static ✓ ✓ ✓ ✗ ✓ FLARE [ 70 ] Static ✓ ✓ ✓ ✗ ✓ AnySplat [ 28 ] Static ✓ ✓ ✓ ✗ ✓ 4DGT [ 58 ] Dyn. ✓ ✗ ✗ ✓ ✓ NeoVerse [ 62 ] Dyn. ✓ ✓ ✗ ✓ ✓ DGGT [ 7 ] Dyn. ✓ ✓ ✓ ✓ ✗ Shape of Motion [ 51 ] Opt. ✗ ✗ ✗ ✓ ✓ MonoFusion [ 56 ] Opt. ✗ ✗ ✓ ✓ ✓ NoPo4D (Ours) Dyn. ✓ ✓ ✓ ✓ ✓ 2 Related Work Static Feed-Forward Reconstruction. The DUSt3R family [ 54 , 34 ] pioneered feed-forward 3D reconstruction by regressing dense point maps from image pairs, bypassing classical multi-stage pipelines. This idea was extended to dynamic point maps [ 69 , 19 ] , incremental multi-view processing [ 49 , 53 ] , and parallel many-view inference [ 59 ] . VGGT [ 50 ] scaled the paradigm to hundreds of views with joint prediction of cameras, depth, and point tracks, while Depth Anything 3 (DA3) [ 37 ] showed that a plain DINOv2 [ 40 ] backbone with alternating attention achieves spatially consistent multi-view geometry with fewer parameters. A parallel thread predicts Gaussian primitives directly from images. PixelSplat [ 6 ] and MVSplat [ 8 ] demonstrated feed-forward Gaussian prediction but require known poses. Removing this assumption, NoPoSplat [ 66 ] fine-tunes a MASt3R-style architecture for pose-free prediction, C3G [ 1 ] builds on top of the existing foundation models [ 50 ] , and subsequent methods generalize to cascaded pose-geometry pipelines [ 70 ] , unconstrained views [ 28 , 46 ] , variable-length sequences [ 9 , 22 ] , and unified pose-free and pose-dependent settings [ 65 ] . All these methods are restricted to static scenes. Feed-Forward Dynamic Reconstruction. L4GM [ 44 ] proposed the first feed-forward 4D model but is limited to object-centric scenes with per-frame Gaussians. 4DGT [ 58 ] introduced temporally coherent 4D Gaussians with lifespan and velocity attributes, trained on monocular posed video. NeoVerse [ 62 ] and MoVieS [ 36