FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstruction
Yuqiu Liu, Jialin Song, Marissa Ramirez de Chanlatte, Rochishnu Chowdhury, Rushil Paresh Desai, Wuyang Chen, Daniel Martin, Michael W. Mahoney · 2026
Read FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstruction by Yuqiu Liu, Jialin Song, Marissa Ramirez de Chanlatte, Rochishnu Chowdhury, Rushil Paresh Desai, Wuyang Chen, Daniel Martin, Michael W. Mahoney (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21356.txt.
Introduction
Liu and co-authors present FluidGaussian, a method that couples 3D reconstruction with fluid simulation. Standard reconstructions from multi-view images optimize for visual fidelity alone. That view ignores body contacts and treats function-critical surfaces, such as aerodynamic ones, like ornamentation. FluidGaussian runs fluid simulations to score surface quality at fine granularity. The scores guide active learning toward views that improve both visual and physical fidelity. On three data sets, visual quality rises and velocity divergence falls sharply.
Catalog record
| CREATOR | Yuqiu Liu, Jialin Song, Marissa Ramirez de Chanlatte, Rochishnu Chowdhury, Rushil Paresh Desai, Wuyang Chen, Daniel Martin, Michael W. Mahoney |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47010 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21356
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstruction Yuqiu Liu, Jialin Song, Marissa Ramirez de Chanlatte, Rochishnu Chowdhury, Rushil Paresh Desai, Wuyang Chen, Daniel Martin, Michael W. Mahoney Abstract Real objects that inhabit the physical world follow physical laws and thus behave plausibly during interaction with other physical objects. However, current methods that perform 3D reconstructions of real-world scenes from multi-view 2D images optimize primarily for visual fidelity, i.e., they train with photometric losses and reason about uncertainty in the image or representation space. This appearance-centric view overlooks body contacts and couplings, conflates function-critical regions (e.g., aerodynamic or hydrodynamic surfaces) with ornamentation, and reconstructs structures suboptimally, even when physical regularizers are added. All these can lead to unphysical and implausible interactions. To address this, we consider the question: How can 3D reconstruction become aware of real-world interactions and underlying object functionality, beyond visual cues? To answer this question, we propose FluidGaussian, a plug-and-play method that tightly couples geometry reconstruction with ubiquitous fluid-structure interactions to assess surface quality at high granularity. We define a simulation-based uncertainty metric induced by fluid simulations and integrate it with active learning to prioritize views that improve both visual and physical fidelity. In an empirical evaluation on NeRF Synthetic (Blender), Mip-NeRF 360, and DrivAerNet++, our FluidGaussian method yields up to +8.6% visual PSNR (Peak Signal-to-Noise Ratio) and -62.3% velocity divergence during fluid simulations. Our code is available in https://github.com/delta-lab-ai/FluidGaussian . 1 Introduction 3D reconstruction aims to recover the geometry and appearance of real-world 3D scenes from multi-view 2D images. Modern radiance-field techniques aim to learn continuous scene representations with strong visual fidelity and efficient rendering. This includes Neural Radiance Fields (NeRFs) optimized through differentiable volume rendering 40 and 3D Gaussian Splatting with explicit Gaussian primitives for real-time rendering 30 . Building on these representations, next-best-view (NBV) selection improves reconstruction with limited views by choosing poses that reduce model uncertainty or that maximize Fisher information 46 ; 28 . Despite such progress, most pipelines still optimize almost exclusively for visual fidelity . Figure 1 : When only visual fidelity is optimized and physical awareness is excluded 46 ; 28 (left column), reconstructions may look correct visually (top), and yet can fail functionally : fluid simulation exhibits excessive velocity-field divergence (defined in Section 3.2 ), a deficiency that worsens from low to high turbulence (from middle to bottom). With FluidGaussian (right column), both visual fidelity and simulation fidelity are better preserved. While visual fidelity is important, in many applications, in particular those in scientific and engineering domains, the goal is not only to reproduce views but also to recover geometry that exists in the real world and that behaves plausibly under interactions 31 ; 17 . Without physics awareness, reconstructed shapes may visually look correct , and yet can fail functionally as 3D assets (Fig. 1 ). This inability of existing methods can arise for several reasons: (i) they rely only on appearance cues , ignoring body contacts and mechanical couplings that govern interactions; (ii) they ignore functional preservation , treating function-critical regions (such as aerodynamic or hydrodynamic surfaces) the same as cosmetic geometry; and (iii) they miss fine-scale details that are essential for stable physical behavior. Although recent studies examine simulation-related uncertainty 23 ; 21 ; 42 ; 12 , these works focus on scientific machine learning rather than 3D reconstruction. Incorporating physics awareness supports “functional intelligence” in 3D vision, potentially enabling assets that interact stably in simulation. Motivated by these gaps, we ask: How can 3D reconstruction become aware of real-world interactions and underlying object function, beyond visual cues? In this work, we introduce FluidGaussian, a method to perform physics-aware reconstruction by propagating uncertainty from physical interactions. We use fluid simulation as the interaction model, as fluid-structure responses can be used to provide detailed signals of geometry quality (Section 2.2 ). We propose the following methods: • Metrics. We define a simulation-induced uncertainty metric that measures physical plausibility and interaction fidelity by evaluating reconstructed geometry in standard fluid simulations. • Planners. We couple this uncertainty with NBV planners, turning view acquisition physics-aware and guiding poses toward regions where fluid–structure behavior reveals weaknesses beyond photometric cues. • Evaluation. We evaluate both visual and simulation-grounded fidelity across synthetic, realistic, and scientific datasets, with a focus on function-critical areas. FluidGaussian achieves the performance improvements: • Improved visual appearance up to +8.6% PSNR on Blender, Mip-NeRF 360, and DrivAerNet++, covering both everyday and scientific scenarios. • Improved simulation fidelity , leading to up to -62.3% lower velocity-field divergence (more incompressible), with larger gains at higher Reynolds numbers. • High accuracy on function-critical surfaces , achieving +7.7% PSNR on flow-interacting regions. Figure 2 : Overview of FluidGaussian. To introduce physics-awareness into 3D reconstruction: (1) start from K candidate camera poses proposed by vision-based NBV methods 46 ; 28 ; and (2) evaluate a physics-informed uncertainty induced from fluid-structure simulations (Section 3.2 ) and select the best next camera pose (Section 3.3 ). The blue block denotes the fluid. 2 Background and Motivation In this section, we justify the lack of physical quality preservation in standard 3D reconstruction methods, and we detail our plan for quantifying this deficit. 2.1 Background: Active 3D Reconstruction Gaussian Splatting. For our geometry representation, we consider 3D Gaussian Splatting (3DGS) 30 . We parameterize a scene by N anisotropic 3D Gaussians: \mathcal{G}=\{g_{i}\}_{i=1}^{N},\qquad g_{i}=(\mathbf{x}_{i},\boldsymbol{\Sigma}_{i},\alpha_{i},\mathbf{c}_{i}), where \mathbf{x}_{i}\in\mathbb{R}^{3} is the center, \boldsymbol{\Sigma}_{i}\in\mathbb{R}^{3\times 3} the covariance, \alpha_{i}\in[0,1] the opacity, and \mathbf{c}_{i} denotes (view-dependent) color coefficients. Given calibrated training data \mathcal{D}=\{(\mathbf{I}_{m},\mathbf{T}_{m})\}_{m=1}^{|\mathcal{D}|} ( \mathbf{I} the image view; \mathbf{T}=[\mathbf{R|\mathbf{t}}] the camera pose with the rotation-translation pair), we render view m with a differentiable rasterizer \hat{\mathbf{I}}_{m}=\mathcal{R}(\mathbf{T}_{m};\mathcal{G}), and we learn parameters \mathcal{G} by minimizing a photometric objective, \min_{\mathcal{G}}\;\mathcal{L}(\mathcal{G})=\sum_{m=1}^{|\mathcal{D}|}\ell\!\left(\hat{\mathbf{I}}_{m},\mathbf{I}_{m}\right), with a standard per-pixel loss \ell (e.g., SSIM). Active View Acquisition. Dense image capture for 3D reconstruction can be costly, especially for large or outdoor assets that can rely on UAV (unmanned aerial vehicle) photogrammetry (adding flight-planning, longer flight times, and heavier data processing burdens) 35 ; 45 ; 22 ; 11 . To reduce effort, active reconstruction lowers capture cost by selecting NBVs using uncertainty or information-gain criteria 46 ; 28 , acquiring only the views that most improve reconstruction under a fixed budget. 2.2 Motivation: Fluid Simulation Exposes Physical Flaws in 3D Reconstructions Visual Overfitting Underestimates Physical Quality. Reconstructions trained only with visual losses can score highly on image metrics (e.g., PSNR) but behave poorly in physical simulation . This is illustrated in Fig. 1 , where the appearance-optimized baseline renders plausibly, but produces flow fields with large (worse) velocity divergence (defined in Section 3.2 ), clear evidence of non-physical behavior, and discrepancy that worsens in high turbulence regimes, where simulation errors amplify. This is but one example of visual overfitting systematically underestimating true physical quality: reconstructions that score well in pixel-space metrics are revealed as seriously deficient when evaluated via interaction-based simulation. Quantification of Physical Quality via Interactions. Physical quality can be assessed by how geometry behaves under interactions . For example, with digital twins, models must not just reproduce appearance, but instead they must also predict real behavior under loads and environments 48 ; 16 ; 29 ; 50 ; 8 . This is particularly important when the digital twin makes decisions to update