Learning an Implicit Physics Model for Image-based Fluid Simulation
Emily Yue-Ting Jia, Jiageng Mao, Zhiyuan Gao, Yajie Zhao, Yue Wang, [email protected] · 2025
Read Learning an Implicit Physics Model for Image-based Fluid Simulation by Emily Yue-Ting Jia, Jiageng Mao, Zhiyuan Gao, Yajie Zhao, Yue Wang, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08254.txt.
Introduction
Emily Yue-Ting Jia and co-authors present a computer method that animates fluid in a still image in a way that obeys physics. Their paper from 2025 starts from a human skill: people can picture motion and depth from one image. Past methods used simple two dimensional motion guesses, which often broke the rules of flow.
The method trains a network to predict motion for each point on a surface. A loss term drawn from the classic flow equations keeps the motion true to physics. Form is built as soft three dimensional blobs from the image and its depth, then moved by the predicted motion. Tests show more life like results than past methods.
Catalog record
| CREATOR | Emily Yue-Ting Jia, Jiageng Mao, Zhiyuan Gao, Yajie Zhao, Yue Wang, [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-08254
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning an Implicit Physics Model for Image-based Fluid Simulation Emily Yue-Ting Jia, Jiageng Mao, Zhiyuan Gao, Yajie Zhao, Yue Wang, [email protected] Abstract Humans possess an exceptional ability to imagine 4D scenes, encompassing both motion and 3D geometry, from a single still image. This ability is rooted in our accumulated observations of similar scenes and an intuitive understanding of physics. In this paper, we aim to replicate this capacity in neural networks, specifically focusing on natural fluid imagery. Existing methods for this task typically employ simplistic 2D motion estimators to animate the image, leading to motion predictions that often defy physical principles, resulting in unrealistic animations. Our approach introduces a novel method for generating 4D scenes with physics-consistent animation from a single image. We propose the use of a physics-informed neural network that predicts motion for each surface point, guided by a loss term derived from fundamental physical principles, including the Navier-Stokes equations. To capture appearance, we predict feature-based 3D Gaussians from the input image and its estimated depth, which are then animated using the predicted motions and rendered from any desired camera perspective. Experimental results highlight the effectiveness of our method in producing physically plausible animations, showcasing significant performance improvements over existing methods. Our project page is https://physfluid.github.io/ . Figure 1 : Our goal is to create realistic fluid animations that are consistent with basic physics laws from a single still image. Our methods handle the obstructions added in the input images and generate realistic fluid animation videos from novel views and moving cameras. 1 Introduction Given a single image of natural fluids, humans can vividly imagine the surrounding scene and the potential movements within it. For instance, an image of a stream might evoke a tranquil walk along its crystal-clear, shallow waters in a peaceful forest, accompanied by the gentle sound of water flowing over smooth stones. Similarly, a photo of a waterfall cascading down a rugged cliff can create a sensory experience, bringing to mind the powerful roar of water crashing into a pool below and the awe of witnessing nature’s grandeur. This imaginative ability to construct a 4D scene, blending spatial and temporal elements from a single image, is essential to the human experience. This paper focuses on replicating the human imaginative ability to construct 4D natural fluid scenes using neural networks. We identify this ability as a video generation problem, where the goal is to enable the model to generate videos that depict both fluid motion and camera movement, given a single image and a specified camera trajectory. Although such an ability is commonly possessed by humans, replicating this imaginative capacity in computational models is a significant challenge, even when we focus only on fluids. One possible approach is leveraging simulation. However, traditional fluid simulation demands precise knowledge of the boundary geometry and physical properties such as mass, initial velocity, and external forces. Such detailed information, however, is difficult to infer solely from a single image. Another potential approach is to learn fluid motion solely from data priors. However, due to the complexity of fluid dynamics, these methods [ 3 , 23 , 19 ] often produce animations that appear unrealistic. For example, the fluids in the animation may penetrate the occlusions, as these methods have no understanding of collisions. In this paper, we propose physics-informed neural dynamics, a data-driven approach that predicts physically grounded flow dynamics from a single fluid image. The core of this method is a conditional physics-informed neural network that learns from both data priors and additional guidance from fundamental physics laws. Our approach addresses the challenge of predicting detailed physical properties by directly estimating the 3D velocity field from the input image. By leveraging both data priors and physical guidance, our physics-informed neural dynamics produces fluid animations that are both visually compelling and physically accurate. Experiments show that our model effectively captures the interaction between fluids and boundaries while successfully adapting to changes in boundary geometry. While our physics-informed neural dynamics predicts physically accurate fluid motions, visualizing these motions in videos requires transforming the input image into a representation suitable for animation. We adopt 3D Gaussians [ 22 ] as the representation, as they facilitate novel-view synthesis and are also easy to animate. Using the velocity field predicted by the physics-informed neural dynamics, the 3D Gaussian representation—obtained by lifting pixels with their relative depth—can be animated by displacing each Gaussian kernel according to its corresponding velocity. The displaced kernels can be rendered from any camera pose to produce the desired video frames. By combining our physics-informed neural dynamics with the 3D Gaussian representation, our method generates physically plausible videos of natural fluid motions from any specified camera trajectory, effectively replicating the human ability to envision and construct a 4D scene from a single image. Further comparison with baseline methods demonstrates that our method achieves higher visual quality from both statistical evaluations and human judgment. Furthermore, experiments on boundary editing tasks show that our method successfully adapts to boundary changes, whereas the baseline method generates unrealistic animations. To summarize, our contributions are: \bullet We introduce a novel method to generate a 4D scene from a single image, producing physically plausible videos that capture both fluid motion and camera movement. \bullet We propose physics-informed neural dynamics, a data-driven approach that can predict physics-grounded flow dynamics from a single image of natural fluids. \bullet Experiments show that our framework surpasses baseline methods, producing more realistic animations, particularly in image editing tasks where the boundary is changed. Figure 2 : An overview of our proposed method. Our method consists of two parts: the Physics-informed Neural Dynamics , which predicts the fluid motions, and the Animation Module , which reconstructs the 3D geometry of the scene. 2 Related Works Single Image Animation: Many studies explore video generation from a single image. Diffusion-based methods [ 17 , 2 , 18 , 39 , 20 , 47 ] generate videos from images or text prompts. However, these methods require careful prompting to effectively control, and the animations produced by these methods often lack physical plausibility and 3D consistency. Recent works [ 3 , 13 , 50 , 25 , 45 , 49 ] add 3D constraints for multi-view consistency but mostly focus on static scenes. Others [ 26 , 40 , 53 , 46 ] incorporate physics for realistic animations, yet none address fluid animation. Besides diffusion-based approaches, alternative methods have also been explored. [ 6 , 21 ] suggest using motions to guide animation generation. Following them, motion transfer methods [ 4 , 8 , 27 , 34 , 37 ] require reference videos and are unsuitable for our task. Other methods [ 9 , 23 , 28 , 19 ] employ learnable motion estimators. [ 9 , 28 , 19 ] adopt 2D feature warping with the predicted motion maps, while [ 23 ] transforms the image to 3D point clouds and animates them by lifting the 2D motion maps to 3D. [ 35 ] further extends [ 23 ] to support longer camera trajectories by using Diffusion model to inpaint the invisible areas. However, lacking the knowledge of physics, these methods produce unrealistic animations. In contrast, our approach integrates both physics and data priors for