Continuous Normalizing Flows for Uncertainty-Aware Human Pose Estimation
Shipeng Liu, Ziliang Xiong, Bastian Wandt, Per-Erik Forssén · 2025
Read Continuous Normalizing Flows for Uncertainty-Aware Human Pose Estimation by Shipeng Liu, Ziliang Xiong, Bastian Wandt, Per-Erik Forssén (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02287.txt.
Introduction
Shipeng Liu, Ziliang Xiong, Bastian Wandt, and Per-Erik Forssén add doubt care to gauge of how folk stand and move, with smooth flow rules that keep sums whole. To gauge stance counts for play in fake worlds and for read of moves. Fit ways are fast but take set forms for out spreads. That weakens their doubt gauges. Heat map ways model spreads well at high cost in gear.
Their way has a long name built from smooth flow and left over gauge terms. It folds smooth flow rules into fit models so the out spread shifts as the case needs. Tests on stance tasks in two dims and three dims show gains. Scores for truth and for doubt beat base ways. The gains come while the fast pace stays. That pace makes fit ways draw staff for real use.
Catalog record
| CREATOR | Shipeng Liu, Ziliang Xiong, Bastian Wandt, Per-Erik Forssén |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-02287
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Continuous Normalizing Flows for Uncertainty-Aware Human Pose Estimation Shipeng Liu, Ziliang Xiong, Bastian Wandt, Per-Erik Forssén Abstract Human Pose Estimation (HPE) is increasingly important for applications like virtual reality and motion analysis, yet current methods struggle with balancing accuracy, computational efficiency, and reliable uncertainty quantification (UQ). Traditional regression-based methods assume fixed distributions, which might lead to poor UQ. Heatmap-based methods effectively model the output distribution using likelihood heatmaps, however, they demand significant resources. To address this, we propose Continuous Flow Residual Estimation (CFRE), an integration of Continuous Normalizing Flows (CNFs) into regression-based models, which allows for dynamic distribution adaptation. Through extensive experiments, we show that CFRE leads to better accuracy and uncertainty quantification with retained computational efficiency on both 2D and 3D human pose estimation tasks. 1 Introduction Human Pose Estimation (HPE) is a critical task in computer vision with applications spanning virtual reality, motion analysis, and intelligent surveillance. It involves identifying human keypoint locations from visual data. These keypoints correspond to anatomical landmarks such as joints (e.g. shoulders, elbows, and knees). Despite steady improvements, reliable real-world performance remains a challenge due to complexities such as noise, occlusions, and diversity in posture. Addressing these issues requires not only accurate pose estimation but also effective uncertainty quantification to ensure robustness and interpretability in practical scenarios. Uncertainty Quantification (UQ) is particularly significant in dynamic and unpredictable environments, such as safety-critical applications. Beyond predicting joint coordinates, understanding the uncertainty of the model in its outputs enables error identification, adaptation to abnormal input, and informed decisions on the need for human intervention. However, existing methods often fail to sufficiently address uncertainty estimation. Two dominant approaches in HPE are regression-based and heatmap-based methods. Regression-based methods [ 13 , 29 , 21 , 27 ] directly predict joint coordinates by minimizing loss functions such as \ell_{1} loss (Laplace assumption) or \ell_{2} (Gaussian assumption). Although computationally efficient, these models are based on fixed distributional assumptions [ 18 ] , which can lead to suboptimal performance and unreliable uncertainty estimates. For instance, heteroscedastic regression based on Laplace distributions has shown better results compared to Gaussian-based models [ 13 ] , indicating that real-world joint locations often deviate from Gaussian assumptions. Heatmap-based methods [ 28 , 24 , 8 , 22 , 19 ] , on the other hand, frame keypoint detection as a classification problem by generating likelihood heatmaps for each keypoint. Although these approaches, such as HRNet [ 24 ] and SimplePose [ 28 ] , achieve high accuracy, they come with significant computational and memory requirements. To address these limitations, we propose a novel approach that combines the strengths of regression-based methods with Continuous Normalizing Flows (CNFs) [ 3 ] shown in Figure 1 . Figure 1 : Overview of our proposed method. Heteroscedastic Deep Regression (Blue box) estimates the mean and scale of keypoint locations, which can be described as a simple distribution (e.g., Gaussian or Laplacian). Our CNF then transforms this into a more complex uncertainty distribution. A CNF uses neural ordinary differential equations to learn complex data distributions without fixed assumptions, using continuous-time transformations. The resulting framework, Continuous Flow Residual Estimation (CFRE), integrates a prior regression network with CNFs to estimate joint locations and associated uncertainties. During training, the regression network assumes a Laplace distribution, while CNFs dynamically refine the predictions to better align with real-world data. Importantly, the framework incurs no additional computational costs during inference, making it both practical and efficient. We validate our method on 2D and 3D HPE tasks using MSCOCO [ 15 ] and Human3.6M [ 10 ] , achieving superior performance over traditional regression and heatmap-based models while ensuring calibrated confidence. Qualitative results indicate that the model captures more complex patterns, including anisotropy and sharper peaks than Gaussian distributions. Experimental results on mAP and AUSE metrics demonstrate that improved data distribution fitting also enhances uncertainty quantification. Our contributions include: • Revealing misalignment: We show that the misalignment between the distribution assumption in regression models and data distribution leads to less accurate estimates and uncalibrated confidence. • Proposing a Novel Method (CFRE): We introduce CNFs into Human Pose Estimation, and to improve the efficiency of model training, we propose a training regime that decouples the CNFs and the regression network. CNFs dynamically adjust regression parameters during training without adding extra computation during inference. Empirically, our training regime significantly outperforms explicit NLL-based training. 2 Related Work 2.1 Heatmap-based Methods Heatmap-based approaches were proposed by Tompson et al. [ 26 ] , which utilize likelihood heatmaps to estimate joint locations. Recently, heatmap-based methods [ 28 , 24 , 8 , 22 , 19 ] have dominated due to their ability to model spatial relationships effectively. Sun et al. [ 24 ] achieved competitive performance by maintaining the high resolution of image features during forward propagation in CNNs. However, these methods suffer from high computational and storage demands, making them unsuitable for scenarios requiring efficiency, such as edge-device deployments. 2.2 Regression-based Methods Unlike heatmap-based methods, regression-based approaches [ 29 , 21 , 27 ] prioritize computational efficiency but often lag behind in performance. To estimate the confidence of model predictions, regression-based methods commonly employ heteroscedastic regression [ 11 ] , which models per-sample variance. However, this approach typically assumes a specific distribution, and deviations from the true data distribution can result in suboptimal performance. Recently, Li et al. [ 13 ] proposed leveraging normalizing flows (NFs) to model data distributions without relying on specific assumptions. However, the discrete-time transformations in normalizing flows may limit their ability to accurately capture complex data distributions. We adopt continuous normalizing flows, which learn such distributions through continuous-time transformations and have demonstrated superior performance in high-dimensional data generation tasks. 3 Method In this section, we introduce a novel regression-based framework that integrates CNFs into human pose estimation. This approach addresses the limitations of fixed distributional assumptions by allowing the model to dynamically learn complex data distributions. Additionally, a specialized loss function is designed to enhance both accuracy and uncertainty quantification. 3.1 Regression Paradigm The proposed model employs a top-down 2D human pose estimation approach. For a given image \mathcal{I} , the model predicts the coordinates of K joints \hat{\mathbf{p}}\in\mathbb{R}^{K\times 2} and their corresponding joint-wise confidence scores \hat{s}\in[0,1]^{K} . These joint-wise confidence scores are averaged into an instance-wise confidence score \hat{c}\in[0,1] , which represents the overall reliability of the model’s predictions. The regression paradigm estimates the deterministic coordinates of joints and corresponding scale by modeling the joint distribution P_{\beta}(x|\mathcal{I}) as a probabilistic distribution parameterized by the mean \hat{\mu} and standard deviation \hat{\sigma} using heteroscedastic Deep Regression [ 11 ] . Here, \beta denotes the learnable parameters of the regression model. The distribution is typically assumed to be Gaussian or Laplacian, with the regression model estimating \hat{\mu} and \hat{\sigma} for each joint given an input image \mathcal{I} . We follow the previous work [ 7 ] to normalize \hat{\sigma} to the range [0,1] . To optimize the regression model, the negative log-likelihood (NLL) of the ground truth joint locations \mu_{g} is minimized as follows: \mathcal{L}_{\text{reg}}=-\log P_{\beta}(x|\mathcal{I})\Big|_{x=\mu_{g}}. (1) From the distribution parameters, the predicted joint locations \hat{\mathbf{p}} and confidence scores \hat{s}_{k} for each joint are obtained as: \hat{\mathbf{p}}=\hat{\mu},\quad\hat{s}_{k}=1-\hat{\sigma}. (2) However, the fixed assumptions about the joint distributions in traditional