Less Biased Noise Scale Estimation for Threshold-Robust RANSAC
Johan Edstedt · 2025
Read Less Biased Noise Scale Estimation for Threshold-Robust RANSAC by Johan Edstedt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13433.txt.
Introduction
Johan Edstedt writes a computer vision paper from 2025 on a key setting inside the RANSAC method. RANSAC fits models to image matches while ignoring bad matches, but a user must set the error threshold that counts a match as good. That threshold is hard to tune by hand without ground truth, so estimating the noise scale of good matches is an attractive shortcut.
Edstedt revisits a known estimator and finds a bias that shrinks its answers. Two fixes follow: stop reusing the same data for fitting and scaling, and account for the threshold itself. A multi-pair version pools estimates across image pairs and filters them, giving robust results across thresholds.
Catalog record
| CREATOR | Johan Edstedt |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-13433
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Less Biased Noise Scale Estimation for Threshold-Robust RANSAC Johan Edstedt Abstract The gold-standard for robustly estimating relative pose through image matching is RANSAC. While RANSAC is powerful, it requires setting the inlier threshold that determines whether the error of a correspondence under an estimated model is sufficiently small to be included in its consensus set. Setting this threshold is typically done by hand, and is difficult to tune without a access to ground truth data. Thus, a method capable of automatically determining the optimal threshold would be desirable. In this paper we revisit inlier noise scale estimation, which is an attractive approach as the inlier noise scale is linear to the optimal threshold. We revisit the noise scale estimation method SIMFIT and find bias in the estimate of the noise scale. In particular, we fix underestimates from using the same data for fitting the model as estimating the inlier noise, and from not taking the threshold itself into account. Secondly, since the optimal threshold within a scene is approximately constant we propose a multi-pair extension of SIMFIT++, by filtering of estimates, which improves results. Our approach yields robust performance across a range of thresholds, shown in Figure 1 . Code is available at https://github.com/Parskatt/simfitpp . Figure 1 : Fundamental matrix estimation performance as a function of RANSAC threshold (higher is better). Traditionally, following an initial guess, RANSAC thresholds are not updated during optimization. In practice, this means that the threshold will be suboptimal, as different images and models require different thresholds. We overcome this issue by alternating between estimating the noise scale \sigma and RANSAC, and using that \tau=F^{-1}(\alpha)\sigma for the confidence level \alpha\in[0,1] , which we fix as \alpha=0.99 . 1 Introduction Robust estimation using RANSAC Fischler and Bolles 1981 requires the user to set a threshold \tau , which is used to determine whether a data point should be considered as an inlier to an estimated model or not. This is in general a difficult problem, partially due to the fact that the optimal threshold can vary significantly between different datasets and models, and is difficult to know without access ground-truth data as is the case in the image matching challenge ( Jin et al. 2020 ) (and also in the real world). One could therefore wonder whether estimation of the optimal threshold \tau^{*} could be baked into RANSAC, removing the inconvenience of having to a priori know it. This is not an entirely novel thought, in fact, there are several approaches that are entirely threshold-free. StarSac ( Choi and Medioni 2009 ) performs a grid search over thresholds to find the threshold with lowest model variance, from the insight that a correct threshold produces stable solutions. However, this is extremely expensive in practice, and the optimal threshold is not guaranteed to align with the lowest model variance. In RECON ( Raguram and Frahm 2011 ) the problem is reformulated as finding consistency in residual rankings between models, which is independent of the noise level. ORSA ( Moisan and Stival 2004 ; Moisan et al. 2012 ) , finds meaningful events ( Desolneux et al. 2000 ) by finding sets of correspondences such that the expectation of their occurrences are as small as possible, which is similarly done in MINPRAN ( Stewart 1995 ) , although for probability rather than expectation. Another of work was developed in ASSC ( Wang and Suter 2004 ) whereby the RANSAC objective is divided by a robust estimate of the scale. This objective is however not well-motivated statistically. ASKC ( Wang et al. 2009 ) uses a more well-motivated objective, but still faces challenges with estimating scale from the full contaminated set of correspondences. In general, these approaches aim to replace RANSAC. While interesting, in this work we do not wish to get rid of RANSAC, instead we aim to augment it with inlier threshold robustness. Besides this reason, these approaches have already been shown to under-perform compared to threshold-robust RANSAC approaches on relative pose estimation ( Heinrich 2013 ; Torr and Murray 1997 ; Raguram and Frahm 2011 ) . Making RANSAC robust to the inlier threshold has also been explored. MAGSAC and MAGSAC++ ( Barath et al. 2019 ; Barath et al. 2020 ) marginalize over noise scales, in order to avoid setting a specific threshold. Unfortunately, they still need to set an upper threshold, and the choice of this threshold affects results, as we will later show in Figure 10 (our method will be shown to help theirs). Hedborg and Felsberg 2013 estimate the noise level using the forward-backward tracking error, although the algorithm used is not specified. Closest to our work is SIMFIT ( Heinrich 2013 ) which alternates between estimating the inlier noise scale \sigma and running MSAC ( Torr and Zisserman 2000 ) using a threshold computed using \sigma . This approach forms the basis of our work. Note that, while we compare ours mainly to SIMFIT, SIMFIT has already been shown to yield SotA results ( Heinrich 2013 ) . Although SIMFIT produces good results, we find that their estimate is biased, due to estimating the variance on the fitting set, and also due to not taking the inlier threshold into account. We propose two fixes to this problem. First, we perform a train/validation split for the estimation of the geometric model and the inlier noise scale. Secondly, we propose an adjustment to the noise scale estimator which works also for thresholded distributions. We call this algorithm SIMFIT++. Finally, we propose a multi-pair extension of SIMFIT++ by filtering estimates over larger image-sets. This multi-pair extension further improves results, particularly when the initial threshold provided is far from optimal. Our main contributions are: a) We propose an empirically well-motivated estimator of the noise scale \sigma^{*} , by identifying two sources of bias in previous approaches, and integrate it into a RANSAC framework. This is described in Section 2.3 . b) We extend the estimator to a multi-pair setting in Section 2.4 . c) We conduct large-scale evaluations and ablations, which show that our approach works well in practice in Section 3 . 2 Method We present SIMFIT++ in Algorithm 2 . In this paper we focus only on relative pose estimation, but the algorithm can be easily generalized, as done in SIMFIT, to cover other types of geometric estimation problems. Our algorithm is similar to SIMFIT, but differs in some key areas. In the next sections we go into more details of our proposed method. 2.1 Modeling the empirical distribution of inliers A classic assumption in multi-view computer vision is that the detection error is Normally distributed, and by propagation find that the squared residuals (when estimating relative pose) ought to be \chi_{k}^{2} distributed, where k depends on the dimensionality of the model/residuals. Typically the assumption is that k=1 . Next, we briefly recap when this is true. When are the squared residuals theoretically \chi_{1}^{2} ? Assuming that our detections \mathbf{x}_{A},\mathbf{x}_{B}\in\mathbb{R}^{2} are affected by independent Normally distributed noise, \mathbf{x}_{A}=\mathbf{x}_{A}^{*}+\mathbf{\varepsilon}_{A},\mathbf{x}_{B}=\mathbf{x}_{B}^{*}+\mathbf{\varepsilon}_{B},\varepsilon\sim\mathcal{N}(0,\sigma^{2}\mathbf{I}) (1) where \mathbf{x}_{A}^{*}=\pi(\mathbf{x}^{*}),\mathbf{x}_{B}^{*}=\pi(\mathbf{R}\mathbf{x}^{*}+\mathbf{t}),\pi:\mathbb{R}^{3}\to\mathbb{R}^{2} . Of course, if \mathbf{x}^{*} was known, the sum of squared residuals would be distributed as \left\lVert\mathbf{x}_{A}-\mathbf{x}_{A}^{*}\right\rVert^{2}+\left\lVert\mathbf{x}_{B}-\mathbf{x}_{B}^{*}\right\rVert^{2}\sim\chi^{2}_{4}. (2) However, since \mathbf{x}^{*} is unknown, we try to find the most likely \mathbf{x} , through \displaystyle\min_{\hat{\mathbf{x}}_{A},\hat{\mathbf{x}}_{B}}\left\lVert\mathbf{x}_{A}-\hat{\mathbf{x}}_{A}\right\rVert^{2}+\left\lVert\mathbf{x}_{B}-\hat{\mathbf{x}}_{B}\right\rVert^{2}