Convex Hull-based Algebraic Constraint for Visual Quadric SLAM

Xiaolong Yu, Junqiao Zhao, Shuangfu Song, Zhongyang Zhu, Zihan Yuan, Chen Ye, Tiantian Feng · 2025

Read Convex Hull-based Algebraic Constraint for Visual Quadric SLAM by Xiaolong Yu, Junqiao Zhao, Shuangfu Song, Zhongyang Zhu, Zihan Yuan, Chen Ye, Tiantian Feng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01254.txt.

Introduction

Xiaolong Yu and co-authors add a convex hull rule to quadric-based visual SLAM, the mapping method that lets a moving camera place itself. Quadrics stand in for objects because they are general and project cleanly between world and image. Many past rules for rebuilding them, the team found, were loose and barely helped.

Their 2025 paper roots the new rule in the object's convex hull, the tightest wrap around its shape. The rule serves object rebuilding, front-end pose tracking, and back-end bundle polishing at once. It draws full value from sharp semantic masks and cuts the mismatch between tangled outlines and smooth quadrics. Tests on public sets beat prior quadric methods for both mapping and tracking.

Catalog record

CREATORXiaolong Yu, Junqiao Zhao, Shuangfu Song, Zhongyang Zhu, Zihan Yuan, Chen Ye, Tiantian Feng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-01254

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Convex Hull-based Algebraic Constraint for Visual Quadric SLAM Xiaolong Yu, Junqiao Zhao, Shuangfu Song, Zhongyang Zhu, Zihan Yuan, Chen Ye, Tiantian Feng Abstract Using Quadrics as the object representation has the benefits of both generality and closed-form projection derivation between image and world spaces. Although numerous constraints have been proposed for dual quadric reconstruction, we found that many of them are imprecise and provide minimal improvements to localization. After scrutinizing the existing constraints, we introduce a concise yet more precise convex hull-based algebraic constraint for object landmarks, which is applied to object reconstruction, frontend pose estimation, and backend bundle adjustment. This constraint is designed to fully leverage precise semantic segmentation, effectively mitigating mismatches between complex-shaped object contours and dual quadrics. Experiments on public datasets demonstrate that our approach is applicable to both monocular and RGB-D SLAM and achieves improved object mapping and localization than existing quadric SLAM methods. The implementation of our method is available at https://github.com/tiev-tongji/convexhull-based-algebraic-constraint. I Introduction In recent years, with the rapid development of object detection and semantic segmentation, many object-based SLAM systems have been proposed [ 1 , 2 , 3 , 4 , 5 ] . By mapping and localizing high-level object landmarks, the robustness of the SLAM system is improved because the image feature points are susceptible to environmental degradation or variations such as textureless regions and illumination changes. Additionally, object-based mapping enhances scene understanding and human-computer interaction capabilities. QuadricSLAM [ 1 ] first proposes using dual quadric as the object representation in visual SLAM due to its generality and rigorous projection properties between the image and world spaces [ 6 ] . Subsequently, various constraints have been proposed for the reconstruction of dual quadrics, including the bounding box (bbox)-derived constraints [ 1 , 7 , 8 , 9 , 10 ] , conic-derived constraint [ 4 ] and contour-derived constraints [ 5 ] . However, we found that most existing quadric SLAM methods focus on accurate semantic object reconstruction but fail to leverage these objects to improve localization. The reason is that existing constraints between dual quadrics and observations are insufficiently precise to improve pose estimation. Fig. 1: The Proposed Convex Hull-based Algebraic Constraint between Dual Quadric and Camera Pose. To address these issues, we evaluate existing constraints for quadric SLAM, and propose a convex hull-based algebraic constraint that fully leverages precise instance segmentation, as illustrated in Fig. 1 . This approach refines rough bbox or conic-based object observation and mitigates mismatches between complex-shaped object contours and their corresponding dual quadrics, thereby enhancing multi-view consistency. To effectively apply the proposed constraint for camera localization, we integrate it into both frontend pose estimation and backend Bundle Adjustment (BA) within a quadric SLAM system. Experimental results demonstrate that our proposed method significantly improves both localization accuracy and object mapping performance in monocular and RGB-D visual SLAM systems, outperforming existing quadric-based methods across multiple sequences. The main contributions of this work are as follows: • A convex hull-based algebraic constraint is proposed to fully leverage accurate segmentation contours and mitigate the mismatches between complex-shaped objects and their dual quadrics. • A monocular/RGB-D quadric SLAM system is constructed which integrates the proposed constraint in object reconstruction, frontend pose estimation, and BA. • Comprehensive experimental results prove our findings and demonstrate that our system outperforms state-of-the-art (SOTA) methods on public datasets. II Related Works Object-based SLAM incorporates semantic objects as landmarks, enhancing the robustness and accuracy of the SLAM system while also providing precise semantic object maps for high-level tasks like object-based localization [ 11 , 12 , 13 ] and object grasping [ 14 , 15 ] . DSP-SLAM [ 16 ] adopts DeepSDF [ 17 ] as a shape embedding, combining sparse 3D points and deep shape priors to achieve dense reconstruction of semantic objects. However, its reliance on prior shape information significantly limits its generality in reconstructing diverse objects. In contrast, CubeSLAM [ 2 ] utilizes cuboids inferred from 2D bounding boxes as object representations, achieving real-time 3D object detection and SLAM in both static and dynamic environments. QuadricSLAM [ 1 ] uses dual quadrics to represent objects, reconstructing them from multiple views to obtain information about size, position, and orientation. Compared to cuboids, dual quadrics offer a closed-form correspondence between their projections in 2D images and the original 3D objects, providing better constraints for general objects. In quadric-based SLAM, existing constraints are primarily derived from bbox [ 1 , 7 , 8 , 9 , 18 , 10 ] and conics [ 5 , 19 , 20 , 21 ] . The bbox-derived constraints calculate the coordinate distance or Intersection-Over-Union (IoU) between observed bounding boxes and those projected from dual quadrics. In contrast, conic-derived constraints utilize more precise conics to describe objects in the 2D image space more accurately. Recently, QISO-SLAM [ 5 ] introduced precise segmentation contours to minimize the algebraic error [ 22 , 23 ] between contours and reprojected conics, incorporating an outlier filtering strategy to enhance accuracy. III Preliminary In standard form, a quadric surface Q in projective space is defined by the equation: p^{T}Qp=0 (1) where Q is a symmetric 4\times 4 matrix, and p is a point represented in 4-dimensional homogeneous coordinates. The projection of the quadric Q onto the image plane is expressed as: C=HQH^{T} (2) where C represents the 3\times 3 conic matrix, H=K[R|t] is the 3\times 4 camera projection matrix composed of intrinsic matrix K and extrinsic parameters [R|t] . In its dual form, a dual quadric Q^{*} is defined by its tangent planes \pi as: \pi^{T}Q^{*}\pi=0 (3) where \pi is a 4-dimensional homogeneous vector representing a plane in 3D place. Q^{*} can represent both closed surfaces, such as ellipsoids, and non-closed surfaces, like hyperboloids [ 6 ] . However, since closed surfaces are suitable for object landmark representation, we use the constrained quadric to ensure that the surface is an ellipsoid. Following the approach in [ 21 ] , the constrained dual quadric can be parameterized as follows: Q^{*}=Z\breve{Q^{*}}Z^{T} (4) where \breve{Q^{*}} represents an ellipsoid centered at the origin, Z is a transformation matrix in homogeneous coordinates, accounting for an arbitrary rotation and translation. Specifically, Z and \breve{Q^{*}} are defined as: Z=\begin{pmatrix}R(\theta)&t\\ 0_{3}^{\top}&1\end{pmatrix}\quad\text{and}\quad\check{Q^{*}}=\begin{pmatrix}s_{1}^{2}&0&0&0\\ 0&s_{2}^{2}&0&0\\ 0&0&s_{3}^{2}&0\\ 0&0&0&-1\end{pmatrix} (5) where t=(t_{1},t_{2},t_{3}) represents the translation vector of the ellipsoid centroid, R(\theta) is a rotation matrix defined by the angles \theta=(\theta_{1},\theta_{2},\theta_{3}) , and s=(s_{1},s_{2},s_{3}) represents the lengths of three semi-axes of the ellipsoid. IV Convex Hull-based Algebraic Constraint IV-A Existing Constraints for Quadric-based SLAM In Quadric SLAM, constraints for a quadric or dual quadric are dervied from various constraint primitives based on object detection and segmentation results. Common primitives include bbox, conic, and segmentation contour. IV-A 1 Bbox-dervied constraint Bbox is the most commonly used primitive due to its simplicity and alignment with 2D object detectors [ 1 ] . Constraints for bbox primitives are typically based on an overlap-based error term, which maximizes the overlapped area between the projected C and the observed bounding box b : \mathcal{L}_{o}=-\zeta(C,b) (6) where \zeta is a function that quantifies the overlapping area. Commom implementations of \zeta include IoU [ 8 ] or pixel coordinate distance [ 1 ] . However, bbox only roughly approximates the object and the overlap-based error

Read the complete text