Robust Differentiable Collision Detection for General Objects

Jiayi Chen, Wei Zhao, Liangwang Ruan, Baoquan Chen, He Wang · 2025

Read Robust Differentiable Collision Detection for General Objects by Jiayi Chen, Wei Zhao, Liangwang Ruan, Baoquan Chen, He Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06267.txt.

Introduction

Jiayi Chen and co-authors make collision detection usable inside gradient-based robot planning. Classic algorithms find the closest or deepest contact points between two objects, but their answers cannot be differentiated, blocking the gradient flow that optimization needs. Recent smoothing tricks worked only for convex shapes and broke down on complex geometry.

Their framework smooths distances rather than directions and adds adaptive sampling plus a way to transport gradients reliably. It handles both convex and concave objects at varied scales and arrangements. On complex meshes from two large datasets it beat existing baselines clearly, and the team applied it to refine the quality of dexterous robot grasps.

Catalog record

CREATORJiayi Chen, Wei Zhao, Liangwang Ruan, Baoquan Chen, He Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06267

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust Differentiable Collision Detection for General Objects Jiayi Chen, Wei Zhao, Liangwang Ruan, Baoquan Chen, He Wang Abstract Collision detection is a core component of robotics applications such as simulation, control, and planning. Traditional algorithms like GJK+EPA compute witness points —the closest or deepest-penetration pairs between two objects—but are inherently non-differentiable, preventing gradient flow and limiting gradient-based optimization in contact-rich tasks such as grasping and manipulation. Recent work introduced efficient first-order randomized smoothing to make witness points differentiable; however, their direction-based formulation is restricted to convex objects and lacks robustness for complex geometries. In this work, we propose a robust and efficient differentiable collision detection framework that supports both convex and concave objects across diverse scales and configurations. Our method introduces distance-based first-order randomized smoothing, adaptive sampling, and equivalent gradient transport for robust and informative gradient computation. Experiments on complex meshes from DexGraspNet and Objaverse show significant improvements over existing baselines. Finally, we demonstrate a direct application of our method for dexterous grasp synthesis to refine the grasp quality. The code is available at https://github.com/JYChen18/DiffCollision . I Introduction Collision detection is a long-standing and fundamental problem in robotics and computer graphics, with applications ranging from simulation and control to planning and learning. A key outcome of collision detection is the witness points [ 11 ] —the closest points when objects are separated or the deepest penetration points when they overlap. These points specify where and how objects interact: they directly indicate contact positions and allow computation of contact distance and direction, making them a cornerstone of contact modeling [ 1 , 17 ] . Despite their importance, traditional collision detection algorithms such as GJK [ 13 , 22 ] , EPA [ 34 ] , and MPR [ 28 ] are non-differentiable, preventing gradients from propagating through witness points. This lack of differentiability is one possible reason limiting the potential of gradient-based optimization in contact-rich tasks such as grasping and manipulation. As a result, robotics has often relied on gradient-free approaches such as reinforcement learning [ 27 , 5 ] and sampling-based planners [ 15 ] , in contrast to the success of gradient-based methods in deep learning. Recent work has begun improving the differentiability of contact modeling [ 18 , 25 , 16 ] , but mainly focuses on improving the contact solvers and smoothing the magnitude of contact forces with respect to inter-object distance, known as force-at-a-distance . In contrast, the differentiability of witness points themselves has received little attention. This omission is critical: without gradients through witness points, it is difficult to enforce desired contact positions or adjust force directions on complex shapes such as concave regions (Figure 2 ). To bridge this gap, Montaut et al. [ 23 ] introduced efficient first-order randomized smoothing approaches to make witness point differentiable. However, their direction-based method is limited to convex objects and has only been extensively tested on simple meshes (as few as 12 vertices), falling short of the demands of real robotic applications. Fig. 1 : Task illustration. To verify our derivative of witness points (in red) with respect to the object poses, we optimize the 6D pose of one object (in orange) so that the specified target points (in green) coincide with the witness points. Fig. 2 : Motivation. When optimizing the pose T_{2} of object O_{2} , treating the witness points \mathbf{x}_{1},\mathbf{x}_{2} as fixed on objects O_{1} and O_{2} without considering their derivatives cannot handle at least two cases: (1) enforcing a specified point \mathbf{t}_{2} to be in contact (i.e., become a witness point); (2) enforcing object O_{2} to produce a target contact force \mathbf{f}_{\text{target}} on a concave object O_{1} , where ignoring \partial\mathbf{x}_{1}/\partial T_{2} actually assumes that \mathbf{x}_{1} is fixed. In this situation, to generate a leftward contact force, one would move \mathbf{x}_{2} rightward, which is incorrect. By contrast, our method accounts for \partial\mathbf{x}_{1}/\partial T_{2} , recognizing that when \mathbf{x}_{2} moves rightward, \mathbf{x}_{1} also shifts rightward even more. Thus, the correct update is to move O_{2} leftward. In this work, we propose a general approach to calculate the derivative of witness points that applies to both convex and concave objects. As shown in Figure 1 , our method is robust to object scale, handles both penetrating and non-penetrating configurations, and scales to complex shapes such as those in DexGraspNet [ 35 ] and Objaverse [ 9 ] . Our method belongs to the family of first-order randomized smoothing but introduces three key innovations. First, instead of relying on direction–based smoothing derived from GJK optimality conditions [ 23 ] , we propose distance–based smoothing , which generalizes naturally beyond convex shapes. Second, rather than approximating local geometry from neighboring vertices—which is mesh-sensitive and not parallel-friendly—we propose an adaptive sampling strategy, yielding greater robustness. Third, we introduce equivalent gradient transport , which improves gradient quality when only one object’s pose is optimized, a scenario frequently encountered in grasping and manipulation. Experiments on both convex and concave objects demonstrate significant improvements over existing baselines. On complex meshes from DexGraspNet and Objaverse, our method achieves a median error below 0.1 mm across 400 random object pairs with 1024 tasks each. At mm-level accuracy, we outperform baselines by more than 40\% . Our approach is also memory- and time-efficient, and easily parallelizable on GPUs. Finally, we demonstrate a direct application to dexterous grasp refinement, achieving improved grasp quality. In summary, our contributions are: • An open-source, robust, and efficient differentiable collision detection framework for both convex and concave objects, built upon distance-based smoothing with adaptive sampling and equivalent gradient transport; • Competitive empirical performance on large-scale object datasets, demonstrating the robustness of our method to object shapes, scales and configurations; • A preliminary application to dexterous grasp refinement. II Related Work II-A Discrete Collision Detection for Meshes A major class of collision detection algorithms leverages the Minkowski sum to reduce collision detection to an origin-in-polytope test. These methods are highly efficient and widely used in rigid-body simulators such as MuJoCo [ 32 ] and PyBullet [ 6 ] . Representative algorithms include the Gilbert-Johnson-Keerthi (GJK) algorithm [ 13 , 22 ] , which iteratively searches for the closest point to the origin in the Minkowski difference; the Expanding Polytope Algorithm (EPA) [ 34 ] , which refines the GJK result to compute penetration depth and witness points; and the Minkowski Portal Refinement (MPR) algorithm [ 28 ] , which combines elements of both for practical efficiency. These methods assume convex meshes, and concave objects typically require convex decomposition [ 20 , 36 ] . Another line of work relies on exact triangle intersection tests, which check for intersections between mesh triangles. While computationally more expensive, these methods are naturally parallelizable on GPUs. A common variant is the Separating Axis Test (SAT) [ 14 ] , again limited to convex shapes. More general methods explicitly check vertex–face and edge–edge pairs, allowing them to handle concave or deformable objects. However, they cannot identify deepest penetration points and typically require penetration-free configurations at each timestep [ 18 ] , making them less common in robotics applications. All of the above methods are non-differentiable, except for vertex–face and edge–edge tests, which provide highly limited and local gradients. In contrast, our method computes derivatives

Read the complete text