Lipschitz Optimization for Formal Verification of Homographies

Jean-Guillaume Durand, Panagiotis Kouvaros, Maxime Gariel, Alessio Lomuscio · 2026

Read Lipschitz Optimization for Formal Verification of Homographies by Jean-Guillaume Durand, Panagiotis Kouvaros, Maxime Gariel, Alessio Lomuscio (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23203.txt.

Introduction

Durand and three coauthors verify vision networks against 3D camera motion, a key gap for safety-critical domains. Current methods cover only statistical checks or norm and affine robustness, missing camera motion. They map camera pose to pixel values, then extend Lipschitz optimization to derive tight linear bounds on perturbed pixels, enabling the first formal verification of projective transforms. It applies to planar scenes. Tests show 89 percent speedup and 7 percent tighter bounds. A runway case study reveals weaknesses to projective perturbations.

Catalog record

CREATORJean-Guillaume Durand, Panagiotis Kouvaros, Maxime Gariel, Alessio Lomuscio
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66983
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23203

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lipschitz Optimization for Formal Verification of Homographies Jean-Guillaume Durand, Panagiotis Kouvaros, Maxime Gariel, Alessio Lomuscio Abstract The adoption of vision neural networks in regulated industries requires formal robustness guarantees, especially in safety-critical domains such as healthcare, autonomous vehicles, and aerospace. However, current approaches are confined to incomplete statistical verification or robustness to ℓ p \ell_{p} -norm and affine transforms, which cover only a narrow subset of perturbations to the image formation process. In particular, robustness to camera motion remains an open problem despite being key to deploy many vision applications. We present a formal verification approach that targets robustness against 3D motion perturbations of the capturing camera. We first establish a closed-form mapping from camera pose to pixel values. By analyzing the continuity properties of the resulting homographies, we show that recent work on Lipschitz optimization and piecewise continuity can be extended to derive tight linear bounds on perturbed pixel values. Our approach applies to scenes with predominantly planar structure, such as ground planes in augmented reality, road markings and traffic signs in autonomous driving, or planar workspaces in robotic manipulation. This enables the first formal verification of projective geometry transforms, without complex simulation, surrogate networks, or explicit image-formation models. We validate our implementation and show up to 89% speedup and 7% tighter bounds over prior work. We then evaluate our method on the VNN-COMP benchmark and reveal systematic weaknesses to projective perturbations. Finally, we demonstrate a real-world case study on a safety-critical runway classifier, highlighting practical vulnerabilities to camera motion, and addressing a key challenge in the certification of learned models. Data and code are publicly available at https://github.com/jeangud/homography-verification . Figure 1 : Example application: autonomous driving. The scene geometry defines the coordinate transform \bm{T}_{C}^{R}\in\mathrm{SE}(3) from road frame (R) to camera frame (C) . Assuming a planar traffic sign and a pinhole camera model, the stop sign features (blue points) are projected from the 3D world to the 2D image plane through projective geometry. Such a plane-to-plane mapping is a homography. We then study the robustness of traffic sign recognition to uncertainty or perturbations on the camera pose and stop sign localization (magenta ellipsoids). The formal verification of such homographies can support the certification of safety-critical applications in robotics. 1 Introduction The deployment of deep neural networks in safety-critical computer vision systems is rapidly accelerating across diverse applications, from augmented reality and medical imaging, to autonomous vehicles and aerospace ( Fig. 1 ). Deep learning has proven a key enabler, significantly improving system performance and generalization 32 ; 5 ; 14 . However, these models exhibit instabilities and non-linear behaviors 45 ; 19 , complicating robustness analysis and ultimately their regulatory compliance. Notwithstanding, for these systems to be trusted and certified in regulated domains, they require formal guarantees demonstrated under foreseeable operational scenarios 50 . Such robustness evidence is often produced by formal methods, which provide strong mathematical guarantees on system outputs. To date, formal verification for neural networks (VNN) has largely focused on robustness against \ell_{p} -bounded perturbations 9 ; 33 , which act directly on the pixel space (e.g. contrast, color). This approach may not model some scenarios where perturbations originate in the physical space of the scene (e.g. viewpoint, shadows), before impacting image formation. While a sufficiently large \ell_{p} -ball might contain the resulting images, it fails to capture the essential constraints defining the transformation. This approach also over-approximates the true manifold of perturbed images ( Fig. 2 ), leading to uninformative loose bounds that are insufficient to prove network robustness 16 ; 37 . Figure 2 : The space of image perturbations (notional). Most vectors in [0,1]^{h\times w} are noise (a). The subset of natural images forms a complex manifold of lower dimension (grey surface), on which lies our original image \bm{x_{0}} . The ball B_{p}(\bm{x_{0}},\varepsilon) of \ell_{p} -norm perturbations (blue) can capture noise (b), hue (c) and brightness (d) variations for example. Beyond B_{p}(\bm{x_{0}},\varepsilon) and along constrained walks on the manifold, we may follow affine 2D perturbations (green) such as translation or rotation (e). We also encounter 3D perturbations (red): the same scene captured from a different perspective (f). Further on the manifold, lie more complex semantic perturbations like lens flare or snow (g). More natural images (e.g. different signs, cats) form other subsets of this manifold. Consequently, verifying robotics applications requires handling a comprehensive range of perturbations within the Operational Design Domain (ODD), including 3D scene transformations. In this context, homographies emerge as a crucial class of transforms that capture perspective changes: they describe the inherent projective mapping between two different views of a planar surface 21 . This plane-to-plane mapping is ubiquitous in computer vision and is central to a vast array of use cases. For instance, augmented reality applications track ground planes for placing virtual objects. Autonomous cars identify planar objects like traffic signs, billboards, and road markings from various distances and angles. Similarly, tasks like image stitching, robotic manipulation, and visual servoing often depend on estimating homographies between views. Existing research on 3D robustness is confined to either: statistical methods, which provide weaker guarantees than formal verification 39 ; formal methods for 2D affine transforms 7 ; 43 , which cannot model perspective effects; or complex simulations and explicit 3D scene models 25 . To bridge this gap, we position homographies as a principled and analytically tractable middle ground for predominantly planar scenes (i.e. limited parallax and occlusion). We propose the following contributions: 1. Formal verification of projective transforms: we derive closed-form homographies induced by 6 DOF pose perturbations. We show that these parameterized homographies are compatible with recent verification work using piecewise-linear constraints and Lipschitz optimization. By extending these techniques, we derive provably tight bounds on pixel values under non-affine transforms. 2. Implementation and integration with existing verifiers: we propose an efficient implementation of our method, introducing several accuracy and run time improvements to the PWL algorithm 7 . We also adapt the Venus verifier to handle piecewise linear bounds. We profile and validate our implementation against PWL, demonstrating faster run times and tighter bounds. 3. Benchmarking and case study: on VNN-COMP benchmarks, we reveal systematic weaknesses of some networks to 3D camera-motion perturbations. We also instantiate our method on a runway visibility classifier, illustrating how homography-based verification can reveal practical vulnerabilities in safety-critical perception, and address key regulatory certification challenges. (a) Transformed image (b) Original image (c) Pixel values Figure 3 : Pixel values under perspective transform. As original image \bm{x_{0}} 3(b) undergoes a yaw angle perturbation \bm{\kappa}\in\mathcal{B}=[0\degree,10\degree] , we look at the values G^{\bm{x_{0}}}_{34,47}(\bm{\kappa}) of pixel \bm{p}=(34,47) , the red square in transformed image 3(a) . Transform T is a homography and, as non-affine, is able to represent a change of perspective of the traffic sign. Applying the inverse transform, we find the corresponding position T^{-1}(\bm{\kappa})=(34.4,53.5) in the original image, the red cross in 3(a) and 3(b) . We then compute the transformed pixel value with bilinear interpolation (zoomed region in 3(b) ). As the yaw angle \bm{\kappa} varies, pixel \bm{p} follows a non-linear behavior in position (magenta path in 3(b) ), and in values 3(c) : transitioning from black (low values), to white (high values), to gray. Black padding is used to highlight the transform, but

Read the complete text