A Generalised Framework for Property-Driven Machine Learning
Thomas Flinkow, Marco Casadio, Colin Kessler, Rosemary Monahan, Ekaterina Komendantskaya · 2025
Read A Generalised Framework for Property-Driven Machine Learning by Thomas Flinkow, Marco Casadio, Colin Kessler, Rosemary Monahan, Ekaterina Komendantskaya (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00466.txt.
Introduction
Thomas Flinkow and colleagues unify two ways of teaching neural networks to respect stated properties, not just fit data. Networks routinely fail safety and correctness rules when left to examples alone. One camp hardens them with adversarial training inside small boxes around inputs; another adds differentiable logic terms to the loss so rule violations cost the model during training. Writing in twenty twenty-five, the team shows both are special cases of one property-driven framework, with flexible input regions described as generalized rectangles standing in for the small cubes of vision work.
Well-known properties from the literature fall out as instances of the scheme. A case study trains a neural controller for a drone to demonstrate the machinery end to end. Code is public. The authors pitch the unification as a step toward practical formal verification of learned systems.
Catalog record
| CREATOR | Thomas Flinkow, Marco Casadio, Colin Kessler, Rosemary Monahan, Ekaterina Komendantskaya |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-00466
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Generalised Framework for Property-Driven Machine Learning Thomas Flinkow, Marco Casadio, Colin Kessler, Rosemary Monahan, Ekaterina Komendantskaya Abstract Neural networks have been shown to frequently fail to satisfy critical safety and correctness properties after training, highlighting the pressing need for training methods that incorporate such properties directly. While adversarial training can be used to improve robustness to small perturbations within ϵ \epsilon -cubes, domains other than computer vision—such as control systems and natural language processing—may require more flexible input region specifications via generalised hyper-rectangles. Meanwhile, differentiable logics offer a way to encode arbitrary logical constraints as additional loss terms that guide the learning process towards satisfying these constraints. In this paper, we investigate how these two complementary approaches can be unified within a single framework for property-driven machine learning. We show that well-known properties from the literature are subcases of this general approach, and we demonstrate its practical effectiveness on a case study involving a neural network controller for a drone system. Our framework is publicly available at https://github.com/tflinkow/property-driven-ml . 1 Introduction Neural networks have been shown to frequently fail to satisfy properties of interest after training [ 31 , 11 ] , and even the most accurate networks are known to be susceptible to adversarial attacks, i.e. inputs that resemble the training data but fall outside of the learnt distribution [ 53 , 26 ] . This puts restrictions on their use in safety-critical domains. To address this gap, numerous formal verification tools 1 1 1 For an overview of the state-of-the art in formal verification of neural networks, we refer the interested reader to [ 28 , 56 , 39 , 3 ] . have been proposed in the past few years, including Marabou [ 31 , 32 , 63 ] , Branch-and-Bound [ 8 ] , NNV [ 54 , 40 ] , and \alpha,\beta -CROWN [ 67 , 64 , 65 , 60 , 66 , 51 ] (winner of the recent Neural Network Verification Competitions (VNN-COMP) [ 4 , 47 , 6 , 7 ] ). Crucially, the success of the verification tools depends on obtaining models that actually yield the desired verification properties after training. However, neural networks obtained via standard training with gradient descent tend to fail verification properties of interest, which is why there is a need for training methods that combine data-driven with property-driven training. Standard optimisation methods that improve robustness. In the simplest case, data augmentation and adversarial training [ 26 , 42 ] can be used to improve neural network robustness. Data augmentation artificially enlarges the data set (e.g. by adding noise, or applying rotation, translation, scaling, etc.). Adversarial training aims to find the worst-case perturbation within \epsilon -distance around an input and integrates the loss computed for the perturbations into the training process. As an example, consider a property frequently used in image classification: \epsilon,\delta -robustness (or local robustness ) of a neural network f , expressed as \forall\vec{x}\ldotp\lVert\vec{x}_{0}-\vec{x}\rVert\leq\epsilon\ \longrightarrow\ \lVert f(\vec{x}_{0})-f(\vec{x})\rVert\leq\delta , given an image \vec{x}_{0} in the data set. Adversarial training (e.g. via Fast Gradient Sign Method (FGSM [ 26 ] ) or Projected Gradient Descent (PGD) [ 42 ] algorithms) finds the perturbation in the \epsilon -vicinity of \vec{x}_{0} for which the property \lVert f(\vec{x}_{0})-f(\vec{x})\rVert\leq\delta fails and optimises the neural network towards correct classification of that sample. Although these standard optimisation methods generally work well for computer vision models, they fail to generalise beyond this domain. In many scenarios outside of computer vision, we encounter properties in the form \forall\vec{x}\ldotp\mathcal{P}(\vec{x})\ \longrightarrow\ \mathcal{Q}(f(\vec{x})) , where preconditions \mathcal{P} and postconditions \mathcal{Q} differ substantially from the concrete instances used in the algorithms that optimise networks for \epsilon,\delta -robustness. Firstly, the properties \mathcal{P} and \mathcal{Q} do not have to be local, i.e. do not have to relate to given data points. Global properties of the input space can constrain input vectors in arbitrary ways. Secondly, \mathcal{P} and \mathcal{Q} do not have to be atomic, and can be given by arbitrary logical formulas. In the last couple of years, several methods have been proposed in order to generalise adversarial training to optimisation tasks involving global properties and non-atomic properties. Global properties and hyper-rectangles. Generally, for a neural network f\colon\mathbb{R}^{m}\to\mathbb{R}^{n} , a global property \mathcal{P} on the input space \mathbb{R}^{m} is given by a number of constraints of the form l_{i}\leq x_{i}\leq u_{i} , for constants l_{i} , u_{i} , and \vec{x}=[x_{1},\ldots,x_{m}]\in\mathbb{R}^{m} being an element of the input space. As noticed by [ 9 , 10 , 24 ] , such constraints generally give rise to the notion of a hyper-rectangle (described in more detail in Section 2.1 ), which generalises the notion of \epsilon -cubes frequently deployed in adversarial training. Although initially investigated in the context of classifiers for large language models [ 9 , 10 ] and for security applications [ 24 ] , there is an even more common application domain for such properties: neural networks deployed in cyber-physical systems as neural controllers . The seminal neural network verification benchmark ACAS Xu 2 2 2 The experimental neural network compression [ 29 ] of the unmanned variant ACAS Xu of the Airbourne Collision Avoidance System X (ACAS X) [ 35 , 34 ] . , for example, is defined via ten global properties that constrain sensor readings based on their intended semantics such as velocity, distance and angle to the intruder. Many neural network controllers yield similar verification conditions [ 43 ] . Non-atomic postconditions and differentiable logics. Important examples where the postcondition \mathcal{Q} is non-atomic have also been flagged in the literature [ 50 , 21 ] . Often, constraints on the output should not just encourage the network to make the correct class prediction, but rather encode complex, expressive constraints on the outputs: for example, in DL2 [ 22 ] , a constraint for CIFAR-100 [ 36 ] that refers to the probability of a group of people (consisting of the individual probabilities of the classes for baby, boy, girl, man, and woman) can be used to make misclassifications less severe; the network can be taught to make it more preferable to misclassify a man as a boy rather than as a bicycle. It was suggested that differentiable logics (described in more detail in Section 2.2 ) can be used to translate arbitrary logical constraints into additional loss terms for optimisation. These loss terms generalise the loss \lVert f(\vec{x}_{0})-f(\vec{x})\rVert\leq\delta used in the PGD or FGSM optimisation algorithms to a function that encodes an arbitrary property \mathcal{Q}(f(\vec{x})) . This line of research was explored in [ 22 , 57 , 23 ] . Contributions. This paper presents a generalised methodology for property-driven machine learning, combining the two existing lines of research into training with hyper-rectangles and differentiable logics. The result is a method that optimises arbitrary neural networks to arbitrary properties \forall\vec{x}\ldotp\mathcal{P}(\vec{x})\ \longrightarrow\ \mathcal{Q}(f(\vec{x})) written in a subset of first-order logic. In particular, \mathcal{P}(\vec{x}) and \mathcal{Q}(f(\vec{x})) can be expressed by arbitrary quantifier-free first-order formulae, such that occurrences of the neural network f is permitted in \mathcal{Q} but not in \mathcal{P} , and \mathcal{P} is limited to constraints that have constant upper and lower bounds for each dimension. We argue that this class of generalised properties is characteristic