SMiLE: Provably Enforcing Global Relational Properties in Neural Networks

Matteo Francobaldi, Michele Lombardi, Andrea Lodi · 2025

Read SMiLE: Provably Enforcing Global Relational Properties in Neural Networks by Matteo Francobaldi, Michele Lombardi, Andrea Lodi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07208.txt.

Introduction

Matteo Francobaldi, Michele Lombardi, and Andrea Lodi extend SMiLE, a system that forces neural networks to obey stated rules rather than merely hoping training instills them. Traits like monotonicity, fairness, and robustness carry growing regulatory weight, but current enforcement handles only certain constraints, narrow neighborhoods, or offers no full guarantee. The extension targets global relational rules defined over the entire input space.

The approach scales with model complexity, accepts general rule types and network backbones, and ensures full satisfaction of the enforced rule. On monotonicity, global robustness, and individual fairness tasks, across synthetic and real data for both regression and classification, SMiLE matched property-specific baselines in accuracy and runtime. It beat them on generality and guarantees. The authors position it as a platform for dependable AI.

Catalog record

CREATORMatteo Francobaldi, Michele Lombardi, Andrea Lodi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-07208

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SMiLE: Provably Enforcing Global Relational Properties in Neural Networks Matteo Francobaldi, Michele Lombardi, Andrea Lodi Abstract Artificial Intelligence systems are increasingly deployed in settings where ensuring robustness, fairness, or domain-specific properties is essential for regulation compliance and alignment with human values. However, especially on Neural Networks, property enforcement is very challenging, and existing methods are limited to specific constraints or local properties (defined around datapoints), or fail to provide full guarantees. We tackle these limitations by extending SMiLE, a recently proposed enforcement framework for NNs, to support global relational properties (defined over the entire input space). The proposed approach scales well with model complexity, accommodates general properties and backbones, and provides full satisfaction guarantees. We evaluate SMiLE on monotonicity, global robustness, and individual fairness, on synthetic and real data, for regression and classification tasks. Our approach is competitive with property-specific baselines in terms of accuracy and runtime, and strictly superior in terms of generality and level of guarantees. Overall, our results emphasize the potential of the SMiLE framework as a platform for future research and applications. Code — https://github.com/Francobaldi/SMiLEAAAI2026 Introduction Artificial Intelligence (AI) has witnessed tremendous success in recent years, becoming a pervasive technology. This has been fueled in many domains by Machine Learning (ML) models such as Neural Networks (NN), and by purely data-driven algorithms. While highly effective in terms of accuracy, these methods have difficulties in providing satisfaction guarantees on additional properties, which is critical when regulatory compliance or reliance on expert knowledge are necessary. The former involves safety-critical or ethically sensitive scenarios, where legal frameworks impose specific requirements, such as robustness in autonomous driving (e.g., resisting adversarial attacks in traffic sign recognition) or fairness in automated hiring (e.g., avoiding gender bias in candidate selection). The latter applies to settings that, even though not necessarily critical, might still benefit from the incorporation of properties, like monotonicity in remaining useful life estimation (e.g., the condition of a machine can only deteriorate over time), or adherence to physical laws in scientific modeling (e.g., conserving mass or energy in fluid simulations). In this work, we consider properties expressible as universally quantified implications between two predicates Q and R , specified over the input and output variables of a ML model f\colon\mathcal{X}\rightarrow\mathcal{Y} , that is: \forall x_{1},..,x_{k}\in\mathcal{X},Q(x_{1},..,x_{k})\Rightarrow R(f(x_{1}),..,f(x_{k})) (1) where each x_{i} represents a distinct input vector. We distinguish properties according to two criteria, arity and scope . The arity is trace if k=1 , relational otherwise. The scope is local if Q and R depend on data-based information, global if they apply also out-of-distribution. Our definition generalizes a broad range of requirements, such as adversarial (local) robustness ( \|x-x_{0}\|\leq\delta\Rightarrow f(x)=f(x_{0}) , with x_{0}\in D_{\text{train}} ), safety ( x\in S_{\text{in}}\Rightarrow f(x)\in S_{\text{out}} ), and monotonicity ( x^{\prime}\leq x^{\prime\prime}\Rightarrow f(x^{\prime})\leq f(x^{\prime\prime}) ). Global relational properties generally allow to express more advanced requirements, but they are also more difficult to handle, as they require searching over the entire domain, as well as reasoning over multiple model evaluations ( Banerjee, Xu, and Singh 2024 ; Blatter et al. 2022 ) . Finally, a property can be enforced with or without guarantees on its validity, that is, on the non-existence of a counterexample where such property is violated. Guarantees are crucial in regulatory scenarios, while not always necessary in knowledge injection ones. Enforcing Properties in ML Regardless of the arity and scope, enforcing properties in complex AI systems such as NNs is challenging due to the non-linear and high-dimensional nature of these models ( Katz et al. 2017 ) . The effort in this direction has been mostly spent on trace properties, in particular on adversarial robustness and safety, as surveyed by ( Liu et al. 2021 ; Meng et al. 2022 ; Muhammad and Bae 2022 ) . Recent years, however, have witnessed a shift of interest to relational ones, in particular fairness, robustness and monotonicity. Most of the proposed approaches embed carefully designed verifiers into training procedures, to promote property feasibility ( Tumlin et al. 2024 ; Athavale et al. 2024 ; Benussi et al. 2022 ; Liu et al. 2020 ; Khedr and Shoukry 2023 ) . Others modify the model architecture to make it systematically feasible ( Kitouni, Nolte, and Williams 2023 ; Nguyen et al. 2023 ; Runje and Shankaranarayana 2023 ; Leino, Wang, and Fredrikson 2021 ) . Despite the substantial progress achieved in the last decade, critical challenges remain, most notably the lack of guarantees and generality. Most of the existing methods improve the degree of property satisfaction, but without certifying its validity. Moreover, many of them are narrowly tailored to specific properties (e.g., adversarial robustness) or models (e.g., ReLU NNs). To the best of our knowledge, the only existing frameworks capable of providing guarantees while retaining generality are ( Goyal, Dumancic, and Blockeel 2024 ) and ( Francobaldi and Lombardi 2025 ) . The two approaches, both limited to trace properties, are based on similar principles: during training they adjust the model weights to guarantee feasibility, in the former case by solving a Quantified SMT problem, in the latter by pairing counterexample generation and Projected Gradient Descent. Contribution In this work, we extend the framework by ( Francobaldi and Lombardi 2025 ) , which was chosen due to the favorable trade-offs provided by its proposed architecture. This is referred to as SMiLE (Safe ML via Embedded overapproximation) and is obtained by augmenting an arbitrarily complex backbone network with a much simpler, trainable overapproximator: the former is used for inference, to enhance expressivity, the latter for enforcement, to improve scalability. Our main contribution is introducing support for relational properties in this framework, through an extensive re-elaboration of its key components. We evaluate the approach on 3 use cases: monotonicity on synthetic data, robustness on MNIST and fairness on Compas, Crime and Law. Across these benchmarks, our method can consistently achieve property guarantees, while remaining competitive with (and sometimes outperforming) property-specific baselines in terms of accuracy and runtime. Finally, we discuss several research directions opened up by our contributions. Related Work Two trends mainly arise from the AI literature accounting for properties: verification and enforcing methods. The former aim to formally certify the validity of properties in already-trained models, mostly by relying on optimization and searching techniques – such as Mixed-Integer Programming (MIP) or Satisfability Modulo Theory (SMT) – to seek counterexamples that falsify the assertion. The latter attempt to directly incorporate the desired property into the model’s behavior, either by designing property-aligned architectures, or by using existing verifiers into counterexample-guided training loops, or into real-time defense mechanisms. Most of the effort has been dedicated, thus far, to trace properties. Adversarial training methods, proposed for adversarial robustness ( Madry et al. 2018 ; Zhang et al. 2019 ; Shafahi et al. 2019 ; Wang et al. 2020 ; Zhang et al. 2020b ; Wong, Rice, and Kolter 2020 ; Kim, Lee, and Lee 2021 ; Bai et al. 2021 ) , local fairness ( Mohammadi, Sivaraman, and Farnadi 2023 ; Benussi et al. 2022 ) , and local monotonicity ( Liu et al. 2020 ) , work by training the model over a combination of the original datapoints and their worst counterexamples. Other methods work by detecting and purifying, or

Read the complete text