Probabilistic Abstract Interpretation on Neural Networks via Grids Approximation

Zhuofan Zhang, Herbert Wiklicky · 2026

Read Probabilistic Abstract Interpretation on Neural Networks via Grids Approximation by Zhuofan Zhang, Herbert Wiklicky (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25266.txt.

Introduction

Zhang and Wiklicky bring probabilistic abstract interpretation to neural networks. The method reasons about all inputs at once when testing each one is out of reach. Instead of single outputs, it tracks how input density flows through the network. The pair shows how the framework maps onto networks. They discuss abstract domains, the pseudo-inverses each one needs, and the transformers that move densities between layers. Small worked examples show how the analysis answers real questions about a network's behavior.

Catalog record

CREATORZhuofan Zhang, Herbert Wiklicky
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35654
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25266

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Probabilistic Abstract Interpretation on Neural Networks via Grids Approximation Zhuofan Zhang, Herbert Wiklicky Abstract Probabilistic abstract interpretation is a theory used to extract particular properties of a computer program when it is infeasible to test every single inputs. In this paper we apply the theory on neural networks for the same purpose: to analyse density distribution flow of all possible inputs of a neural network when a network has uncountably many or countable but infinitely many inputs. We show how this theoretical framework works in neural networks and then discuss different abstract domains and corresponding Moore-Penrose pseudo-inverses together with abstract transformers used in the framework. We also present experimental examples to show how this framework helps to analyse real world problems. [[email protected], ] [[email protected], ] keywords explainable AI ,probabilistic abstract interpretation ,neural network † † copyrightyear: 2024 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † address: Imperial College London, 180 Queen’s Gate, South Kensington, London SW7 2AZ † † address: Imperial College London, 180 Queen’s Gate, South Kensington, London SW7 2AZ † † venue: xaiit2024 1 Introduction In recent years, deep neural networks has been regarded as an essential technique for machine learning since the work of deep learning is being progressed deeplearning ; dlgoodfellow and have been playing in a big role in many industries in real world. However, a major problem of it is that it is difficult to interpret how neural networks deal with information and derive their decisions, especially when layers are getting deeper. Interpreting neural networks is important because in some application areas cost of mistakes is intolerable. Our approach aims at making use of the theory of probabilistic abstract interpretation to analyse density distribution flow of possible inputs of a neural network and to make sure the system is safe and under controlled. Research on interpreting neural networks has been carried on for years. One approach to do is through rule extraction algorithms review . Activation Maximisation is another approach to interpret model prediction by only looking at its relationships with input, disregarding the inner process am . A further development of the technique is to add a decoder on it am_decoder . In the same year Bazen et al. used Taylor decomposition explain model’s decision by decomposing output as a sum of relevance scores taylor_decomposition , and Landecker et al. decomposed the model prediction by back-propagating relevance in reverse direction, progressively redistributing the prediction score until the input is reached releprop . Bach et al. further introduced the Layer-wise Relevance Propagation explanation framework lrp . Another measurement is to use sensitivity analysis to quantify the importance of each input variable samek . In 2015 Zilke proposed DeepRED, by extending a decompositional algorithm CRED deepred . Jacobsson rnn and Wang rnn2 have proposed algorithms of understanding recurrent neural networks. In 2018 Zhang et al. and Zhou et al. respectively proposed methods to interpret convolutional neural networks Quanshi1 ; Quanshi2 ; Bolei . Zeiler et al. instead used approach of layer activation visualisation with algorithm of Deconvnets to understand CNN visualize . Bau et al. proposed Network Dissection framework which well quantifies the interpretability of latent representations of CNN dissection . In the mean time, the attacks and defenses from adversarial examples to neural networks are frequently studied adversarial . Program analysis, on the other hand, is a research area which focuses on using mathematical theory and formal methods to automatically analyse the behavior of a computer program regarding a property such as safety, correctness, robustness and liveness nielsonbook . In particular, abstract interpretation is a theory of approximating semantics of a computer program based on order theory, especially lattices cousot ; AI . In recent years, probabilistic program analysis has been introduced to analyze quantitative aspect of computer programs. Probabilistic abstract interpretation correspondingly is the framework to lift classical abstract interpretation to the probabilistic setting paicousot ; ccp ; psa ; PAI . In 2018 SRILAB proposed AI^{2} analyzer that uses abstract interpretation to over-approximate a range of concrete values into an abstract domain and checks whether this abstract domain holds the expected result, and which will prove every single input over-approximated by this abstract domain also holds this result ai2 . Later ai2_2 proposed a new abstract domain which combines floating point polyhedra with intervals. Its performance was compared to Reluplex which is a former property verification technique extending the simplex algorithm to support ReLU constraints reluplex . Abstract interpretation is also bridged with gradient-based optimization and can be applied on training neural networks ai2ontrain . In this paper, we take theory of probabilistic abstract interpretation to analyse density distribution flow of all possible inputs of a neural network, when the network has uncountably many or countable but infinitely many possible inputs. We also see that in particular situations probabilistic abstract interpretation has stronger features than classical ones. Section 2 gives a brief background of probabilistic abstract interpretation theory. In Section 3 we introduce how to apply the theory on neural networks, and discuss different choices of abstract domains for different purposes, together with corresponding Moore-Penrose pseudo inverses and abstract domains. In Section 4 we show in experiments how the framework helps in real world problem. Section 5 gives a conclusion and future works. 2 Background: Probabilistic Abstract Interpretation Theory In this section we give a brief introduction of probabilistic abstract interpretation theory originally introduced in program analysis. C D C^{\#} D^{\#} f f^{\#} A G A^{\prime} G^{\prime} Figure 1 : Probabilistic abstract interpretation with Moore-Penrose pseudo-inverse pairs A and G . The left hand side C\xrightarrow{\text{$f$}}D is the concrete domain and the right hand side C^{\#}\xrightarrow{\text{$f^{\#}$}}D^{\#} is the abstract domain. Probabilistic abstract interpretation is considered as a quantitative version of the classical abstract interpretation, commonly to give a not safe but a more average case scenario, while the classical framework keeps safe but might be not precise enough and therefore addressing a worst case scenario nielsonbook ; cousot ; ccp ; lecturenotes ; psa . In probabilistic framework, instead of forming a Galois connection in which classical framework does, we take a Moore-Penrose pseudo-inverse. Definition 1 Let C and C^{\#} be two finite-dimensional vector (Hilbert) spaces and A:C\rightarrow C^{\#} a linear map. Then the linear map G:C^{\#}\rightarrow C is the Moore-Penrose pseudo-inverse of A iff (i) A\circ G=P_{A} (ii) G\circ A=P_{G} , where P_{A} and P_{G} denote orthogonal projections onto the ranges of A and G . As shown in Figure 1, f is the original function in concrete domain, which can be a step in a computer program. Based on f , we further consider function \overrightarrow{f} in probability domain and function f^{\#} in abstract domain respectively. Given in concrete domain f:R\rightarrow R (1) we lift f to \overrightarrow{f} which is a mapping from a distribution to a distribution in probabilistic domain \overrightarrow{f}:\mathcal{V}(R)\rightarrow\mathcal{V}(R) (2) where \mathcal{V}(R) is the vector space of R , and from probabilistic abstract interpretation framework in Figure 1, we can formalise f^{\#} in abstract domain as f^{\#}=A^{\prime}fG (3) where we have Moore-Penrose pseudo-inverse as connections between concrete and abstract domains. f^{\#} is also called the abstract transformer . Defining an appropriate

Read the complete text