Independence Is Not an Issue in Neurosymbolic AI

Håkan Karlsson Faronius, Pedro Zuidberg Dos Martires · 2025

Read Independence Is Not an Issue in Neurosymbolic AI by Håkan Karlsson Faronius, Pedro Zuidberg Dos Martires (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07851.txt.

Introduction

Håkan Karlsson Faronius and Pedro Zuidberg Dos Martires dispute a warning about neurosymbolic AI in a 2025 paper. Such systems feed a neural network's output through a graph of logic rules. The setup often leaves output variables independent of each other, a trait blamed for a flaw called deterministic bias. In that flaw, systems settle on one valid answer and ignore the rest.

The pair present evidence that the blame is misplaced. The bias, they argue, springs from flawed training setups rather than the independence itself. Their case frees designers from a feared constraint. It also redirects debugging: when a system plays favorites among valid answers, check the training pipeline before the logic graph.

Catalog record

CREATORHåkan Karlsson Faronius, Pedro Zuidberg Dos Martires
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07851

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Independence Is Not an Issue in Neurosymbolic AI Håkan Karlsson Faronius, Pedro Zuidberg Dos Martires Abstract A popular approach to neurosymbolic AI is to take the output of the last layer of a neural network, e.g. a softmax activation, and pass it through a sparse computation graph encoding certain logical constraints one wishes to enforce. This induces a probability distribution over a set of random variables, which happen to be conditionally independent of each other in many commonly used neurosymbolic AI models. Such conditionally independent random variables have been deemed harmful as their presence has been observed to co-occur with a phenomenon dubbed deterministic bias , where systems learn to deterministically prefer one of the valid solutions from the solution space over the others. We provide evidence contesting this conclusion and show that the phenomenon of deterministic bias is an artifact of improperly applying neurosymbolic AI. 1 Introduction Neurosymbolic (NeSy) AI is an approach to AI which seeks to combine logic and neural networks [ 13 ] . Such an integration of symbolic and sub-symbolic methods allows, inter alia, for more interpretable [ 17 ] and data efficient [ 11 , 20 ] AI systems. One of the most popular approaches to realize NeSy systems, uses the idea of a semantic loss function [ 32 , 20 ] , which imposes logical constraints on the outputs of a neural network while retaining end-to-end differentiability. C1 As a first contribution we show that neurosymbolic AI formulated using the semantic loss can be seen as a special case of so-called disjunctive supervision [ 33 ] , cf. Section 3 . Disjunctive supervision [ 33 ] is a setting for multi-class classification in which examples may be labeled with a disjunction of classes, i.e. a single input can have multiple valid outputs. Our result formally relates neurosymbolic AI to a wider range of techniques that are already being explored in the machine learning community. Note, however, that important differences exist and the often implicit assumptions can result in drastically differing outcomes. C2 In Section 4 we experimentally show how the different assumptions in NeSy AI and disjunctive supervision learning drastically affect the behavior of classifiers when trained with weak supervision. In a recent study, van Krieken et al. [ 30 ] reported that under assumptions commonly made in neurosymbolic AI, NeSy systems exhibit a phenomenon they dub deterministic bias . More specifically, they write that “the conditional independence assumption causes neurosymbolic methods to be biased towards deterministic solutions. This is because minima of neurosymbolic losses have to deterministically assign values to some variables.” We do not observe any such phenomenon in our experimental evaluation. On the other hand, we report on a phenomenon related to deterministic bias for disjunctive supervision, as predicted by Zombori et al. [ 33 ] . C3 In Section 5 we identify that van Krieken et al. [ 30 ] do not use the semantic loss as originally derived in [ 32 ] , which takes into account both positive examples that satisfy the constraints and negative ones that do not. Instead they use a truncated semantic loss that takes into account positives only. This explains why we did not observe deterministic bias in our experimental evaluation (cf. Section 4 ). 2 Preliminaries 2.1 From Probabilistic Logic to Neurosymbolic AI As pointed out by Poole and Wood [ 27 ] (and already earlier by Laplace (1814) [ 19 ] , Poole (1993) [ 25 ] , Pearl (2000) [ 24 ] , and Poole (2010) [ 26 ] ) probabilistic models consist of deterministic systems and independent probabilistic choices (DSIC). This simple principle can, for instance, be used to construct Turing complete probabilistic logic programming languages as done by Sato with his celebrated distribution semantics [ 29 ] . The DSIC principle can even be used to construct probabilistic programming languages with an uncountable number of random variables [ 35 ] . In the context of logic programming, which many NeSy systems are based on [ 20 , 1 ] , the DSIC principle implies that a probabilistic model consists of a set of (deterministic) logic formulas and a set of literals that are not deterministically true or false but are only true or false with a certain probability. This means in turn that each formula \phi is only satisfied with a certain probability: \displaystyle p(\phi{=}\top)=\sum_{\mathbf{w}}p(\phi{=}\top,\mathbf{b}{=}\mathbf{w}), (1) where \mathbf{w}=(w_{1},\dots,w_{N}) ( w_{i}\in\{\bot,\top\} ) is called a world and denotes a value assignment (either true or false) to all the N Boolean variables \mathbf{b} in \phi . The sum goes over all 2^{N} possible value assignments. Using Poole’s DSIC principle [ 26 ] we further write: \displaystyle p(\phi{=}\top) \displaystyle=\sum_{\mathbf{w}}p(\phi{=}\top\mid b{=}\mathbf{w})p(\mathbf{b}{=}\mathbf{w}) (2) \displaystyle=\sum_{\mathbf{w}}p(\phi{=}\top\mid\mathbf{b}{=}\mathbf{w})\prod_{i:w_{i}\in\mathbf{w}}p(b_{i}{=}w_{i}) (3) where w_{i}\in\{\top,\bot\} and where we have p(b_{i}{=}\top)=1{-}p(b_{i}{=}\bot) . For the sake of notational ease we will often write this as: \displaystyle p(\phi)=\sum_{\mathbf{w}}p(\phi\mid\mathbf{w})\prod_{w_{i}\in\mathbf{w}}p(w_{i}). (4) Given that the \mathbf{w} ’s assign values to all the Boolean (random) variables in \phi we finally have: \displaystyle p(\phi)=\sum_{\mathbf{w}}\llbracket\phi\models\mathbf{w}\rrbracket\prod_{w_{i}\in\mathbf{w}}p(w_{i}), (5) where \llbracket\phi\models\mathbf{w}\rrbracket is an indicator function that evaluates to one if \phi models the value assignment \mathbf{w} and zero otherwise. In a neurosymbolic setting [ 20 ] we additionally have the presence of some subsymbolic data \mathbf{x} in the conditioning set: \displaystyle p_{\theta}(\phi\mid\mathbf{x})=\sum_{\mathbf{w}}\llbracket\phi\models\mathbf{w}\rrbracket\prod_{w_{i}\in\mathbf{w}}p_{\theta}(w_{i}\mid\mathbf{x}). (6) Here we use a neural parametrization for p_{\theta}(w_{i}\mid\mathbf{x}) depending on the parameters \theta . Note that by omitting an index on \theta we allow for parameters to be shared between the different probability distributions in the product. Note also how the DSIC principle manifests itself in Equation 5 and Equation 6 with the product over probabilities encoding the independent choices and the indicator function representing the deterministic system. 2.2 Neurosymbolic Learning Apart from a few exceptions [ 23 , 8 , 10 , 15 ] (this being a non-exhaustive list), most works in the NeSy literature to date are concerned with supervised classification problems and use the cross-entropy as a loss function. For K -class multi-class classification in neurosymbolic AI, we have K logic formulas (\phi_{k},\dots,\phi_{K}) (one for each class) whose probabilities we would like to know. This means that we have a one-to-one mapping between the classes we would like to predict and the logic formulas. Furthermore, these K formulas are mutually exclusive ( \phi_{i}\land\phi_{j}=\bot , with i{\neq}j ) and exhaustive ( \lor_{i=1}^{K}\phi_{k}=\top ). These conditions mirror the setting for traditional supervised classification, where one assumes classes to be mutually exclusive and exhaustive, as well. Given a data point (\mathbf{x},y) , where \mathbf{x} are the (subsymbolic) features and y is the class label, we write the cross-entropy as \displaystyle L(\theta,\mathbf{x},y)=-\sum_{k=1}^{K}\llbracket y=k\rrbracket\log p_{\theta}(\phi_{k}\mid\mathbf{x}). (7) In the special case of binary classification this reduces to \displaystyle L(\theta,\mathbf{x},y) \displaystyle=-\llbracket y=1\rrbracket\log p_{\theta}(\phi_{1}\mid\mathbf{x})-\llbracket y=0\rrbracket\log p_{\theta}(\phi_{0}\mid\mathbf{x}) \displaystyle=-\llbracket y=1\rrbracket\log p_{\theta}(\phi_{1}\mid\mathbf{x})-\llbracket y=0\rrbracket\log\bigl(1-p_{\theta}(\phi_{1}\mid\mathbf{x})\bigr), (8) where we use 1 to denote the positive class and 0 to denote the negative class. Manhaeve et al. [ 20 ] used this form to enforce logical constraints on the outputs of neural networks and Xu et al. [ 32 ] used it to regularize neural networks. The latter work also coined the term semantic loss . Consequently, we will denote the neurosymbolic loss in Equation 7 by L_{SL}(\theta,\mathbf{x},y) for the remainder of the paper. The NeSy learning problem (for the general case)

Read the complete text