Modal Logical Neural Networks Antonin Sulc Abstract We propose Modal Logical Neural Networks (MLNNs), a neurosymbolic framework that integrates deep learning with the formal semantics of modal logic, enabling reasoning about necessity and possibility. Drawing on Kripke semantics, we introduce specialized neurons for the modal operators □ \Box and ◇ \Diamond that operate over a set of possible worlds, enabling the framework to act as a differentiable “logical guardrail.” The architecture is highly flexible: the accessibility relation between worlds can either be fixed by the user to enforce known rules or, as an inductive feature, be parameterized by a neural network. This allows the model to optionally learn the relational structure of a logical system from data while simultaneously performing deductive reasoning within that structure. This versatile construction is designed for flexibility. The entire framework is differentiable from end to end, with learning driven by minimizing a logical contradiction loss. This not only makes the system resilient to inconsistent knowledge but also enables it to learn nonlinear relationships that can help define the logic of a problem space. We illustrate MLNNs on four case studies: grammatical guardrailing, axiomatic detection of the unknown, multi-agent epistemic trust, and detecting constructive deception in natural language negotiation. These experiments demonstrate how enforcing or learning accessibility can increase logical consistency and interpretability without changing the underlying task architecture. 1 Introduction Modern neural networks, particularly large language models, have achieved remarkable success in learning complex statistical patterns from vast datasets. However, their reliance on purely data-driven learning presents a critical challenge in high-stakes environments. These models can produce outputs that are statistically plausible yet logically incoherent, factually incorrect, or in violation of fundamental domain constraints. This inherent unpredictability poses a significant barrier to their deployment in safety-critical applications such as autonomous systems, medical diagnostics, or legal reasoning, where adherence to explicit rules and principles is not just desirable, but essential. The core of this problem is a methodological gap: a lack of a native mechanism within these architectures to enforce declarative, symbolic knowledge and guarantee that outputs conform to a set of verifiable logical rules. This paper addresses this gap by turning to modal logic, a powerful extension of classical logic designed for reasoning about concepts like necessity and possibility. While standard logic deals with propositions that are simply true or false in a single, fixed reality, modal logic introduces a framework of “possible worlds” to reason about qualified truths. For instance, in the context of an autonomous vehicle, a temporal logic rule might state \Box(\neg\text{moving}\land\text{red\_light}) , meaning “it is necessarily true at all future moments that the vehicle is not moving while the traffic light is red.” This is a far stronger and more useful constraint than a simple statistical correlation. Similarly, epistemic logic, another form of modal logic, reasons about knowledge, where a statement like K_{a}\phi means “agent a knows that \phi is true.” These logics provide the formal language needed to specify the complex, nuanced rules that govern real-world systems, but integrating them into differentiable, learnable models remains an open challenge. We introduce Modal Logical Neural Networks (MLNNs) 1 1 1 Code available at https://github.com/sulcantonin/MLNN_public.git , a neurosymbolic framework that bridges this divide. Building upon the weighted real-valued logic of Logical Neural Networks (LNNs) 14 , we propose a distinct architecture centered on Kripke semantics that reasons over possible worlds. This moves beyond purely statistical learning to a hybrid approach, allowing users to impose explicit modal logic constraints on a model’s behavior. A defining feature of this architecture is its flexibility: the accessibility relation between worlds can be parameterized by a neural network. This design enables MLNNs to simultaneously perform deductive reasoning based on user-defined axioms and inductively learn the relational structure that best explains the data. Consequently, this work shows modeling multi-agent systems: by interpreting the learnable accessibility relation as a dynamic graph of trust or information flow, the framework can formalize how agent behavior and communication evolve in response to one another. Proposer NN Learns State Differentiable Modal Logic Relation Fixed A /Learned A_{\theta} Loss L_{\text{task}} + L_{\text{contra}} Gradient ( \nabla ) (A) Deductive Fixed Rules, Learn Content Context Enc. Fixed Input Differentiable Modal Logic Relation NN Learns A_{\theta} Loss L_{\text{task}} + L_{\text{contra}} Gradient ( \nabla ) (B) Inductive Fixed Input, Learn Structure Figure 1: MLNN learning modes executing the Upward-Downward inference algorithm. (A) Deductive: Enforces fixed axioms by updating state representations (Proposer NN). (B) Inductive: Discovers relational structure ( A_{\theta} ) by updating the Relation NN. Gray arrows denote the forward differentiable inference (performing Upward aggregation and Downward constraint propagation); Orange arrows denote the gradient flow minimizing logical contradiction. This approach enables the creation of differentiable “guardrails” for powerful statistical models. By framing learning as the dual objective of fitting data and minimizing logical contradiction, MLNNs can steer models toward outputs that are both statistically likely and logically sound. In this paradigm, we explicitly accept a trade-off: we may sacrifice a margin of raw statistical accuracy to achieve higher logical coherence and explainability. We demonstrate this capability through a series of experiments: reducing specific grammatical errors made by a sequence tagger, training a classifier to logically abstain on ambiguous inputs it has never seen, learning the relational knowledge structure in a multi-agent system, and identifying deceptive strategies in human negotiation benchmarks. MLNNs offer a methodological step toward building AI systems that are not only powerful pattern recognizers but also more predictable and verifiable reasoners. In the following sections, we formalize the MLNN architecture (Section 3 ), analyze its theoretical properties (Section 4 ), and demonstrate its capabilities across distinct case studies (Section 5 ). 2 Related Work 2.1 Classical (Single-World) Neurosymbolic Logic Our work utilizes the foundational principles of the Logical Neural Network (LNN) framework 14 . LNNs establish a one-to-one correspondence between neurons and the components of logical formulae, creating a highly disentangled and interpretable representation. They employ a weighted real-valued logic, where neurons compute truth values within the continuous interval [0,1] and use truth bounds [L,U] to represent uncertainty and enable an open-world assumption. Inference is performed via a provably convergent Upward-Downward algorithm, and learning is driven by a novel loss function that minimizes logical contradiction ( L>U ). Other prominent neurosymbolic systems designed for First-Order Logic (FOL) or probabilistic logic also operate on a single-world assumption. Frameworks like Logic Tensor Networks (LTNs) ground FOL formulae in tensors 15 , Markov Logic Networks (MLNs) merge FOL with probabilistic graphical models by weighting clauses as features 13 , and ProbLog integrates probabilistic reasoning with logic programming 6 . While powerful, these systems share a common characteristic: their logic is defined over a single, fixed reality. Sophisticated reasoning often demands evaluating statements across dynamic contexts, such as temporal futures or epistemic beliefs, rather than within a static snapshot. By incorporating Kripke semantics 8 , our framework evaluates propositions over connected possible worlds. This architecture captures structural relationships inexpressible in single-world models, enabling the richer analysis of complex domains like demonstrated in experiment section. 2.2 Neural Models for Modal Logic The concept of representing modal logic in neural networks was pioneered by Connectionist Modal Logic (CML) 9 . CML represents Kripke models by using an ensemble of neural networks, with one network dedicated to each possible world. In this framework, the modal operators ( \Box , \Diamond ) are implemented by structurally propagating information between these networks based on a fixed accessibility relation, which is typically derived a priori from a logic program. Consequently, the learning task in CML is restricted to the internal propositions of each world within this fixed topology. Modal Logical Neural Networks (MLNNs) advance this paradigm in two fundamental ways. First, rather than relying on binary truth values, they incorporate a weighted, real-valued logic capable of modeling uncertainty and actively minimizing logical inconsistencies. Second, and most significantly, MLNNs treat the accessibility relation, the structural rules defining how different possible worlds connect, as a flexible, learnable component. Unlike CML, which relies on a pre-determined logical structure, MLNNs employ fully differentiable modal operators. This allows the entire reasoning pipeline to be trained end-to-end, enabling the system to be embedded within larger neural architectures and to inductively discover complex logical structures, such as epistemic trust or temporal dependencies, directly from data. 2.3 Modal Logic as a Constraint or Tool for Neural Nets Other recent work has used modal logics, particularly temporal and epistemic logics, around neural networks rather than as the network architecture itself. For example, LTLfNet trains a recursive neural network to decide the satisfiability of Linear Temporal Logic on finite traces (LTLf) 11 . Here, the logic is the input to be classified, not a persistent multi-world state for reasoning. In epistemic reinforcement learning, modal logic has been used as an external model-checking layer or “shield” to verify an agent’s beliefs (doxastic states) and guide its actions 7 . In such systems, the agent itself is often a standard neural network, and the accessibility relation (defining an agent’s beliefs) is symbolically defined, not learned via gradient descent as A_{\theta} is in our framework. These approaches demonstrate the utility of modal logic for specification and verification, but do not provide a unified, differentiable Kripke-style architecture. 2.4 Modal Logic as an Analysis Tool for GNNs While theoretical studies have established an expressive equivalence between GNNs and certain fragments of modal logic 12 , the two frameworks differ fundamentally in their operational direction. Their approach leverage this duality for post-hoc analysis: they train standard GNNs on data and subsequently attempt to extract or explain logical behaviors from the learned weights. In contrast, MLNNs natively embed modal semantics into the neural architecture itself. Rather than relying on a statistical model to approximate logical rules as an emergent property of the data, MLNNs enforce these rules as differentiable constraints. Similarly, 3 identified the limitations of the equivalence between GNNs and graded modal logic. They demonstrated that this logical fragment is inherently restricted to local neighborhoods, preventing the representation of global properties without explicit readout mechanisms. Our framework addresses this theoretical constraint by parameterizing the accessibility relation ( A_{\theta} ), enabling the model to learn the global connectivity needed for broader logical expressivity. 2.5 Positioning MLNNs MLNNs synthesize and extend these ideas. Our framework makes two primary contributions to this landscape. First, it brings full Kripke semantics to neurosymbolic learning by introducing sound, differentiable \Box and \Diamond neurons that operate over a set of possible worlds, inheriting the LNN’s [L,U] bounds and contradiction-driven learning. Second, unlike CML or shielding-based approaches, MLNNs uniquely parameterize the accessibility relation itself as A_{\theta} , allowing the logical structure to be learned from data. This A_{\theta} can also be optionally regularized to approximate the relational properties of standard modal systems, such as T (reflexivity) or S4 (transitivity), as discussed in Section 4.3 . This makes MLNN a general-purpose, differentiable modal reasoning layer designed to enforce logical coherence. This capability complements purely statistical approaches. For instance, while Conformal Prediction (CP) provides statistical guarantees for abstention 1 , MLNNs enable axiomatic detection of the unknown (as shown in Section 5.2 ) based on user-defined axioms, providing a form of logical interpretability absent in statistical methods. To the best of our knowledge, there is currently no neurosymbolic framework that simultaneously (i) implements Kripke-style modal semantics with explicit \Box/\Diamond operators, (ii) maintains LNN-style lower/upper truth bounds for open-world reasoning, and (iii) treats the accessibility relation itself as a differentiable, learnable component trained jointly with the task. Existing systems either handle only propositional or first-order constraints, rely on symbolic (non-differentiable) modal reasoning, or assume a fixed accessibility relation defined a priori. As a consequence, there is no directly comparable “drop-in” baseline for MLNNs; in our experiments we therefore focus on controlled comparisons to simplified variants of our own model and to standard non-symbolic baselines that address overlapping subtasks. 3 Method: Modal Logical Neural Networks 3.1 Preliminaries and Notation The power of modal logic stems from Kripke semantics, which extends classical logic by evaluating propositions across multiple ’possible worlds’. Formally, a Kripke model is a tuple M=\langle W,R,V\rangle , where W is a set of possible worlds, R is a binary accessibility relation on W (i.e., R\subseteq W\times W ), and V is a valuation function that assigns a truth value to each atomic proposition p\in P in each world w\in W . An MLNN instantiates a differentiable, learnable version of this model. A “world” is a flexible concept representing an agent’s belief, a moment in time, or a specific context. We formalize our framework using the following notation. Let W be a finite set of possible worlds and T be a finite set of discrete time steps, which together define a set of spacetime states S=W\times T . Atomic propositions and logical formulae are denoted by p and \phi , respectively, with their truth values represented by continuous lower and upper bounds [L,U]\subseteq[0,1] . The structural relationships between worlds are defined by a crisp binary accessibility relation R\subseteq W\times W or a learnable, neurally parameterized accessibility matrix A_{\theta} , which may be applied as a masked matrix \tilde{A} . We utilize the standard modal operators \Box (necessity) and \Diamond (possibility), which instantiate as K_{a}\phi (“Agent a knows \phi ”) in epistemic logic or G\phi (“Globally”) and F\phi (“Finally”) in temporal logic. The soft logic aggregations are controlled by a temperature parameter \tau , and the model is trained by minimizing a total loss composed of a task loss L_{\text{task}} and a logical contradiction loss L_{\text{contra}} , balanced by a weighting hyperparameter \beta . 3.2 Differentiable Kripke Semantics In an MLNN, the components of a Kripke model are realized as differentiable tensors. For each proposition p , the MLNN stores a tensor of truth bounds of shape (|W|,2) , where each row [L_{p,w},U_{p,w}] represents the truth bounds of p in world w . The accessibility relation R , which defines which worlds can “see” each other, dictates the function of modal operators. A key feature of the MLNN is the option to make this relation a learnable component, parameterized by a neural network, A_{\theta} . This allows the model to learn the underlying relational physics of the problem domain-such as which agents trust each other or how time flows-directly from data, guided by the goal of achieving logical consistency. 3.2.1 Modal Operators: The Necessity and Possibility Neurons The modal operators are specialized neurons that aggregate information across worlds. While classical logic uses hard minimums and maximums over a fixed set of neighbors, we employ differentiable relaxations over the weighted accessibility matrix \tilde{A} to allow gradients to propagate through the structural decision boundaries. To ensure the soundness of our bounds (as shown in Theorem 1 ), we define a set of differentiable, monotonic operators. Let x=\{x_{i}\} be a set of truth values from all worlds. We define: • \operatorname{softmin}_{\tau}(x)=-\tau\log\sum_{i}\exp(-x_{i}/\tau) , which is a sound lower bound on \min(x) . • \operatorname{softmax}_{\tau}(x)=\tau\log\sum_{i}\exp(x_{i}/\tau) , which is a sound upper bound on \max(x) . • \operatorname{conv-pool}_{\tau}(x,z)=\sum_{i}w_{i}x_{i} , where w_{i}=\operatorname{softmax}(z_{i}/\tau) . This is a convex pooling (a weighted average). When z=x , this is a lower bound on \max(x) . When z=-x , this is an upper bound on \min(x) . We use these to define the modal neuron bounds (default \tau=0.1 unless stated). The \Box (Necessity) Neuron In differentiable Kripke semantics, \Box\phi represents a weighted universal quantification: \phi must be true in all worlds to the degree that they are accessible. We implement this using the differentiable implication (1-\tilde{A}_{w,w^{\prime}}+\text{truth}) . Intuitively, this acts as a “weakest link” detector: if a world is highly accessible ( \tilde{A}\approx 1 ) but \phi is false, the score collapses. \begin{array}[]{llll}L_{\Box\phi,w}&=&\underset{w^{\prime}\in W}{\operatorname{softmin}_{\tau}}\left((1-\tilde{A}_{w,w^{\prime}})+L_{\phi,w^{\prime}}\right)&\quad\text{(Weighted Universal)}\\ U_{\Box\phi,w}&=&\underset{w^{\prime}\in W}{\operatorname{conv-pool}_{\tau}}\left((1-\tilde{A}_{w,w^{\prime}})+U_{\phi,w^{\prime}},\dots\right)&\quad\text{(Sound Upper Bound)}\end{array} (1) The \Diamond (Possibility) Neuron Dually, \Diamond\phi represents a weighted existential quantification: \phi must be true in at least one highly accessible world. We implement this using a differentiable conjunction. Functionally, this acts as an “evidence scout”: the neuron activates if it finds any world that is both accessible and where \phi is true. \begin{array}[]{llll}L_{\Diamond\phi,w}&=&\underset{w^{\prime}\in W}{\operatorname{conv-pool}_{\tau}}\left(\tilde{A}_{w,w^{\prime}}+L_{\phi,w^{\prime}}-1,\dots\right)&\quad\text{(Sound Lower Bound)}\\ U_{\Diamond\phi,w}&=&\underset{w^{\prime}\in W}{\operatorname{softmax}_{\tau}}\left(\tilde{A}_{w,w^{\prime}}+U_{\phi,w^{\prime}}-1\right)&\quad\text{(Weighted Existential)}\end{array} (2) This formulation ensures that the bounds respect the fundamental modal duality \Diamond\phi\equiv\neg\Box\neg\phi via the identity \operatorname{softmax}(x)=1-\operatorname{softmin}(1-x) . 3.3 Flexible and Learnable Accessibility Relations A key capability of MLNNs is the ability to treat the accessibility relation as a learnable parameter, rather than a fixed part of the model structure. In classical modal logic, R is a fixed, given structure. In an MLNN, R can be replaced by a learnable, weighted relation A_{\theta} . The flexibility to use either a fixed or learnable structure is crucial; we use fixed logical rules in our grammatical guardrailing and axiomatic detection of the unknown, while the learnable relation A_{\theta} is showcased in our multi-agent epistemic trust analysis. We parameterize this relation with a neural network, A_{\theta}:W\times W\rightarrow[0,1] . For smaller domains, this can be instantiated as a direct matrix of learnable logits passed through a sigmoid function. For scalable applications, we can employ a metric learning parameterization, where a neural encoder maps each world w to a latent embedding \mathbf{h}_{w}\in\mathbb{R}^{d} . The accessibility score is then defined by a kernel function, such as A(w_{i},w_{j})=\sigma(\mathbf{h}_{w_{i}}^{\top}\mathbf{h}_{w_{j}}) , effectively determining logical access via geometric proximity. This factorized form reduces the parameter space from quadratic to linear with respect to |W| . For differentiability, we use these weights directly in a soft aggregation. The necessity neuron, for example, becomes a weighted soft minimum, see Equation 1 . The truth value L_{\phi,w_{j}} from a target world w_{j} is incorporated into the minimum at w_{i} using a differentiable implication 1-(\tilde{A})_{ij}+L_{\phi,w_{j}} . If (\tilde{A})_{ij}\approx 1 (full access), the term (1-(\tilde{A})_{ij}) is near 0, and L_{\phi,w_{j}} fully participates in the minimum. If (\tilde{A})_{ij}\approx 0 (no access), the term is near 1, effectively removing L_{\phi,w_{j}} from consideration. This formulation is a weighted generalization of a logical conjunction, adapted from the LNN framework’s operator for universal quantification. Its use preserves the monotonicity required for the Upward-Downward algorithm, as it is a composition of monotonic functions (soft-min and a linear term in L ), which we rely on in Section 4.2 . In line with the base LNN framework, we assume that all neuron activations are clipped to the interval [0,1] to maintain valid truth values. The parameters \theta of this accessibility network are learnable, updated via gradient descent on the system’s overall contradiction loss. This is the core inductive capability of the MLNN. It allows the model to discover the logical structure that best resolves contradictions in the data. For example, it can learn whether the relation should be reflexive (by learning high values on the diagonal) or symmetric, all driven by the objective of finding a maximally consistent logical theory. 3.4 Modal Inference and Learning We extend the Upward-Downward algorithm from 14 to handle modal operators. During the upward pass, the truth of a modal formula is determined by aggregating its subformula’s truth from accessible worlds, as shown in the equations above. Downward Pass During the downward pass, a parent modal formula’s truth constrains its subformula in accessible worlds. This propagation is also monotonic. For the necessity operator, if the lower bound L_{\Box\phi,w} is high, it implies a strong belief that \phi must be true in all accessible worlds. This propagates a new, tighter lower bound to all children: L_{\phi,w^{\prime}}^{(t+1)}\leftarrow\max(L_{\phi,w^{\prime}}^{(t)},L_{\Box\phi,w}^{(t)})\quad\forall w^{\prime}\text{ s.t. }(\tilde{A})_{w,w^{\prime}}>0 Dually, a low upper bound U_{\Diamond\phi,w} implies \phi must be false in all accessible worlds: U_{\phi,w^{\prime}}^{(t+1)}\leftarrow\min(U_{\phi,w^{\prime}}^{(t)},U_{\Diamond\phi,w}^{(t)})\quad\forall w^{\prime}\text{ s.t. }(\tilde{A})_{w,w^{\prime}}>0 The entire system is trained end-to-end via joint optimization. The total loss combines a standard task-specific loss (e.g., cross-entropy) with the logical contradiction loss. This loss is theoretically grounded in the principle of reductio ad absurdum. A state where the lower bound L exceeds the upper bound U is a logical impossibility. Theoretically, the minimization of L_{\text{contra}} can be viewed as a differentiable search for a satisfying interpretation of the logical theory. Under the assumption that a fully consistent Kripke model exists that is representable by the network, gradient descent is guided towards a parameterization \theta and a set of truth bounds that satisfy all axioms simultaneously. The total loss is formulated as: L_{\text{total}}=L_{\text{task}}+\beta L_{\text{contra}} (3) where \beta is a hyperparameter that balances statistical learning and logical consistency. Gradients from both loss terms flow back through the entire network, including the parameters \theta of the accessibility relation A_{\theta} , allowing the logical structure itself to be learned. 3.5 Neural Parameterization for Temporal Epistemic Logic A particularly powerful instantiation of the MLNN framework is for temporal epistemic logic, which combines reasoning about knowledge (epistemic) and time (temporal). This is essential for modeling scenarios like multiagent planning or verifying the behavior of autonomous systems over time. Worlds as Spacetime Points Instead of a simple set of worlds W , we consider a set of world-time points S=W\times T , where W is a set of agents and T=\{t_{0},\dots,t_{m}\} is a set of discrete time steps. A “world” in this context is a tuple (w,t) , representing the state of agent w at time t . Propositional truth bounds are now tensors of shape (|W|\times|T|,2) . While we typically use discrete time steps for simplicity, it is worth noting that continuous representations of time are also possible within this framework, for instance by parameterizing A_{\theta} as a function of a continuous variable \Delta t (e.g., via Neural ODEs), though we leave this exploration for future work. Multiple Accessibility Relations We introduce distinct, learnable neural models for the different accessibility relations. First, Epistemic Accessibility ( A^{a}_{\theta} ) defines, for each agent a , a separate neural network that computes a matrix defining which states the agent considers possible. The operator K_{a}\phi (“agent a knows \phi ”) is then implemented as a \Box neuron operating with the A^{a}_{\theta} relation. Second, Temporal Accessibility ( A^{T}_{\phi} ) is a network that computes a matrix governing the flow of time. Common temporal operators like G\phi (“ \phi is always true in the future”) and F\phi (“ \phi is eventually true in the future”) are implemented as \Box and \Diamond neurons, respectively, using the A^{T}_{\phi} relation. Composite Modal Operators This structure allows for rich, composite operators. For example, the statement “Agent a will always know that \phi is true” ( GK_{a}\phi ) is implemented as a nested aggregation. First, the epistemic neuron for K_{a}\phi is computed at each future time step. Then, the temporal neuron for G (Globally/Always) aggregates these intermediate results. This compositional approach allows the MLNN to learn and reason about complex specifications involving how agents’ knowledge evolves over time. Having defined the architecture and learning mechanism of an MLNN, we now turn to a formal analysis of its soundness, convergence, and expressivity. 4 Theoretical Analysis 4.1 Soundness of MLNN Bounds Assumptions: finite W , bounded continuous operators with monotone updates, fixed \tau>0 , and bounded weights. We first show that the bounds computed by an MLNN are sound with respect to a probabilistic semantics over Kripke models. This extends Theorem 2 from the LNN paper 14 . Let a set of atomic propositions be given over a set of worlds W . A classical Kripke interpretation g assigns a truth value \{T,F\} to each proposition in each world. Let \mathcal{G} be the set of all such interpretations. A probabilistic Kripke model is a probability function p(\cdot) over \mathcal{G} . For any modal formula \sigma and world w , we define S_{\sigma,w}=\{g\in\mathcal{G}|g(\sigma,w)=T\} . Theorem 1 (Soundness of MLNN Bounds) . Let an MLNN be initialized with a theory \Gamma_{0}=\{(\sigma,L_{0}(\sigma),U_{0}(\sigma))\} . Let P_{\Gamma_{0}} be the set of all probabilistic Kripke models consistent with this theory, i.e., for any p\in P_{\Gamma_{0}} and any world w , L_{0}(\sigma,w)\leq p(S_{\sigma,w})\leq U_{0}(\sigma,w) . If P_{\Gamma_{0}} is non-empty, then for any formula \phi and world w , the bounds [L_{\phi,w},U_{\phi,w}] computed by the MLNN after convergence satisfy: L_{\phi,w}\leq\inf_{p\in P_{\Gamma_{0}}}p(S_{\phi,w})\quad\text{and}\quad U_{\phi,w}\geq\sup_{p\in P_{\Gamma_{0}}}p(S_{\phi,w}) Proof. The proof extends the logic of Lemma 1 and Theorem 2 from the LNN supplementary material by showing that each update step preserves the set of consistent probabilistic models P_{\Gamma} . This property has been established for classical connectives; we must check that it holds for the modal operators as defined in Section 3.1 . For any p\in P_{\Gamma} , we know by induction that L_{\phi,w^{\prime}}\leq p(S_{\phi,w^{\prime}})\leq U_{\phi,w^{\prime}} . For L_{\Box\phi,w}=\operatorname{softmin}(L) : The sound bound is \inf p(S_{\Box\phi,w})\leq\min_{w^{\prime}}p(S_{\phi,w^{\prime}})\geq\min_{w^{\prime}}L_{\phi,w^{\prime}} . Since \operatorname{softmin}(L)\leq\min(L) , we have L_{\Box\phi,w}\leq\min_{w^{\prime}}L_{\phi,w^{\prime}}\leq\inf p(S_{\Box\phi,w}) . This bound is sound . For U_{\Box\phi,w}=\operatorname{conv-pool}(U,-U) : The sound bound is \sup p(S_{\Box\phi,w})\leq\min_{w^{\prime}}p(S_{\phi,w^{\prime}})\leq\min_{w^{\prime}}U_{\phi,w^{\prime}} . A convex pooling \operatorname{conv-pool}(U)=\sum w_{i}U_{i} is always greater than or equal to \min(U) . Thus, U_{\Box\phi,w}\geq\min_{w^{\prime}}U_{\phi,w^{\prime}}\geq\sup p(S_{\Box\phi,w}) . This bound is sound . For L_{\Diamond\phi,w}=\operatorname{conv-pool}(L,L) : The sound bound is \inf p(S_{\Diamond\phi,w})\geq\max_{w^{\prime}}p(S_{\phi,w^{\prime}})\geq\max_{w^{\prime}}L_{\phi,w^{\prime}} . A convex pooling \operatorname{conv-pool}(L)=\sum w_{i}L_{i} is always less than or equal to \max(L) . Thus, L_{\Diamond\phi,w}\leq\max_{w^{\prime}}L_{\phi,w^{\prime}}\leq\inf p(S_{\Diamond\phi,w}) . This bound is sound . For U_{\Diamond\phi,w}=\operatorname{softmax}(U) : The sound bound is \sup p(S_{\Diamond\phi,w})\leq\max_{w^{\prime}}p(S_{\phi,w^{\prime}})\leq\max_{w^{\prime}}U_{\phi,w^{\prime}} . Since \operatorname{softmax}(U)\geq\max(U) , we have U_{\Diamond\phi,w}\geq\max_{w^{\prime}}U_{\phi,w^{\prime}}\geq\sup p(S_{\Diamond\phi,w}) . This bound is sound . ∎ 4.2 Convergence of MLNN Inference Assumptions: finite W , bounded continuous operators with monotone updates, fixed \tau>0 , and bounded weights. Theorem 2 (Convergence of MLNN Inference) . For a finite set of propositions and a finite set of worlds, the MLNN Upward Downward inference algorithm 14 converges to a fixed point. Proof. The proof relies on the monotonic nature of the bound update operations. The network consists of a finite set of neurons k , each storing truth bounds [L_{k},U_{k}] . The Upward-Downward algorithm 14 is an iterative application of bound update functions f_{k} . Each update function f_{k} (for \land,\lor,\rightarrow,\Box,\Diamond ) is a composition of monotonic functions. The base LNN operators are known to be monotonic 14 . The new modal operators, \operatorname{softmin} , \operatorname{softmax} , and \operatorname{conv-pool} , are also monotonic with respect to their inputs. Therefore, the entire update function for any bound is monotonic. During inference, each lower bound L_{k} forms a non-decreasing sequence, L_{k}^{(t+1)}\geq L_{k}^{(t)} , which is bounded above by 1. Simultaneously, each upper bound U_{k} forms a non-increasing sequence, U_{k}^{(t+1)}\leq U_{k}^{(t)} , which is bounded below by 0. By the monotone convergence theorem, each of these finite sequences must converge to a fixed point. Since the number of bounds in the network is finite, the joint state of all bounds must converge to a global fixed point. ∎ 4.3 Expressivity and Guarantees of the Learnable Relation The parametrized accessibility relation A_{\theta} is a particularly powerful feature for interoperability, allowing us to maintain the classification strength of neural networks while adhering to symbolic structures. This capability is theoretically grounded in the Universal Approximation Theorem 5 ; 10 , which posits that a neural network with sufficient capacity (as used for A_{\theta} ) can approximate the characteristic function of any arbitrary accessibility relation R . This flexibility allows the MLNN to inductively discover the appropriate modal logic system (e.g., T , S4 , S5 ) that best explains the data by minimizing contradiction. This learning can be guided. We can enforce specific modal axioms by adding regularization terms to the contradiction loss that penalize violations of the corresponding relational properties. For example, the axiom T , \Box\phi\rightarrow\phi , requires the relation to be reflexive ( wRw ). This can be encouraged by a regularization loss L_{T}=\sum_{i=1}^{|W|}(1-(\tilde{A})_{ii}) . Minimizing L_{T} forces each diagonal term (1-(\tilde{A})_{ii}) towards zero, directly encouraging (\tilde{A})_{ii}\approx 1 . Similarly, axiom 4 , \Box\phi\rightarrow\Box\Box\phi , requires transitivity. This can be encouraged by L_{4}=\sum_{i,j}\max(0,(\tilde{A}^{2})_{ij}-\tilde{A}_{ij}) , which enforces a soft version of transitivity where a direct path \tilde{A}_{ij} must be at least as strong as any two-step path (\tilde{A}^{2})_{ij} . An optional symmetry regularizer L_{S}=\sum_{i