T-ILR: a Neurosymbolic Integration for LTLf

Riccardo Andreoni, Andrei Buliga, Alessandro Daniele, Chiara Ghidini, Marco Montali, Massimiliano Ronzani · 2025

Read T-ILR: a Neurosymbolic Integration for LTLf by Riccardo Andreoni, Andrei Buliga, Alessandro Daniele, Chiara Ghidini, Marco Montali, Massimiliano Ronzani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15943.txt.

Introduction

Riccardo Andreoni and co-authors add time based logic to neural learning in a 2025 paper. Joining symbol based rules with deep learning has worked well for still tasks, but rules about order over time are less explored. The only prior method built a full state machine for the time rule, which can be costly.

Their method, T-ILR, works with a form of temporal logic for finite sequences, using a fuzzy reading of the rules. It refines a network step by step toward answers that fit the rule, without building the machine. On a benchmark of image sequences with time knowledge, the method gave better accuracy and used less compute than the prior top method.

Catalog record

CREATORRiccardo Andreoni, Andrei Buliga, Alessandro Daniele, Chiara Ghidini, Marco Montali, Massimiliano Ronzani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15943

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

T-ILR: a Neurosymbolic Integration for LTLf Riccardo Andreoni, Andrei Buliga, Alessandro Daniele, Chiara Ghidini, Marco Montali, Massimiliano Ronzani Abstract State-of-the-art approaches for integrating symbolic knowledge with deep learning architectures have demonstrated promising results in static domains. However, methods to handle temporal logic specifications remain underexplored. The only existing approach relies on an explicit representation of a finite-state automaton corresponding to the temporal specification. Instead, we aim at proposing a neurosymbolic framework designed to incorporate temporal logic specifications, expressed in Linear Temporal Logic over finite traces ( ltl f \xspace ), directly into deep learning architectures for sequence-based tasks. We extend the Iterative Local Refinement (ILR) neurosymbolic algorithm, leveraging the recent introduction of fuzzy ltl f \xspace interpretations. We name this proposed method Temporal Iterative Local Refinement (T-ILR \xspace ). We assess T-ILR \xspace on an existing benchmark for temporal neurosymbolic architectures, consisting of the classification of image sequences in the presence of temporal knowledge. The results demonstrate improved accuracy and computational efficiency compared to the state-of-the-art method. 1 Introduction The integration of symbolic reasoning into deep learning (DL) architectures, commonly referred to as neurosymbolic (NeSy) learning, has emerged as a powerful paradigm to improve generalization capabilities in data-driven models. While a variety of NeSy frameworks have been proposed, the majority of these approaches primarily focus on first-order logics as the underlying symbolic formalism, only supporting reasoning over static domains ( Badreddine et al. 2022 ; Daniele et al. 2023 ; Manhaeve et al. 2018 ) . Nonetheless, the application of NeSy methods to dynamic, temporally structured environments, where knowledge is expressed in temporal logic, remains an open, underexplored problem. Temporal logics, and especially Linear Temporal Logic, are employed across a range of domains—including formal methods ( Pnueli 1977 ) , automated planning ( De Giacomo et al. 2014 ) , process mining ( Di Ciccio and Montali 2022 ) , and reinforcement learning ( De Giacomo et al. 2020 ) . We believe that the exploration and adaptation of different NeSy approaches to temporal, dynamic domains can greatly benefit the research community. The only notable approach to temporal NeSy integration relies on constructing finite-state automata that represent temporal formulae expressed in ltl f \xspace (Linear Temporal Logic on finite traces), which are subsequently used to define supervision signals over input sequences ( Umili et al. 2023 ) . While effective, this strategy may incur high computational costs due to the complexity of building finite-state automata ( De Giacomo and Vardi 2013 ) . Our work starts from the observation that the majority of recent NeSy approaches aim to directly embed the representation of the knowledge within the deep learning architectures ( Badreddine et al. 2022 ; Daniele et al. 2023 ) . Motivated by this observation we propose Temporal Iterative Local Refinement (T-ILR \xspace ) , a novel framework for NeSy learning over sequential data with temporal knowledge expressed using ltl f \xspace . Our approach builds upon the Iterative Local Refinement (ILR) ( Daniele et al. 2023 ) algorithm that has shown excellent computational performances. We extend ILR to operate directly over ltl f \xspace specifications via their fuzzy interpretations. This allows for a differentiable, gradient-based optimization of temporal logic satisfaction within standard deep learning architectures. The proposed architecture includes a neural perception module that grounds the atomic propositions contained in the formula from raw observations, and a symbolic reasoning layer that encodes ltl f \xspace semantics through fuzzy temporal logics. Crucially, the combination of ILR with the fuzzy semantics of ltl f \xspace enables end-to-end differentiable training without the need for an external representation of the logical formulas (e.g., a finite-state-automata). We empirically validate T-ILR \xspace by comparing it with the state of the art by expanding the benchmark for temporal symbol grounding in Umili et al. 2023 both in terms of sequences of increasing lengths and ltl f \xspace formulae built upon alphabets of increasing sizes. The results show a lead of T-ILR \xspace , both in terms of classification accuracy and computational efficiency. The remainder of the paper is organized as follows: Section 2 reviews related work, Section 3 covers background concepts, and Section 4 introduces T-ILR \xspace . Finally, Sections 5 details and discusses the experimental evaluations and the results we have obtained. 2 Related Works NeSy integration methods can be broadly categorized into two main approaches: those based on probabilistic logic and those based on fuzzy logic. Probabilistic approaches typically rely on the optimization of Weighted Model Counting (WMC). Notable examples include DeepProbLog ( Manhaeve et al. 2018 ) , DeepStochLog ( Winters et al. 2022 ) , and Semantic Loss ( Xu et al. 2018 ) . More closely related to our work are approaches grounded in fuzzy logic. These methods often fall into two categories: loss-based and model-based. Loss-based approaches inject logical constraints into the training process by encoding them as a loss function or as a regularization term. This class includes Semantic Based Regularization (SBR) ( Diligenti et al. 2017 ) and Logic Tensor Networks (LTN) ( Badreddine et al. 2022 ) . Despite their success, a key limitation of this class of methods is that logical constraints are typically not retained at inference time. In contrast, model-based approaches embed logical knowledge directly into the architecture, typically through additional layers or components that persist at inference time. Representative examples include KENN ( Daniele and Serafini 2019 ; Daniele and Serafini 2022 ) , C-HMCNN(h) ( Giunchiglia and Lukasiewicz 2021 ) , and CCN+ ( Giunchiglia et al. 2024 ) . These methods enforce logical consistency by construction and are thus not subject to the same limitations as loss-based techniques. Unlike loss-based methods, which have been shown to work better with product fuzzy logic ( van Krieken et al. 2022 ) , the model-based approaches are more commonly based on Gödel logic, as the logical layers require a closed-form formulation, which is not known for product logic, except for special cases ( Daniele et al. 2023 ) . Among this type of approaches, there is ILR ( Daniele et al. 2023 ) , upon which our work builds. It is a multi-layer refining algorithm that minimally modifies the neural network’s output, making it consistent with the provided logical specifications (more details in Section 3.3 ). All the approaches presented above are tailored to the integration of knowledge written using propositional or first order logics. When it comes to temporal logics, such as ltl \xspace and ltl f \xspace (see Section 3.1 ), the number of works available in the literature drops dramatically. The direct, differentiable integration of temporal logic into NeSy architectures is recent, with Umili et al. 2023 providing the main example. Their work proposes a NeSy system for weakly-supervised learning, where input sequences are classified based on the satisfaction of a given ltl f \xspace formula. The formula is translated into a Deterministic Finite Automaton (DFA) and interpreted via fuzzy logic, resulting in a differentiable architecture that enables learning through back-propagation. While demonstrating the feasibility of integrating ltl f \xspace into DL pipelines, Umili et al. 2023 rely on DFA construction, which poses computational challenges due to the costly ltl f \xspace to DFA conversion ( De Giacomo and Vardi

Read the complete text