Neurosymbolic Object-Centric Learning with Distant Supervision

Stefano Colamonaco, David Debot, Giuseppe Marra · 2025

Read Neurosymbolic Object-Centric Learning with Distant Supervision by Stefano Colamonaco, David Debot, Giuseppe Marra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-16129.txt.

Introduction

Stefano Colamonaco, David Debot, and Giuseppe Marra teach a vision system to find objects in pictures using only whole-image labels and logic rules. Neurosymbolic methods learn well from rules, but they usually demand that the objects the rules mention be marked in advance. Object-centric models split a scene into slots, yet those slots may not match the things the rules care about. Their 2025 model, DeepObjectLog, joins the two halves.

A slot-based encoder guesses each candidate object's presence and class, and a probabilistic logic layer weighs all assignments to explain the image's single label. Learning flows from that task-level signal alone, with no masks, boxes, or per-object labels. Across varied visual reasoning tasks, the model generalized better than neural and neurosymbolic rivals when tests shifted the mix of objects, their counts, or the rules themselves.

Catalog record

CREATORStefano Colamonaco, David Debot, Giuseppe Marra
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-16129

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neurosymbolic Object-Centric Learning with Distant Supervision Stefano Colamonaco, David Debot, Giuseppe Marra Abstract Relational learning enables models to generalize across structured domains by reasoning over objects and their interactions. While recent advances in neurosymbolic reasoning and object-centric learning bring us closer to this goal, existing systems rely either on object-level supervision or on a predefined decomposition of the input into objects. In this work, we propose a neurosymbolic formulation for learning object-centric representations directly from raw unstructured perceptual data and using only distant supervision. We instantiate this approach in DeepObjectLog , a neurosymbolic model that integrates a perceptual module, which extracts relevant object representations, with a symbolic reasoning layer based on probabilistic logic programming. By enabling sound probabilistic logical inference, the symbolic component introduces a novel learning signal that further guides the discovery of meaningful objects in the input. We evaluate our model across a diverse range of generalization settings, including unseen object compositions, unseen tasks, and unseen number of objects. Experimental results show that our method outperforms neural and neurosymbolic baselines across the tested settings. 1 Introduction Relational learning has long served as a cornerstone of machine learning approaches that aim to generalize across structured domains. From Statistical Relational Learning (SRL) to Graph Neural Networks (GNNs), these paradigms offer a powerful mechanism for modeling interactions among entities—without being tied to fixed input dimensionality. By operating over graphs, sets, or logic-based representations, relational models achieve size-invariance and strong inductive generalization, leveraging local patterns such as message-passing rules or logical constraints that apply uniformly across varying input structures. For instance, a GNN trained on small molecule graphs can generalize to larger, unseen molecular structures by reusing local chemical interaction patterns. Neurosymbolic AI, which combines neural network perception with logic reasoning, has been recently analysed Marra et al. 2024 in terms of SRL dimensions, showing it inherits the relational strengths of its predecessors while incorporating a deep representation learning component. However, just like SRL, neurosymbolic frameworks Manhaeve et al. 2018 , Skryagin et al. 2022 often make a critical assumption: that the input is already structured . The entities and their relationships are typically assumed to be given, often represented as a knowledge graph, a scene graph, or a logical database, potentially extended with object-level subsymbolic representations (e.g. images). This assumption becomes a significant limitation when dealing with raw perceptual data, where such a structure must be inferred rather than assumed. In many real-world settings, inputs do not come with explicit object boundaries or relational structure; instead, this information must be inferred from complex, unstructured data, often under supervision that is incomplete or only indirectly related to the structure the model needs to learn. Neurosymbolic models must therefore bridge the gap between perception and reasoning by constructing symbolic representations directly from raw input. This ability to induce structure from subsymbolic data is arguably the core promise and the main challenge of neurosymbolic AI. Object-centric learning De Sousa Ribeiro et al. 2024 offers a promising foundation for structured representation learning. Models such as MONet, IODINE, and Slot Attention decompose visual scenes into object-like components, enabling representations that support compositional reasoning Burgess et al. 2019 , Greff et al. 2019 , Locatello et al. 2020 . However, these models often rely on object-level supervision, meaning they require a label or annotation for each object in the image. This restricts their applicability in reasoning tasks, where such supervision is usually unavailable or impractical. In contrast, neurosymbolic approaches seek to operate in weakly supervised regimes , where only global labels or logical constraints are available as training signals Manhaeve et al. 2018 . In these settings, models must not only parse unstructured inputs into symbolic entities but also do so in a way that supports downstream reasoning, even when the structure is ambiguous and no direct supervision over object identity or count is provided. For instance, a model trained to predict the sum of digits in an image without access to the digit labels or positions must learn to decompose the input in a way that supports correct logical inference. A total sum of 5 could correspond to many different groupings: a single digit "5", a pair like "2+3", or even five "1"s. The ambiguity in such supervision provides little direct signal about the number of entities present, yet the model must still learn a decomposition useful for reasoning. This paper argues that neurosymbolic learning must go beyond simply layering symbolic reasoning on top of neural models. It must also address the precondition for relational modeling itself: the discovery of entities and their relations from unstructured input, under minimal supervision. This requires an integration of object-centric learning and relational reasoning not as sequential modules, but as jointly-trained components that inform each other. In this work, we make several contributions. First, we highlight the limitations of current neural and neurosymbolic systems in achieving fully relational learning from unstructured input. Second, we propose a new probabilistic formulation for learning object-centric representations directly from raw perceptual data, enabling a model to identify, classify, and reason about multiple objects using only distant supervision from discriminative tasks. Third, we instantiate this formulation in DeepObjectLog , a model that integrates object-centric neural perception with symbolic reasoning based on DeepProbLog, allowing end-to-end object-centric learning driven by logical structure. Finally, we introduce benchmarks based on MultiMNIST and the newly developed PokerRules dataset, designed to assess the ability of models to discover relevant objects and reason over their relations. Experimental results show that our approach consistently outperforms both neural and neurosymbolic baselines across a range of generalization settings. 2 Related Works The problem addressed in this study lies at the intersection of two research areas: object-centric representation learning and neurosymbolic reasoning. Both are essential, but neither is sufficient on its own to meet the demands of a system capable of learning relational abstractions directly from raw input when supervision is provided only at the task level. Object-centric learning. Object-centric models aim to decompose visual scenes into discrete object representations Greff et al. 2020 . Early approaches Burgess et al. 2019 , Greff et al. 2019 , Engelcke et al. 2019 use iterative variational inference to discover object structure in an unsupervised manner, but often suffer from scalability limitations. Slot Attention Locatello et al. 2020 replaces these procedures with a parallel attention-based binding mechanism, enabling permutation-invariant inference over latent slots. This model has since been extended across several domains Kori et al. 2023 , Elsayed et al. 2022 , Seitzer et al. 2022 , Singh et al. 2022 , with slot-based representations being applied to generative modeling and dynamic scenes. Some works attempt to improve the selection of useful slots by adaptively selecting which representations carry meaningful content Fan et al. 2024 , Engelcke et al. 2021 , but these still rely on heuristics or sparsity priors that are disconnected from task-level semantics. A recent study Kori et al. 2023 shows that slot-based models can be trained end-to-end with supervision on a downstream task, but it assumes a fixed number of objects and employs a neural classifier without symbolic reasoning, requiring few-shot learning to achieve task generalization. Overall, current object-centric models remain limited when applied to tasks requiring logical reasoning under weak or indirect supervision. Without

Read the complete text