Semantics-Aware Caching for Concept Learning
Louis Mozart Kamdem Teyou, Caglar Demir, Axel-Cyrille Ngonga Ngomo louis888, cdmir, axel.ngonga}@upb.de · 2026
Read Semantics-Aware Caching for Concept Learning by Louis Mozart Kamdem Teyou, Caglar Demir, Axel-Cyrille Ngonga Ngomo louis888, cdmir, axel.ngonga}@upb.de (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06506.txt.
Introduction
Teyou and colleagues ease concept learning's runtime burden with a cache, addressing search through an infinite concept space in knowledge bases. Learners retrieve instances of solutions to pick the concept, needing a few dozen calls for simple problems but thousands for complex ones. Their cache is a subsumption-aware map linking concepts to instance sets via crisp set operations. Experiments on datasets with symbolic reasoners, a neuro-symbolic reasoner, and five pagination policies cut learning runtime by an order of magnitude, for symbolic and neuro-symbolic reasoners.
Catalog record
| CREATOR | Louis Mozart Kamdem Teyou, Caglar Demir, Axel-Cyrille Ngonga Ngomo louis888, cdmir, axel.ngonga}@upb.de |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40963 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.06506
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semantics-Aware Caching for Concept Learning Louis Mozart Kamdem Teyou, Caglar Demir, Axel-Cyrille Ngonga Ngomo louis888, cdmir, axel.ngonga}@upb.de Abstract Concept learning is a form of supervised machine learning that operates on knowledge bases in description logics. State-of-the-art concept learners often rely on an iterative search through a countably infinite concept space. In each iteration, they retrieve instances of candidate solutions to select the best concept for the next iteration. While simple learning problems might require a few dozen concept retrieval calls to find a suitable solution, complex learning problems might require thousands of calls, making concept retrieval a major runtime bottleneck. We alleviate the resulting runtime challenge by presenting a semantics-aware caching approach. Our cache is essentially a subsumption-aware map that links concepts to a set of instances via crisp set operations. We evaluate our approach on four datasets using four symbolic reasoners, one neuro-symbolic reasoner, and five cache eviction policies. The results show that our cache reduces concept retrieval and concept learning runtimes by up to an order of magnitude while remaining effective across both symbolic and neuro-symbolic reasoning reasoners. 1 Introduction Knowledge bases have become first-class citizens of the Web, with roughly 50% of websites containing structured data expressed in RDF knowledge bases. 1 1 1 https://webdatacommons.org/structureddata/ Given the advent of machine learning across disciplines and on corpora of increasing size, it stands to reason that the over 10^{11} assertions available on the Web need to be made amenable to machine learning. Embedding approaches and geometric deep learning are used to map the constituents of knowledge bases to vectorial representations [ 32 ] . While effective for many predictive tasks, these methods typically approximate the relational structure of knowledge bases and do not explicitly preserve the logical semantics of RDF and description logics. In contrast, concept learning (also called class expression learning, short: CEL) [ 10 , 25 , 14 ] operates directly on symbolic representations and produces interpretable models in the form of description logic class expressions. The goal of CEL is to learn a class expression that describes a set of positive examples while excluding negative ones [ 20 , 19 ] . In practice, this requires searching in an infinite, quasi-ordered hypothesis space defined by the expressivity of the underlying description logic (short: DL). Most state-of-the-art CEL algorithms use a top-down refinement operator that starts from the most general concept (e.g., \top ) and iteratively specializes it through a sequence of refinement steps [ 20 ] . This iterative process continues until a hypothesis that best approximates the target concept in terms of covering positive examples while avoiding negatives is reached. CEL has demonstrated its effectiveness across various application domains. In software engineering, it has been employed to support the development of software information systems by facilitating semantic integration and information retrieval [ 22 ] . In ontology engineering, CEL contributes to the (semi-)automatic construction, refinement, and validation of ontologies by learning new concept definitions from instance data [ 20 ] . In the medical field, CEL has been applied to tasks such as the prediction of protein functions, where logical definitions of protein classes enhance interpretability and biological insight [ 18 ] . Additionally, it has been used in content recommendation systems, where learned class expressions help model user preferences and content categories in a transparent and semantically meaningful manner [ 23 ] . A central computational bottleneck of CEL is the repeated use of description logic reasoners to evaluate candidate class expressions. Each candidate must be submitted to a reasoner to retrieve its instances, an operation that can be computationally expensive. During the search process, hundreds or even thousands of candidate expressions may be evaluated, resulting in many repeated instance-retrieval calls. Consequently, the efficiency of concept retrieval has a direct impact on the overall runtime of concept learning algorithms. Despite the importance of this operation, we could not identify prior work that systematically investigates caching mechanisms for accelerating concept retrieval. In this work, we address this bottleneck by introducing a semantics-aware caching mechanism designed to accelerate concept retrieval in description logic reasoners. Our cache can be viewed as a subsumption-aware map that associates class expressions with their corresponding sets of instances. By exploiting the semantics of \mathcal{ALC} , the cache can derive the instances of new concepts from previously computed ones through simple set operations, thereby avoiding redundant reasoning calls. Traditional approaches such as ELK [ 15 ] demonstrate how materialization-based techniques can significantly improve reasoning efficiency by precomputing subsumptions and class memberships. Although our work shares the general goal of improving scalability, the two approaches differ fundamentally. ELK is an optimized reasoner designed specifically for the \mathcal{EL}^{++} description logic. In contrast, our approach does not introduce a new reasoner. Instead, it provides a complementary caching layer that accelerates concept retrieval for existing reasoners without modifying their internal algorithms. For this reason, a direct experimental comparison with ELK is not meaningful. We evaluate the proposed caching mechanism on four datasets using four symbolic reasoners and one neuro-symbolic reasoner. Experiments are conducted for both concept retrieval and full concept-learning pipelines. Our results show that the proposed cache can substantially improve performance, reducing concept retrieval time by up to 80\% for slower reasoners and by up to 20\% for faster ones when sufficient cache capacity is available. When integrated into concept learning systems, the cache can reduce overall learning runtimes by up to three orders of magnitude. Our code, datasets, and experimental setup are available in the supplementary material. 2 2 2 https://github.com/Louis-Mozart/Cache-algorithm-for-concept-learners 2 Background 2.1 Concept Learning Algorithms CEL algorithms have significantly evolved during the last decade. Among the early approaches, CELOE [ 19 ] , OCEL, and ELTL [ 6 ] are foundational examples of search-based CEL methods. These algorithms rely on refinement operators to iteratively generate and evaluate candidate class expressions and are all implemented into the DL-Learner framework [ 20 ] . OCEL uses heuristic rules to guide the search process, reducing the exploration of irrelevant or overly complex expressions. CELOE extends upon OCEL by improving the heuristic function, prioritizing syntactically shorter and semantically relevant expressions, which has made it one of the most effective search-based CEL algorithms within the DL-Learner framework [ 17 ] . EvoLearner [ 12 ] , a more recent development, takes an evolutionary approach to CEL. Instead of relying only on refinement operators, EvoLearner initializes its population of candidate expressions through random walks on the knowledge graph, which are then converted into description logic concepts represented as abstract syntax trees. These candidate concepts are refined further using mutation and crossover operations, enabling EvoLearner to outperform traditional refinement operator-based methods like CELOE and OCEL in both efficiency and accuracy. Another example is ECII [ 26 ] , a search-based algorithm that does not employ refinement operators, invoking a reasoner only once during execution. This design choice allows ECII to bypass the iterative computational overhead that is common in traditional methods. As ontologies grow increasingly complex and data sets expand, the runtime limitations of these traditional approaches have become more apparent. Therefore, accelerating CEL has been crucial in the field of machine learning, with diverse methods explored to overcome the computational costs inherent to this domain. Recent efforts have