KROMA: Ontology Matching with Knowledge Retrieval and Large Language Models

Lam Nguyen, Erika Barcelos, Roger French, Yinghui Wu · 2025

Read KROMA: Ontology Matching with Knowledge Retrieval and Large Language Models by Lam Nguyen, Erika Barcelos, Roger French, Yinghui Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-14032.txt.

Introduction

Lam Nguyen, Erika Barcelos, Roger French, and Yinghui Wu present, in twenty twenty-five, KROMA, a framework that matches concepts across ontologies with language models and fetched knowledge. Ontology matching aligns the word sets of data systems. It is a key base for systems to work together. Old systems rely on handcrafted rules or narrow models. KROMA wraps a large language model in a retrieval pipeline. Fetched structural, lexical, and definitional knowledge enriches each matching choice. A similarity-based step and a light refinement step prune candidate concepts first.

That pruning cuts the cost of calling the language model by a lot. Tests on several benchmark data sets show KROMA beating classic matchers and newer language-model approaches. Communication overhead stayed comparable to rivals. The study argues that targeted retrieval plus prompt enrichment makes matching scale.

Catalog record

CREATORLam Nguyen, Erika Barcelos, Roger French, Yinghui Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-14032

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

KROMA: Ontology Matching with Knowledge Retrieval and Large Language Models Lam Nguyen, Erika Barcelos, Roger French, Yinghui Wu Abstract Ontology Matching (OM) is a cornerstone task of semantic interoperability, yet existing systems often rely on handcrafted rules or specialized models with limited adaptability. We present KROMA, a novel OM framework that harnesses Large Language Models (LLMs) within a Retrieval - Augmented Generation (RAG) pipeline, to dynamically enrich the semantic context of OM tasks with structural, lexical, and definitional knowledge. To optimize both performance and efficiency, KROMA integrates a bisimilarity - based concept matching and a lightweight ontology refinement step, which prune candidate concepts and substantially reduce the communication overhead from invoking LLMs. Through experiments on multiple benchmark datasets, we show that integrating knowledge retrieval with context-augmented LLMs significantly enhances ontology matching—outperforming both classic OM systems and cutting-edge LLM-based approaches—while keeping communication overhead comparable. Our study highlights the feasibility and benefit of the proposed optimization techniques (targeted knowledge retrieval, prompt enrichment, and ontology refinement) for ontology matching at scale. Code is available at: https://anonymous.4open.science/r/kroma/ 1 Introduction Ontologies have been routinely developed to unify and standardize knowledge representation to support data-driven applications. They allow researchers to harmonize terminologies and enhance knowledge and sharing in their fields. Ontologies can be classified according to their level of specificity, ranging from more abstract, general-purpose ontologies such as Basic Formal Ontology (BFO) [ 38 ] or DOLCE [ 6 ] down to more domain-oriented ‘mid-level” ones, such as CheBi [ 14 ] in chemistry, Industrial Ontology Foundy (IOF) [ 17 ] or Common Core Ontology(CCO) [ 27 ] . Domain ontologies are data-driven, task-specific “low-level” ontologies, containing concepts from domain-specific data, such as Materials Data Science Ontology (MDS-Onto) [ 46 ] . To achieve broad usability, ontologies need to be aligned for better interoperability via ontology matching. Ontology matching has been studied to find correspondence between terms that are semantically equivalent [ 52 ] . It is a cornerstone task to ensure semantic interoperability among terms originated from different sources. Ontology matching methods can be categorized to rule-based or structural-based (graph pattern or path-based) matching [ 10 ] , matching with semantic similarity, machine learning-based approaches and hybrid methods. Linguistic (terminological) methods are often used for ontology matching tasks, ranging from simple string matching or embedding learning to advance counterparts based on natural language processing (NLP). Nevertheless, conventional rule- or structural-based methods are often restricted to certain use cases and hard to be generalized for new or unseen concepts. Learning-based approaches may on the other hand require high re-training process, for which abundant annotated or training data remains a luxury especially for e.g., data-driven scientific research. Meanwhile, the emerging Large Language Models ( \mathsf{LLMs} ) have demonstrated remarkable versatility for NL understanding. LLMs are trained on vast and diverse corpora, endowing them with an understanding of language nuances and contextual subtleties. Extensive training enables them to capture semantic relationships and abstract patterns that are critical for aligning concepts across different data sources. A missing yet desirable opportunity is to investigate whether and how \mathsf{LLMs} can be engaged to automate and improve ontology matching. This paper introduces \mathsf{KROMA} , a novel framework that exploits \mathsf{LLMs} to enhance ontology matching. Unlike existing \mathsf{LLM} -based methods that typically “outsource” ontology matching to \mathsf{LLMs} with direct prompting (which may have low confidence and risk of hallucination), \mathsf{KROMA} maintain a set of conceptually similar groups that are co-determined by concept similarity and \mathsf{LLMs} , both guided by their “context” obtained via a runtime knowledge retrieval process. Moreover, the groups are further refined by a global ontological equivalence relation that incorporate structural equivalence. Contributions . Our main contributions are summarized below. (1) We propose a formulation of semantic equivalence relation in terms of a class of bisimilar equivalence relation, and formally define the ontology structure, called concept graph, to be maintained ( Sections 2 and 3 ). We justify our formulation by showing the existence of an “optimal” concept graph with minimality and uniqueness guarantee, subject to the bisimilar equivalence. (2) We introduce \mathsf{KROMA} , an \mathsf{LLM} -enhanced ontology matching framework ( Section 4 ). \mathsf{KROMA} fine-tunes \mathsf{LLMs} with prompts over enriched semantic contexts. Such contexts are obtained from knowledge retrieval, referencing high-quality, external knowledge resources. (3) \mathsf{KROMA} supports both offline and online matching, to “cold-start” from scratch, and to digest terms arriving from a stream of data, respectively. We introduce efficient algorithms to correctly construct and maintain the optimal concept graphs ( Section 5 ). (a) The offline refinement performs a fast grouping process guided by the bisimilar equivalence, blending concept equivalence tests co-determined by semantic closeness and \mathsf{LLMs} . (b) The online algorithm effectively incrementalizes its offline counterpart with fast delay time for continuous concept streams. Both algorithms are in low polynomial time, with optimality guarantee on the computed concept graphs. (4) Using benchmarking ontologies and knowledge graphs, we experimentally verify the effectiveness and efficiency of \mathsf{KROMA} ( Section 6 ). We found that \mathsf{KROMA} outperforms existing \mathsf{LLM} -based methods by 10.95% on average, and the optimization of knowledge retrieval and refinement improves its accuracy by 6.65% and 2.68%, respectively. Related Work . We summarize related work below. Large Language Models . Large language models (LLMs) have advanced NLP by enabling parallel processing and capturing complex dependencies [ 53 , 48 ] , which have scaled from GPT-1’s 117M [ 44 ] , GPT-2’s 1.5B [ 45 ] to GPT-3’s 175B [ 35 ] and GPT-4’s 1.8T parameters [ 36 ] . Open-source models like Llama have grown to 405B [ 32 ] , with Mistral Large (123B) [ 33 ] and DeepSeek V3 (671B) [ 12 ] also emerging. Recent advances in specialized reasoning LLMs (RLLMs) such as OpenAI’s O1 and DeepSeek R1 have further propelled Long Chain - of - Thought reasoning—shifting from brief, linear Short CoT to deeper, iterative exploration, and yielded substantial gains in multidisciplinary tasks [ 37 , 13 , 47 , 50 , 8 , 42 , 56 , 30 ] . Ontology Matching with LLMs . Several methods have been developed to exploit LLMs for ontology matching. Early work focused on direct prompting LLMs for ontology matching. For example, [ 39 ] frame product matching as a yes/no query, and [ 34 ] feed entire source and target ontologies into ChatGPT—both achieving high recall on small OAEI conference-track tasks but suffering from low precision. Beyond these “direct-prompt” approaches, state-of-the-art LLM-OM systems fall into two main categories: (1) retrieval-augmented pipelines, which first retrieve top - k candidates via embedding - based methods and then refine them with LLM prompts (e.g. LLM4OM leverages TF–IDF and SBERT retrievers across concept, concept - parent, and concept - children representations [ 20 ] , while MILA adds a prioritized depth - first search step to confirm high - confidence matches before any LLM invocation [ 49 ] ); and (2) prompt-engineering systems, which generate candidates via a high - precision matcher or inverted index and then apply targeted prompt templates to LLMs in a single step (e.g. OLaLa embeds SBERT candidates into MELT’s prompting framework with both independent and multi - choice formulations [ 25 ] , and LLMap uses binary yes/no prompts over concept labels plus structural

Read the complete text