KG-First, LLM-Fallback: A Hybrid Microservice for Grounded Skill Search and Explanation

Ngoc Luyen Le § \lx@sectionsign ‡ [email protected], Marie-Hélène Abel ‡ [email protected], Bertrand Laforge ∗ \ast [email protected] · 2026

Read KG-First, LLM-Fallback: A Hybrid Microservice for Grounded Skill Search and Explanation by Ngoc Luyen Le § \lx@sectionsign ‡ [email protected], Marie-Hélène Abel ‡ [email protected], Bertrand Laforge ∗ \ast [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01582.txt.

Introduction

Ngoc Luyen Le, Marie-Hélène Abel, and Bertrand Laforge unify the big skill frameworks that link schooling to jobs, ESCO, ROME, and O*NET, behind one searchable service for educators. The frameworks are authoritative but hard to use: their structures differ and their terms rarely match how teachers phrase a query.

The SkillGraph service merges them into one knowledge graph that keeps the source of every fact. Search runs graph-first. A hybrid engine blends full-text and vector search to bridge wording gaps. A language model is used only for tight ranking and audience-aware explanation, never as the source of facts. On a multilingual test set the hybrid beats a strong ranking bar with fast responses, making heavy re-ranking look needless here. One trade-off stands out: model-written explanations read smoothly, but plain templates still cover the evidence most faithfully.

Catalog record

CREATORNgoc Luyen Le § \lx@sectionsign ‡ [email protected], Marie-Hélène Abel ‡ [email protected], Bertrand Laforge ∗ \ast [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.01582

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

KG-First, LLM-Fallback: A Hybrid Microservice for Grounded Skill Search and Explanation Ngoc Luyen Le § \lx@sectionsign ‡ [email protected], Marie-Hélène Abel ‡ [email protected], Bertrand Laforge ∗ \ast [email protected] Abstract Authoritative competency frameworks such as ESCO, ROME, and O*NET are essential for aligning education with labor market needs, yet their technical complexity and structural heterogeneity hinder practical adoption by educators. This paper introduces SkillGraph-Service , an interoperable microservice designed to bridge this gap by unifying these resources into a provenance-preserving Knowledge Graph (KG). Adopting a KG-first, LLM-fallback architecture, the system combines symbolic rigor with sub-symbolic flexibility. It implements a lightweight hybrid retrieval engine (fusing SQLite FTS5 and HNSW vector search) to handle the vocabulary mismatch in educator queries, and utilizes Large Language Models (LLMs) strictly for constrained ranking and audience-aware explanation. Empirical evaluation on a multilingual dataset reveals that the proposed hybrid strategy achieves superior retrieval effectiveness (nDCG@5 > > 0.94) with sub-200 ms latency, rendering computationally expensive cross-encoder re-ranking may be unnecessary for this domain. Furthermore, an analysis of generated explanations highlights a trade-off between fluency and faithfulness: while JSON-constrained LLMs ensure high citation precision, deterministic templates remain the most reliable method for maximizing evidence coverage. The resulting architecture offers a practical, scalable, and auditable solution for integrating complex skill data into digital learning ecosystems. I Introduction Competency-based education requires that learning activities, assessments, and outcomes be explicitly aligned with well-defined skills drawn from authoritative frameworks. In practice, however, widely used corpora such as ESCO 1 1 1 ESCO: European Skills, Competences, Qualifications and Occupations, https://ec.europa.eu/esco , ROME 2 2 2 ROME : Répertoire Opérationnel des Métiers et des Emplois, https://www.francetravail.org , and O*NET 3 3 3 Occupational Information Network, https://www.onetcenter.org/ are heterogeneous in structure, vary in granularity and multilingual coverage, and expose technical interfaces that are difficult for non-experts to exploit [ 16 , 20 ] . As a result, educators and instructional designers often rely on ad hoc keyword search and manual tagging. This limits the discoverability of relevant skills, obscures prerequisite and decomposition structures, and hinders the design of transparent, portable learning pathways. The methodological challenge is thus to provide a lightweight, interoperable service that makes skills from multiple frameworks discoverable, interpretable, and actionable – while strictly preserving provenance. Concretely, given a natural-language query q , the system should return: (i) top- k relevant skills across frameworks; (ii) structural context (prerequisites, sub-skills, and granularity); and (iii) a concise, audience-aware explanation. Crucially, to support trustworthy curricular design, the solution must be grounded: it must cite evidence via stable identifiers and avoid hallucination risks typical of unconstrained generative AI. In this work, we present “KG-First, LLM-Fallback: A Hybrid Microservice for Grounded Skill Search and Explanation” . This architectural approach combines symbolic retrieval over a unified, provenance-aware representation of ESCO, ROME, and O*NET with the tightly controlled capabilities of Large Language Models (LLMs). The “KG-First” component handles educator-style queries via hybrid retrieval (lexical BM25 plus sentence-level embeddings), ensuring that all search results are directly anchored in authoritative standards [ 19 , 18 ] . The “LLM-Fallback” component is invoked strictly for augmentation tasks where symbolic methods fall short – specifically, constrained query reformulation, ranking within closed candidate sets [ 14 , 11 ] , and generating audience-aware explanations. These generations are strictly constrained (via templates or JSON schemas) to remain grounded in the provided graph facts [ 5 ] . We investigate two primary research questions: whether this hybrid retrieval strategy improves educator-style skill search over unimodal baselines (RQ1); and whether template-based and JSON-constrained explanations yield higher clarity and faithfulness (evidence-linked) compared to free-form generation under practical latency constraints (RQ2). We implement SkillGraph-Service , a prototype exposing these capabilities via a minimal REST API, and demonstrate its integration readiness through an LMS-oriented workflow scenario with initial empirical results. The remainder of this paper is organized as follows: Section II reviews related work in semantic interoperability and neural retrieval. Section III details the system architecture and the KG-first design. Section IV describes the implementation stack and data unification strategy. Section V presents the experimental evaluation and results. Finally, Section VI concludes with a discussion of limitations and future directions. II Related Work The design of intelligent competency services sits at the intersection of Semantic Web interoperability, neural information retrieval, and controlled generative AI. This section reviews the state of the art in these domains and identifies the specific operational gaps that SkillGraph-Service aims to address. Standardised vocabularies such as ESCO, ROME, and O*NET are the backbone of digital labour markets [ 14 , 11 ] . These frameworks are typically published using the Simple Knowledge Organization System (SKOS) and accessed via SPARQL endpoints [ 16 , 20 ] . While standards like IEEE Shareable Competency Definitions specify metadata structures for exchange [ 8 ] , they do not resolve the underlying semantic heterogeneity between frameworks. Current alignment strategies often rely on either lexical matching, which fails on cross-lingual synonyms, or hard logic merging, which obscures the provenance of the original definitions. Furthermore, raw SPARQL access presents a high technical barrier for educational platform developers. There is a need for intermediate architectures that maintain the provenance of disparate frameworks (avoiding destructive merges) while exposing them through simplified, developer-friendly APIs. Retrieval for skill discovery has evolved from purely lexical methods to complex hybrid architectures. The probabilistic BM25 model remains the robust baseline for exact terminology matching and short queries [ 19 ] . However, BM25 struggles with the “vocabulary mismatch” inherent in educator queries (e.g., describing a skill without knowing its official title). To address this, dense retrieval utilizes bi-encoder architectures, such as Sentence-BERT [ 18 ] , to map queries and documents into a shared semantic vector space. To scale these semantic lookups to large corpora, Approximate Nearest Neighbor algorithms are required; Hierarchical Navigable Small World (HNSW) graphs [ 15 ] have emerged as a standard for balancing efficiency and recall. Recent benchmarks demonstrate that fusing sparse (lexical) and dense (semantic) signals yields superior performance. Foundational strategies for combining these signals range from the linear score combination proposed by Fox and Shaw [ 7 ] to rank-based methods like Reciprocal Rank Fusion [ 4 ] . To further maximize precision, modern pipelines often employ a “retrieve-then-rerank” architecture. A second-stage Cross-Encoder – which processes the query and document simultaneously – typically provides the highest relevance scoring [ 17 ] . However, in latency-sensitive microservices, the computational cost of cross-encoders is often prohibitive. The application of LLMs to knowledge retrieval – Retrieval-Augmented Generation (RAG) – offers natural language interfaces for complex data [ 12 ] . However, hallucination remains a critical barrier in educational settings where factual accuracy is paramount. While techniques like prompting with knowledg-graph context improve controllability [ 13 ] , free-form generation often fails to strictly adhere to citation constraints. Emerging research highlights the necessity of constrained decoding (e.g., enforcing JSON schemas) to ensure that generative outputs remain auditable. There is a gap in the literature regarding the quantitative evaluation of such constraints specifically for competency explanations, comparing the trade-off between the fluency of free text and the faithfulness of structured outputs. Many existing systems operate in silos: they either browse a single framework, focus solely on vector search, or rely on

Read the complete text