Competency Questions as Executable Plans: a Controlled RAG Architecture for Cultural Heritage Storytelling
Naga Sowjanya Barla, Jacopo de Berardinis · 2026
Read Competency Questions as Executable Plans: a Controlled RAG Architecture for Cultural Heritage Storytelling by Naga Sowjanya Barla, Jacopo de Berardinis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02545.txt.
Introduction
Barla and de Berardinis turn competency questions, normally used to check a knowledge graph at design time, into run-time plans for storytelling about intangible cultural heritage. Their neuro-symbolic system plans, retrieves and generates from a knowledge graph, keeping every story evidence-closed and auditable. Tested on a new Live Aid knowledge graph, the study weighs symbolic, hybrid and graph-based retrieval against each other on precision, richness and coherence.
Catalog record
| CREATOR | Naga Sowjanya Barla, Jacopo de Berardinis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56034 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.02545
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Competency Questions as Executable Plans: a Controlled RAG Architecture for Cultural Heritage Storytelling Naga Sowjanya Barla, Jacopo de Berardinis Abstract The preservation of intangible cultural heritage is a critical challenge as collective memory fades over time. While Large Language Models (LLMs) offer a promising avenue for generating engaging narratives, their propensity for factual inaccuracies or “hallucinations” makes them unreliable for heritage applications where veracity is a central requirement. To address this, we propose a novel neuro-symbolic architecture grounded in Knowledge Graphs (KGs) that establishes a transparent “plan-retrieve-generate” workflow for story generation. A key novelty of our approach is the repurposing of competency questions (CQs) – traditionally design-time validation artifacts – into run-time executable narrative plans. This approach bridges the gap between high-level user personas and atomic knowledge retrieval, ensuring that generation is evidence-closed and fully auditable. We validate this architecture using a new resource: the Live Aid KG , a multimodal dataset aligning 1985 concert data with the Music Meta Ontology and linking to external multimedia assets. We present a systematic comparative evaluation of three distinct Retrieval-Augmented Generation (RAG) strategies over this graph: a purely symbolic KG-RAG , a text-enriched Hybrid-RAG , and a structure-aware Graph-RAG . Our experiments reveal a quantifiable trade-off between the factual precision of symbolic retrieval, the contextual richness of hybrid methods, and the narrative coherence of graph-based traversal. Our findings offer actionable insights for designing personalised and controllable storytelling systems. 1 Introduction Intangible cultural heritage – the ephemeral yet foundational fabric of collective experience – is inherently fragile [ 32 ] . Landmark socio-cultural events, such as the 1985 Live Aid concert, represent a complex interplay of tangible artefacts, like the stages at Wembley and JFK Stadiums, and a rich tapestry of intangible elements: iconic musical performances, a unique global broadcast, and a powerful message of humanitarianism. As direct human memory of such moments recedes, society increasingly relies on digital systems to preserve and transmit this cultural legacy. Digital storytelling has emerged as a critical medium for this purpose, capable of weaving together disparate facts, media, and contexts into engaging narratives that transform passive observers into active participants in history [ 34 ] . The evolution of this field in cultural heritage contexts has moved beyond static digital archives towards interactive, personalised experiences that can create “digital biographies” of objects and events [ 19 ] . The advent of Large Language Models (LLMs) has offered unprecedented capabilities for creating fluent and compelling narratives [ 5 ] . However, this technological leap presents a significant dilemma for applications in cultural heritage. LLMs are prone to factual invention and distortion – a phenomenon widely known as “hallucination” – which renders them fundamentally unsuitable for domains where factuality is paramount [ 20 , 36 ] . For museums, archives, and educational platforms, factual veracity is not merely a desirable feature but an ethical and institutional imperative [ 34 , 37 ] . The core of this issue is a deep epistemological conflict. LLMs are probabilistic systems; their mastery lies in statistical correlation and linguistic fluency, not in the representation of factual, verifiable knowledge [ 18 ] . In contrast, cultural heritage is a domain of evidence, where the value of a statement is intrinsically tied to its provenance [ 12 ] . Retrieval-Augmented Generation (RAG) has become the referential paradigm for mitigating hallucination by conditioning an LLM’s output on externally retrieved information [ 23 ] . While this represents a significant advance, the retrieval of ambiguous, context-poor, or conflicting text chunks can still lead to fragmented or subtly inaccurate narratives [ 28 ] . On the other hand, Knowledge Graphs (KGs) offer a robust foundation for grounding, providing a semantic backbone of unambiguous entities (identified by URIs), explicit, typed relationships, and a formal structure that supports verifiable querying [ 18 , 37 ] . KGs ensure that the evidence provided to the generator is atomic, accurate, and traceable, forming the basis for truly dependable storytelling [ 10 ] . While KGs provide the verifiable what , a research gap remains in defining a methodology for controlling the how in this domain. There is currently no established neuro-symbolic methodology for translating high-level user intent, such as the information needs of a museum visitor, into a structured, auditable, and machine-executable narrative plan that leverages this KG backbone. This paper introduces a novel RAG-based solution by repurposing competency questions (CQs) – natural language questions that an ontology should satisfy [ 15 ] . Traditionally, CQs are a design-time artefact used in various ontology engineering methodologies [ 29 , 31 ] to define the scope of a knowledge base and to validate its completeness [ 2 ] . We investigate their dual use as requirement elicitation paradigm for knowledge graph construction (the “ what ”) and as a run-time primitive to orchestrate the entire generative workflow (the “ how ”). In our approach, a narrative is conceptualised as a “beat plan” – an ordered sequence of CQs – that explicitly dictates the information-seeking steps required to construct the story, as illustrated in Fig. 1 . This transforms the creative act of storytelling into a transparent, reproducible, and auditable process. Beat 1 Beat 2 \dots Beat k Beat n Persona-conditioned narrative plan CQ1 CQ2 CQ3 CQ4 CQ5 Beat k Retrieved CQ answers (SPARQL / enrichment) Prompt assembly (ordered by beats) LLM narrative output Beat realisation into narrative text Figure 1 : Story construction as a list of beats based on a shared CQ pool. Each beat is realised by retrieving CQ answers and prompting an LLM in beat order. The contributions of this paper are threefold: 1. The Live Aid KG: The first publicly available semantic resource dedicated to the 1985 Live Aid concert, modelled using general and domain-specific semantic models ( schema.org , Music Meta Ontology [ 9 ] ) and including multimodal links to external assets to ensure interoperability and richness. 2. A CQ-driven RAG workflow: A novel “plan-retrieve-generate” neuro-symbolic pipeline where a sequence of CQs acts as an executable narrative plan, ensuring that every generated sentence is grounded in evidence retrieved from the KG with full provenance. 3. A comparative evaluation: An empirical analysis of three distinct KG-based RAG strategies – symbolic KG-RAG , text-enriched Hybrid-RAG , and structure-aware Graph-RAG – providing actionable insights into the trade-offs between factual precision, contextual richness, and narrative coherence. Our work aims to empower institutions to valorise semantic resources for visitor engagement, acting as an incentive for the publication of Linked Data. The paper is organised as follows: Section 2 reviews related work; Section 3 describes the Live Aid KG; Section 4 details the storytelling workflow; and Sections 5 and 6 present the comparative evaluation and discuss our findings. 2 Background and related work The use of technology to convey narratives in cultural heritage contexts has a rich history, evolving from early hypermedia systems to modern AI-driven platforms [ 28 ] . The goal is often to create personalised and interactive experiences that move beyond static exhibits, allowing users to actively engage with historical artefacts and stories [ 27 ] . KGs have become increasingly central to this effort, providing a formal structure to represent the complex web of entities and relationships inherent in