HEISIR: Hierarchical Expansion of Inverted Semantic Indexing for Training-free Retrieval of Conversational Data using LLMs
Sangyeop Kim, Hangyeul Lee, Yohan Lee · 2025
Read HEISIR: Hierarchical Expansion of Inverted Semantic Indexing for Training-free Retrieval of Conversational Data using LLMs by Sangyeop Kim, Hangyeul Lee, Yohan Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04141.txt.
Introduction
Sangyeop Kim, Hangyeul Lee, and Yohan Lee present a training-free way to search conversation records by meaning, in a 2025 paper. Chat services pile up dialogue data fast. Finding the right past exchange is hard. Keyword search misses intent. Fine-tuned models need costly labels. Their framework, HEISIR, builds a semantic index instead. It needs no model retraining.
The index is built in two steps. First, dialogue is broken into structured triplets. A second step adds context words, forming four-part entries. Each entry names who did what, with what extra detail. Queries then match against this index quickly. Tests beat fine-tuned models across embeddings and language models. Retrieval stayed fast at query time. The structure also supports intent and topic analysis. The authors pitch it as a versatile base for dialogue systems. Support desks and chat archives are natural users.
Catalog record
| CREATOR | Sangyeop Kim, Hangyeul Lee, Yohan Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04141
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HEISIR: Hierarchical Expansion of Inverted Semantic Indexing for Training-free Retrieval of Conversational Data using LLMs Sangyeop Kim, Hangyeul Lee, Yohan Lee Abstract The growth of conversational AI services has increased demand for effective information retrieval from dialogue data. However, existing methods often face challenges in capturing semantic intent or require extensive labeling and fine-tuning. This paper introduces HEISIR (Hierarchical Expansion of Inverted Semantic Indexing for Retrieval), a novel framework that enhances semantic understanding in conversational data retrieval through optimized data ingestion, eliminating the need for resource-intensive labeling or model adaptation. HEISIR implements a two-step process: (1) Hierarchical Triplets Formulation and (2) Adjunct Augmentation, creating semantic indices consisting of Subject-Verb-Object-Adjunct (SVOA) quadruplets. This structured representation effectively captures the underlying semantic information from dialogue content. HEISIR achieves high retrieval performance while maintaining low latency during the actual retrieval process. Our experimental results demonstrate that HEISIR outperforms fine-tuned models across various embedding types and language models. Beyond improving retrieval capabilities, HEISIR also offers opportunities for intent and topic analysis in conversational data, providing a versatile solution for dialogue systems. $\dagger$ $\dagger$ footnotetext: Corresponding author. 1 Introduction Conversational AI is being deployed across diverse industries, including personalized services Kocaballi et al. (2019) , code generation Li et al. (2022) , educational tutoring Mousavinasab et al. (2021) and even in social welfare services Jo et al. (2023) . This rapid expansion has resulted in vast amounts of dialogue data, rich with insights into user needs and behavioral patterns. To harness this wealth of information, Information Retrieval approach tailored to the unique characteristics of conversational data is necessary. We define this area as Conversational Data Retrieval (CDR), which aims to enable efficient access to and extraction of relevant information from large-scale conversational data. CDR is highly important for both end-users and conversational AI service providers. End-users frequently need to retrieve specific information from past conversations, such as previous agreements or discussion outcomes, using natural language queries. Service providers can utilize CDR to analyze user interactions and enhance their AI-powered services. For example, CDR can enhance Retrieval Augmented Generation (RAG) systems by providing relevant dialogue examples Lewis et al. (2020) ; Wang et al. (2024) , and support service improvement by identifying patterns in user behavior and recurring topics Motger et al. (2022) ; Owoicho et al. (2022) . However, conventional sparse and dense retrieval methods exhibit limited performance when applied to conversational data. Unlike traditional document data, conversational data has distinct characteristics that make traditional retrieval approaches insufficient. First, each utterance is assigned to a specific speaker, meaning that the same message can be expressed in entirely different ways depending on who is speaking. Additionally, a speaker’s intention can be multifaceted; a single utterance may have multiple, often complex, intents in it. Furthermore, the meaning of utterances depends heavily on the context of the dialogue and the relationship between participants, often without explicit contextual markers. These unique characteristics pose significant challenges that existing context-aware retrieval models, trained primarily on document-based QA tasks Yang et al. (2015) ; Rajpurkar et al. (2016) ; Nguyen et al. (2016) , struggle to address. Figure 1: Architecture of HEISIR framework: Data Ingestion Phase Apart from the limited effectiveness of existing retrieval methods on conversational data, the structure of the retrieval system itself poses a significant challenge to practical implementation. A typical retrieval system consists of two main phases Wang et al. (2021) : the data ingestion phase, where incoming data is processed and indexed offline, and the retrieval phase, where relevant information is searched based on user queries. Recent research on retrieval system leverages the powerful context understanding capability of LLMs through techniques such as re-ranking Zhang et al. (2023) , query rewriting Yu et al. (2020) , and using larger retrieval models Ma et al. (2023) ; Peng et al. (2023) . However, these approaches, especially when incorporating LLMs, introduce significant latency trade-off in the retrieval phase, making them impractical for real-time services. Building on these insights, we propose a novel framework that extracts and processes the inverted semantic indices in the data ingestion phase, unlike traditional approaches that process indices in the retrieval phase. HEISIR ( H ierarchical E xpansion of I nverted S emantic I ndexing for R etrieval) implements structured semantic indices that capture the inherent syntactic hierarchy within sentences. Overall scheme of our framework is detailed in Figure 1 . HEISIR constructs search indices based on the inherent syntax present in all natural language sentences, eliminating the need for extensive labeling and training. In data ingestion phase, HEISIR extracts semantic indices and stores them as inverted indices . In retrieval phase, HEISIR computes score to retrieve the most relevant conversations. Our approach not only enhances retrieval performance but also offers practical advantages, as it eliminates latency during the retrieval phase. The key contributions of this research are: 1. Improved retrieval performance significantly enhances retrieval capabilities with only negligible increase of latency by optimizing data ingestion. 2. Practical real-world applicability enables deployment of effective dialogue retrieval systems in production environments lacking labeled training data. 3. Practical-scale Robustness consistently enhances performance when integrated with any combination of language model scales. 4. Versatility beyond retrieval provides highly interpretable atomic semantic units, enabling intuitive intent and topic analysis. 2 Linguistic Preliminaries To design semantic indices for CDR, it is necessary to identify two fundamental components in a message: the speaker and the intent. These components correspond to the subject and the verb of a sentence. To capture complex intents while maintaining the structural integrity, HEISIR follows the syntactic comprehension process of humans. Numerous studies support the view that humans comprehend sentences incrementally. Specifically, sentences are processed by first constructing the simplest syntactic structure and then integrating semantic adjuncts to achieve full understanding Kamide et al. (2003) ; Altmann and Mirković (2009) ; Fossum and Levy (2012) . Phrase Structure Grammar (PSG) Chomsky (2002) ; Gazdar (1985) is one of the most widely used models to explain this top-down syntactic processing. PSG breaks down natural language sentences into constituents —syntactically significant units—organized in a hierarchical binary tree structure. The overall scheme of how PSG parses messages for HEISIR is detailed in Figure 2 . Figure 2: Phrase Structure Grammar and Constituents Another key concept central to syntactic processing is verb valency . Verb valency refers to the number of arguments that a verb can take in a sentence, and it describes the relationship between the verb and other elements in the clause, such as the subject, direct object, and indirect object. Verbs can be categorized based on their valency as avalent (taking no arguments), monovalent (taking one argument), divalent (taking two arguments), or trivalent (taking three arguments). Verb valency plays a critical role in determining the constituent hierarchy in sentences, as different valency types lead to different phrase structures. In this study, we develop a semantic indexing framework according to hierarchical syntactic processing schemes that represent the three most common types of verb valency: monovalent, divalent, and trivalent. We parse the constituents from sentences as follows: • Subject : The entity performing the action or the one that the sentence is about. • Verb : The action or state described in the sentence. • Object : The entity directly affected