A Computational Approach to Modeling Conversational Systems: Analyzing Large-Scale Quasi-Patterned Dialogue Flows

1 st Mohamed Achref Ben Ammar, 2 nd Mohamed Taha Bennani · 2025

Read A Computational Approach to Modeling Conversational Systems: Analyzing Large-Scale Quasi-Patterned Dialogue Flows by 1 st Mohamed Achref Ben Ammar, 2 nd Mohamed Taha Bennani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13544.txt.

Introduction

Mohamed Achref Ben Ammar and Mohamed Taha Bennani model messy conversations as graphs in a 2025 paper. Chatbots and support systems produce dialogues that wander rather than follow scripts. Their framework turns such talks into graphs of turns and links, capturing flow and structure at scale. A new simplification method, Filter and Reconnect, prunes noise while keeping meaning and shape intact.

Paired with large language models, the method more than doubled a semantic quality score over earlier approaches. The pruned graphs came out tree-like in the strictest sense, which aids clarity. Uses range from watching chatbot behavior to studying how users actually talk with machines. Loose conversation, it turns out, still has a skeleton worth drawing.

Catalog record

CREATOR1 st Mohamed Achref Ben Ammar, 2 nd Mohamed Taha Bennani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-13544

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Computational Approach to Modeling Conversational Systems: Analyzing Large-Scale Quasi-Patterned Dialogue Flows 1 st Mohamed Achref Ben Ammar, 2 nd Mohamed Taha Bennani Abstract The analysis of conversational dynamics has gained increasing importance with the rise of large language model-based systems, which interact with users across diverse contexts. In this work, we propose a novel computational framework for constructing conversational graphs that capture the flow and structure of loosely organized dialogues, referred to as quasi-patterned conversations. We introduce the Filter & Reconnect method, a novel graph simplification technique that minimizes noise while preserving semantic coherence and structural integrity of conversational graphs. Through comparative analysis, we demonstrate that the use of large language models combined with our graph simplification technique has resulted in semantic metric S increasing by a factor of 2.06 compared to previous approaches while simultaneously enforcing a tree-like structure with 0 δ \delta -hyperbolicity, ensuring optimal clarity in conversation modeling. This work provides a computational method for analyzing large-scale dialogue datasets, with practical applications related to monitoring automated systems such as chatbots, dialogue management tools, and user behavior analytics. I Introduction With the rise of large language model [ 3 , 2 , 1 ] (LLM)-based conversational systems, the analysis of conversational dynamics has gained increasing importance. Understanding how conversations flow, identifying underlying intents, and modeling dialogue structures are critical for improving the effectiveness of these systems in real-world applications. Recent advancements in natural language processing (NLP) [ 4 ] have facilitated progress in conversational systems modeling techniques such as intent extraction [ 5 ] and dialogue act modeling [ 6 ] . While dialogue act modeling classifies utterances into communicative functions using models like Long Short-Term Memory (LSTM) networks [ 7 ] , intent extraction identifies the underlying intent of an utterance through models like biLSTM-CRF [ 8 ] . However, these techniques primarily focus on analyzing conversations in isolation rather than exploring recurring patterns across sets of conversations. Recent studies have introduced methods for constructing conversational graphs to analyze dialogue dynamics. Ferreira et al. (2023) [ 9 ] presented an unsupervised flow discovery method for task-oriented dialogues, utilizing frequent verb phrases extracted via the spaCy toolkit [ 10 ] and keywords identified through KeyBERT to represent dialogue states. This approach constructs transition graphs to model dialogue flows without relying on LLMs or sentiment analysis. In this work, we propose a computational approach for constructing conversational graphs, where each node represents an intent and directed edges indicate transitions labeled with their respective probabilities. Our approach focuses on quasi-patterned sets of conversations, which are collections of dialogues that, while not adhering to strict conversational structures, still display common underlying patterns in the flow of intents. These conversations may vary in specifics, but they tend to follow similar intent transitions and themes, reflecting consistent conversational dynamics across multiple interactions. The primary steps of our approach include utterance embedding using Sentence-BERT (SBERT) [ 11 ] , Kmeans++ clustering [ 12 ] , and intent extraction through LLMs [ 13 , 14 , 15 , 16 , 17 ] . Following these steps, we construct a transition matrix and generate the conversational graph. These processes will be thoroughly detailed in the following sections of this paper. This paper is organized as follows: A review of relevant work is given in Section II. The method is then described in Section III, followed by a case study of our approach in Section IV and the assessment metrics in Section V. The findings and discussion are presented in Section VI, and the study’s conclusions are provided in Section VII. II Related Works The study of conversational systems has evolved from early rule-based systems [ 18 ] to modern deep learning approaches for intent extraction and dialogue act modeling [ 5 , 19 ] . Despite improvements, scaling these models to diverse interactions remains challenging. II-A Intent Extraction and Dialogue Act Modeling Intent extraction identifies the goal behind a user’s utterance. Early methods such as biLSTM-CRF [ 8 ] and RNNs [ 7 ] have been largely replaced by Transformer-based models like BERT [ 19 ] and GPT-based models [ 2 , 3 ] , which offer better contextual understanding but require large annotated datasets and struggle with domain adaptation [ 14 ] . Dialogue act modeling, which classifies utterances (e.g., questions, statements), also transitioned from statistical methods to deep learning techniques [ 6 , 7 , 5 ] . However, both approaches typically analyze utterances in isolation, missing recurring conversational patterns. II-B Graph-Based Dialogue Analysis Graph-based methods analyze dialogue flows by constructing transition graphs from clustered utterances. Ferreira et al. [ 9 ] proposed an unsupervised framework using spaCy [ 10 ] for frequent verb phrase extraction and KeyBERT [ 20 ] for keyword identification. Their method suffers from vague cluster labels and noisy graphs due to the absence of a structured simplification mechanism. II-C Our Contributions Our approach improves conversational modeling by: • Enhanced Intent Extraction: Leveraging LLMs [ 13 , 15 , 16 , 17 ] to generate more coherent and semantically rich intent labels than verb-phrase-based methods [ 9 ] . • Graph Simplification via Filter & Reconnect: Introducing a novel technique that removes redundant transitions while preserving essential conversational structures, resulting in cleaner, more interpretable dialogue graphs. By combining LLM-based intent extraction with structured graph simplification, our method significantly enhances the analysis of large-scale dialogue datasets, providing clearer insights into conversational patterns while improving practical applications such as chatbot monitoring and user behavior analysis. III Methodology In this section, we present the methodology of our approach. The process begins by extracting utterances from the dataset, then each utterance is embedded using a text-embedding model [ 11 ] , thus transforming them into vectors that represent the semantic meaning of each utterance. These vectors are then clustered to identify the key utterance intents contained in the quasi-patterned set of conversations using an LLM. After that, we construct a Markov Chain, which will be filtered and processed to discard the noise and irrelevant intent transitions from the graph, and thus we create a conversational graph that can be analyzed to extract conversational flow patterns. III-A Vector Embedding Generation The first step involves generating vector embeddings for each utterance using a pre-trained text embedding model [ 11 ] . Formally, let U=\{u_{1},u_{2},\dots,u_{N}\} be the set of utterances. A pre-trained embedding model f:U\to\mathbb{R}^{d} maps each utterance u_{i} to a vector \mathbf{x}_{i}=f(u_{i}) . By doing so, we capture semantic and contextual properties of the utterances in a continuous metric space. For this work, we utilized the all-MiniLM-L12-v2 model [ 11 ] , which converts textual data into high-dimensional vectors \mathbf{x}_{i}\in\mathbb{R}^{d} that represent the semantic meaning of the utterances. These embeddings form the foundation for clustering, as they encapsulate both syntactic and semantic similarities [ 21 ] . By using embeddings that capture the contextual meaning of utterances, we ensure that the clusters formed represent coherent thematic groups. III-B Vector Clustering Once the vector embeddings \{\mathbf{x}_{i}\}_{i=1}^{N} of the utterances are generated, we use K-means++ [ 12 ] for clustering. Let N_{c} be the number of clusters. K-means aims to find \{\boldsymbol{\mu}_{c}\}_{c=1}^{N_{c}} that minimize: \min_{\{\boldsymbol{\mu}_{c}\}}\sum_{i=1}^{N}\min_{1\leq c\leq N_{c}}\|\mathbf{x}_{i}-\boldsymbol{\mu}_{c}\|^{2} (1) K-means++ strategically initializes centroids \boldsymbol{\mu}_{c}\in\mathbb{R}^{d} to be well-spread, leading

Read the complete text