Def-DTS: Deductive Reasoning for Open-domain Dialogue Topic Segmentation
Seungmin Lee, Yongsang Yoo, Minhwa Jung, Min Song · 2025
Read Def-DTS: Deductive Reasoning for Open-domain Dialogue Topic Segmentation by Seungmin Lee, Yongsang Yoo, Minhwa Jung, Min Song (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21033.txt.
Introduction
Seungmin Lee, Yongsang Yoo, Minhwa Jung, and Min Song split long chats into topics with step-by-step reasoning. Their paper, from twenty twenty-five, presents Def-DTS. Topic segmentation underpins many language tools, yet suffers scarce labels and fuzzy boundaries. Recent fixes keep growing more complex. Language models with structured reasoning are the untried lever here.
Their prompts summarize both directions of context around each line. Each utterance gets an intent label from a reusable list. A deductive check then decides whether the topic truly shifts. Tests across chat settings beat older and recent rivals. Each sub-step adds gains, especially on missed shifts. Auto-labeling new data is a further promise.
Catalog record
| CREATOR | Seungmin Lee, Yongsang Yoo, Minhwa Jung, Min Song |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-21033
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Def-DTS: Deductive Reasoning for Open-domain Dialogue Topic Segmentation Seungmin Lee, Yongsang Yoo, Minhwa Jung, Min Song Abstract Dialogue Topic Segmentation (DTS) aims to divide dialogues into coherent segments. DTS plays a crucial role in various NLP downstream tasks, but suffers from chronic problems: data shortage, labeling ambiguity, and incremental complexity of recently proposed solutions. On the other hand, Despite advances in Large Language Models (LLMs) and reasoning strategies, these have rarely been applied to DTS. This paper introduces Def-DTS: Deductive Reasoning for Open-domain Dialogue Topic Segmentation, which utilizes LLM-based multi-step deductive reasoning to enhance DTS performance and enable case study using intermediate result. Our method employs a structured prompting approach for bidirectional context summarization, utterance intent classification, and deductive topic shift detection. In the intent classification process, we propose the generalizable intent list for domain-agnostic dialogue intent classification. Experiments in various dialogue settings demonstrate that Def-DTS consistently outperforms traditional and state-of-the-art approaches, with each subtask contributing to improved performance, particularly in reducing type 2 error. We also explore the potential for autolabeling, emphasizing the importance of LLM reasoning techniques in DTS. 1 1 1 Our code and prompts are publicly available at https://github.com/ElPlaguister/Def-DTS 0 0 footnotetext: This is a preprint of the camera-ready version accepted to Findings of the ACL 2025. The official version will appear in the ACL Anthology. 1 Introduction Figure 1: An example of a topic shift in a conversation. The cues for a topic shift are highlighted in red. Dialogue Topic Segmentation (DTS) is a task that aims to divide a dialogue into segments where each segment focuses on a coherent topic. Figure 1 shows an example of topic shift within a single dialogue. DTS is crucial for various natural language processing (NLP) tasks, including response prediction ( Lin et al. 2020 ; Xu et al. 2021b ; He et al. 2022 ) , response generation ( Li et al. 2016 ; Xu et al. 2021a ; Liu et al. 2022 ) , dialogue state tracking ( Das et al. 2024 ) , summarization ( Bokaei et al. 2016 ; Chen and Yang 2020 ; Qi et al. 2021 ; Zhong et al. 2022 ) , question answering ( Yoon et al. 2018 ; Zhang et al. 2022 ) , and machine reading comprehension ( Ma et al. 2024 ) . Despite growing interest, DTS suffers from several chronic challenges. First, the shortage of annotated data has led most recent DTS studies to an unsupervised way, which generally yields suboptimal performance. Second, ambiguity in segment labeling has hindered the development of effective approaches. Lastly, recent studies: DialSTART ( Gao et al. 2023 ) , UR-DTS ( Hou et al. 2024 ) have proposed incremental approaches that require more parameter and complexity, enhancing previous studies: CSM ( Xing and Carenini 2021 ) and DialSTART ( Gao et al. 2023 ) , respectively. This progression indicates that DTS is a challenging and often underestimated problem. While DTS struggles with its complexities, NLP has witnessed significant advancements with the rise of Large Language Models (LLMs) and reasoning methodologies. However, even considering the robust problem-solving skills of these LLMs and the challenges posed by DTS, reasoning strategies are rarely applied in the DTS area. This is because DTS has been treated largely as a lightweight subtask in NLP. Nonetheless, with the rise of AI-driven chat services, the demand for more advanced DTS modules is growing. LLMs with reasoning capabilities are well suited to meet this need, making LLM-based DTS a viable solution. To establish clear criteria for topic shifts and simplify complex subtasks, we propose Def-DTS: a deductive reasoning approach for open-domain dialogue topic segmentation using LLM-based multi-step reasoning. Def-DTS employs structured prompting to guide LLMs through bidirectional context summarization, utterance intent classification, and deductive topic shift detection at the utterance level, with an emphasis on domain-agnostic intent classification. To evaluate Def-DTS, we test it on three dialogue datasets spanning open-domain and task-oriented settings across three key metrics. Our method consistently outperforms traditional and state-of-the-art unsupervised, supervised, and prompt-based techniques by a significant margin. Ablation studies confirm that each subtask improves overall performance, with intermediate intent classification particularly improving true-positive detection. Finally, we explore LLM-based auto-labeling for DTS. Our contributions are fourfold: • We introduce LLM reasoning techniques to DTS for the first time, consolidating insights from previous methodologies into a coherent and deductive prompt design. • We reformulate DTS as an utterance-level intent classification task by implementing intent classification as a core component of a multi-step reasoning process, enabling flexible and task-agnostic prompting. • Our method empirically demonstrates superior performance across nearly all comparative baselines, underscoring the efficacy of prompt engineering in DTS. • Through an in-depth analysis of our approach’s reasoning results, we shed light on the challenges LLM reasoning faces in DTS and discuss the possibility of using LLM as a DTS auto-labeler. 2 Related Works 2.1 Dialogue Topic Segmentation Dialogue topic segmentation divides dialogues into coherent topic units. Due to limited annotated datasets, researchers have largely relied on unsupervised approaches despite their complexity ( Xing and Carenini 2021 ) . Early methods like TextTiling ( Hearst 1997 ) detected topic shifts via lexical similarity, later improved with embedding-based methods ( Song et al. 2016 ) . Recent research emphasizes topical coherence and similarity scoring. CSM ( Xing and Carenini 2021 ) leverages BERT-based coherence, while Dial-START ( Gao et al. 2023 ) incorporates SimCSE ( Gao et al. 2021 ) for topic similarity. SumSeg ( Artemiev et al. 2024 ) extracts key information via summaries and applies smoothing to handle topic variations. UR-DTS ( Hou et al. 2024 ) enhances segmentation by rewriting utterances to recover missing references. Despite these advances, data scarcity and performance limitations persist. To address this, SuperDialSeg ( Jiang et al. 2023 ) introduces a supervised approach using large-scale DGDS datasets ( Feng et al. 2020 ; Feng et al. 2021 ) . However, the available datasets remain limited for open-domain conversations. LLMs are also influencing DTS. S3-DST ( Das et al. 2024 ) applies structured prompting for dialogue state tracking and segmentation, but lacks general applicability to diverse DTS settings. 2.2 Reasoning Strategy at LLM Inference The advancement of LLMs ( Brown et al. 2020 ) has led to research on the integration of System 2 reasoning ( Kahneman 2011 ) , including in-context learning ( Brown et al. 2020 ) and chain-of-thought prompting ( Wei et al. 2022 ) . These techniques enable LLMs to tackle complex tasks, such as symbolic mathematics ( Yang et al. 2024 ) , retrieval-augmented generation ( Lewis et al. 2020 ) , and data generation ( Adler et al. 2024 ) . Studies show that intermediate reasoning steps significantly enhance performance in areas like multi-hop reasoning ( Wang et al. 2023 ) and math problem-solving ( Imani et al. 2023 ) . Building on this, we integrate LLM-based reasoning into DTS, leveraging its potential to improve segmentation accuracy in this inherently complex task. 3 Def-DTS Figure 2: Prompt configuration and overall flow of our method: Def-DTS. (a) We utilize general intent list including the intent-specific examples to enable domain-agnostic categorization. (b) We employ the xml structured input-output format to stably provide the dialogue. (c)