ThreadSumm: Summarization of Nested Discourse Threads Using Tree of Thoughts
Olubusayo Olabisi, Ekata Mitra, Ameeta Agrawal · 2026
Read ThreadSumm: Summarization of Nested Discourse Threads Using Tree of Thoughts by Olubusayo Olabisi, Ekata Mitra, Ameeta Agrawal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17648.txt.
Introduction
Olabisi, Mitra, and Agrawal introduce ThreadSumm, a multi-stage framework for summing up deeply nested threads, where tangled replies, quotes, and mixed topics defeat standard tools. The method first plans content by pulling discourse aspects and Atomic Content Units, then orders lines into thread-aware chains showing multiple views rather than one linear strand. A Tree of Thoughts search then drafts and scores multiple passage options, jointly tuning flow and breadth. The design yields summaries with clear logic beating current rivals.
Catalog record
| CREATOR | Olubusayo Olabisi, Ekata Mitra, Ameeta Agrawal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55232 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17648
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ThreadSumm: Summarization of Nested Discourse Threads Using Tree of Thoughts Olubusayo Olabisi, Ekata Mitra, Ameeta Agrawal Abstract Summarizing deeply nested discussion threads requires handling interleaved replies, quotes, and overlapping topics, which standard LLM summarizers struggle to capture reliably. We introduce ThreadSumm , a multi-stage LLM framework that treats thread summarization as a hierarchical reasoning problem over explicit aspect and content unit representations. Our method first performs content planning via LLM-based extraction of discourse aspects and Atomic Content Units, then applies sentence ordering to construct thread-aware sequences that surface multiple viewpoints rather than a single linear strand. On top of these interpretable units, ThreadSumm employs a Tree of Thoughts search that generates and scores multiple paragraph candidates, jointly optimizing coherence and coverage within a unified search space. With this multi-proposal and iterative refinement design, we show improved performance in generating logically structured summaries compared to existing baselines, while achieving higher aspect retention and opinion coverage in nested discussions. 1 Introduction Discussion forums are known to have nested structures, as users respond to one another, quoting or replying to topics of interest, leading to a long thread of content associated with a single post. These multi-turn conversations on discussion forums have additional layers of complexity required to navigate the discussion threads 14 . There is a tendency for threads to attract off-topic replies that get interleaved with the author’s own continuation posts, burying the main content. The nested discourse threads can be represented as graphs connected by reply, retweet, and quote edges, making it inherently harder to follow linearly compared to traditional structured documents. The fragmented and tree-like structure is further branched out by mixed reply types such as reposts, quoted posts and replies as shown in Figure 1 , and navigating these branches to follow one coherent strand is crucial for summarization. User A: What do you think, now that everyone thinks/knows the NSA can see who has significant amount of Bitcoins and so forth… And with cash receipts you can send them to your parents trust lawyer and they match the amount (for all those being spoon fed). User B (replies to A; quotes A): It depends what you’re buying & how you initially contacted the seller to arrange a face-to-face meet. Phone/email records may be easier to trace than a couple of Bitcoin transactions if you’re using a VPN. User C (replies to A): Cash is more anonymous. Computers always leave traces. User E (replies to B; quotes B): If it’s a face-to-face transaction of physical goods, the only non-anonymous aspect is the other person remembering your face. If it’s online, Bitcoin is more anonymous … User D (replies to C; quotes C): I agree, computers leave too much trace nowadays. The best anonymous payment method will always be cash. Figure 1: Nested thread structure illustrating reply and quote relations (A \rightarrow B \rightarrow E and A \rightarrow C \rightarrow D). Traditional approaches to abstractive text summarization largely focus on optimizing the selection and reduction of document content. While these methods have demonstrated the ability to condense information, they frequently overlook deeper document-level structures, resulting in summaries that may lack coherence, logical flow, and a clear representation of the original text’s hierarchy as seen in most discussion forums. Large Language Model (LLM)-based multi-agent frameworks have been used in summarization for long-form documents through hierarchical processing 2 ; 6 ; 29 ; 10 . However these methods do not balance dynamic viewpoints, especially in noisy, multi-speaker settings 20 . Early work on structured textual threads and conversations explored abstractive summarization across a spectrum of multi-turn settings. 28 introduced a hierarchical model for summarizing multi-turn email threads, capturing structure at both the email and token levels. 3 then extended this line to multi-party conversations, integrating argument mining to identify argumentative roles and relationships. 4 carried these ideas into Q&A forums, proposing a pipeline that combines answer selection, content unit extraction, and abstraction to summarize multiple answers to the same question. Building on this, 25 framed content selection as an iterative self-questioning process that guides summary generation. More recent work, such as 21 , further broadens the paradigm by incorporating multimodal signals from images into thread summarization. However, these methods do not employ explicit multi-step reasoning over structure or content units to ensure content coverage and coherence. In this work, we are concerned with two main research questions. (RQ1): How do we address discourse coverage, especially when multiple interleaved topics are present in the threaded documents? In addition, in multi-party speech, turns often overlap and speakers interrupt each other, making it difficult to rely on a simple linear adjacency model to infer what response was targeted to a comment, leading to our second research question (RQ2): How do we ensure that the overlap and interruptions present in complex threaded discussions are considered in order to generate a coherent summary, even without predefined thread order? D2 D1 D3 D5 D4 D8 D6 D7 Aspect Extraction Extract the unique aspects in all the documents Aspect 1 Aspect 2 \cdots Aspect n ACU Generation Generate all atomic content units on each aspect ACU 1 ACU 2 \cdots ACU r Sentence Reordering Reorder ACUs to flow coherently ACU 2 ACU 1 \cdots ACU r Paragraph Writing Generate paragraph proposals from reordered ACUs \cdots P_{1} P_{n} Paragraph Evaluation and Selection Final Summary = \max(\mathrm{Coh},\mathrm{Cov})\{P_{1},\ldots,P_{n}\} Summary Figure 2: Our proposed framework for Summarization of Nested Discourse Threads To answer these questions, we make the following contributions: • We introduce ThreadSumm , a multi-stage LLM pipeline framework for threaded multi-document summarization. • We employ a thread-aware content-planning layer (Aspects + Atomic Content Units) feeding into a multi-proposal Tree of Thoughts search to iteratively refine the summary for optimized coherence and coverage. • We conduct extensive experiments to show the effectiveness of our method using three LLMs and three datasets across various domains. While our framework integrates established ideas such as Aspect extraction, Atomic Content Units, and LLM-based evaluation, our contribution lies in operationalizing these components using Tree of Thoughts as a single controllable pipeline specifically tailored to nested threaded discourse. 2 Related Work Early neural models incorporated discourse structure into end-to-end architectures: 9 proposed a discourse-aware hierarchical attention network encoding RST dependencies, and 11 introduced NeRoBERTa, which injects nested syntactic and discourse trees into a Transformer encoder. In the area of multi-party speech, 28 demonstrated that modeling email thread hierarchy improves abstractive summaries, while 3 and 4 proposed pipelines that identify argumentative roles and cluster responses to preserve multiple perspectives in community Q&A discussions. Query-based summarization of discussion threads was explored by 23 , who showed that conditioning summaries on user information needs helps surface relevant branches of a discussion. Recent LLM-based frameworks adopt multi-agent or multi-stage processing for long inputs ( 7 ; 29 ; 10 ) . Nevertheless, these approaches either rely on relatively structured interactions or flattened thread structure and optimize for a single-pass summary. In contrast, ThreadSumm explicitly targets unstructured, deeply nested discourse threads by framing summarization as a hierarchical reasoning problem using a thread-aware content-planning layer feeding into a multi-proposal Tree of Thoughts search over paragraph realizations. 3 ThreadSumm We introduce ThreadSumm , a multi-stage LLM pipeline framework that summarizes threaded documents using Tree