Explanatory Summarization with Discourse-Driven Planning
Dongqi Liu, Xi Yu, Vera Demberg, Mirella Lapata, {dongqi,xiyu,vera}@lst.uni-saarland.de [email protected] · 2025
Read Explanatory Summarization with Discourse-Driven Planning by Dongqi Liu, Xi Yu, Vera Demberg, Mirella Lapata, {dongqi,xiyu,vera}@lst.uni-saarland.de [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19339.txt.
Introduction
Dongqi Liu and co-authors plan explanations into automatic summaries in a 2025 paper on lay summarization. Plain-language summaries of science papers need built-in explanations, but current summarizers do not model them, so the share of explanatory content in machine summaries drifts away from what human writers produce.
Their approach borrows discourse frameworks to plan a summary before writing it, then prompts the model to answer the plan with explanatory sentences. Two variants place the plan in the input or in the output's opening. On three datasets the method beat prior systems, with better control and fewer invented claims.
Catalog record
| CREATOR | Dongqi Liu, Xi Yu, Vera Demberg, Mirella Lapata, {dongqi,xiyu,vera}@lst.uni-saarland.de [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-19339
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Explanatory Summarization with Discourse-Driven Planning Dongqi Liu, Xi Yu, Vera Demberg, Mirella Lapata, {dongqi,xiyu,vera}@lst.uni-saarland.de [email protected] Abstract Lay summaries for scientific documents typically include explanations to help readers grasp sophisticated concepts or arguments. However, current automatic summarization methods do not explicitly model explanations, which makes it difficult to align the proportion of explanatory content with human-written summaries. In this paper, we present a plan-based approach that leverages discourse frameworks to organize summary generation and guide explanatory sentences by prompting responses to the plan. Specifically, we propose two discourse-driven planning strategies, where the plan is conditioned as part of the input or part of the output prefix, respectively. Empirical experiments on three lay summarization datasets show that our approach outperforms existing state-of-the-art methods in terms of summary quality, and it enhances model robustness, controllability, and mitigates hallucination. The project information is available at https://dongqi.me/projects/ExpSum . 1 Introduction Figure 1 : An excerpt of a source document paired with its summary (bottom); the explanatory sentence and its target are highlighted in green and orange , respectively. The RST tree (top) for the text corresponding to the two sentences shows they are linked by the rhetorical relation Elaboration . In the domain of lay summarization for scientific documents, the inclusion of explanatory content is beneficial for improving readability and accessibility, particularly when dealing with difficult concepts or complicated statements Srikanth and Li (2021) ; August et al. (2022) ; Luo et al. (2022) ; Goldsack et al. (2022) . As an example, consider the target sentence being explained (highlighted in orange ) within the lay summary in Figure 1 . It describes the role of the cerebellum (a similar sentence can be found in the source document, also highlighted in orange ) and is accompanied by an explanation highlighted in green , which compares the cerebellum to a coach. This analogy, which illustrates how the cerebellum adjusts the timing of actions based on previous movements, makes the preceding technical description easier to understand. Using simpler vocabulary or shorter sentences can make the summaries easier to read, but could also lead to misinterpretations Liu and Demberg (2023) ; Han et al. (2023) ; Wu et al. (2023b) ; Hewett et al. (2024) . Thus, explanations are often used to avoid this, balancing accessibility with accuracy and cognitive load Oksa et al. (2010) . Empirical analysis of lay summaries supports the observation that explanations are commonplace. Specifically, by using a discourse parser Liu et al. (2020) ; Liu et al. (2021) to identify explanations in the eLife and PLOS (lay summarization) datasets Goldsack et al. (2022) , we find that explanations account for approximately 19.02% and 18.19% of summary sentences, respectively. This proportion of explanations in lay summaries is three times higher than in expert summaries (6.28% and 5.06%) and nearly four times greater than in the original academic papers (5.16% and 4.76%). In other words, explanations are significantly more common than other discourse relations like Condition and Purpose . This underscores their importance in structuring lay summaries and enhancing text accessibility. Most lay summarization models follow an end-to-end approach Goldsack et al. (2022) ; Liu et al. (2022) ; Goldsack et al. (2023) ; Liu et al. (2024) without explicitly accounting for explanations. As a result, explanations are often underrepresented in generated summaries, which in turn may be the reason why generated summaries lack the clarity and readability found in human-produced ones Guo et al. (2021b) ; Goldsack et al. (2023) ; Tang et al. (2023) ; Liu and Demberg (2023) ; Zhang et al. (2024a) ; Wang et al. (2025) . In this paper, we develop neural models that are capable of generating lay summaries with controlled explanatory content. We achieve this by planning the content of the summary, thus directly steering the model towards generating explanations. Plan-based models are a suitable type of approach for lay summarization, as they are less prone to hallucinations, offer greater controllability ( Puduppully et al., 2019 ; Narayan et al., 2021 ; Moryossef et al., 2023 ; Narayan et al., 2023 ; Huot et al., 2023 ; Huot et al., 2024 ; Liu et al., 2025 ) , and can be flexibly adapted to different generation tasks depending on how plans are formulated. Our method conceptualizes plans as a series of questions that trigger explanatory content, with their strategic placement learned from training data. This placement is not arbitrary; rather, it reflects where human writers tend to insert explanations to clarify complex claims or findings. Importantly, our approach not only models where to explain, but also what is being explained and how—e.g., through analogy, background, or causal reasoning. In addition, evaluating such explanations remains challenging, as automatic consistency detection metrics often misclassify useful additions as hallucinations Cao et al. (2022) . To address this, we incorporate external knowledge verification, but acknowledge that finer-grained human or LLM-based judgments are still needed for nuanced evaluation. A common challenge with plan-based models is the scarcity of datasets with plan annotations. As a result, plans are often reverse-engineered from existing reference summaries through automatic means, e.g., by identifying entities Narayan et al. (2021) ; Huot et al. (2024) or generating questions and their answers Narayan et al. (2023) . Our approach draws inspiration from Rhetorical Structure Theory (RST; Mann and Thompson 1987 ). RST represents texts as trees (see Figure 1 ), where the leaves correspond to Elementary Discourse Units (EDUs) and the nodes specify how these and larger units are connected through rhetorical relations (e.g., Elaboration ). Discourse units are further characterized in terms of their text importance: nuclei represent central segments, whereas satellites denote peripheral ones. As depicted in the upper part of Figure 1 , EDU j acts as a satellite to EDU i , supplying an explanation. We automatically generate plans from reference summaries annotated with RST trees Liu et al. (2020) ; Liu et al. (2021) . We hypothesize that explanatory EDUs answer latent questions Beaver et al. (2017) , which we verbalize. Our plans are designed to pose these latent questions, but we do not state the answers explicitly (see Figure 2 ). We develop two model variants that differ in how they integrate planning in the summarization process, with plans either included as part of the source document or as part of the target summary. Empirical results using Mistral Jiang et al. (2023) as backbone confirm that our discourse-driven planning approach significantly improves the quality of lay summaries but also has the potential to control the generation of explanatory content to a certain extent. Our key contributions are as follows: • We introduce the task of explanatory summarization , which aims to generate lay summaries with controlled explanations. • We propose two discourse-driven models that generate lay summaries without requiring manual annotations. Empirical results show improvements in summary quality and better alignment with human performance. • Both qualitative and quantitative analyses indicate that our models mitigate content hallucinations and enhance factual accuracy. However, a gap still exists compared to human performance. Figure 2 : We use DMRST Liu et al. (2021) to extract explanatory ( e ) EDUs and their target ( t ) EDUs from reference summaries, and then feed this data into