Progressive Code Integration for Abstractive Bug Report Summarization

Shaira Sadia Karim [email protected], Abrar Mahmud Rahim [email protected], Lamia Alam [email protected], Ishmam Tashdeed [email protected], Lutfun Nahar Lota [email protected], Dr. Md. Abu Raihan M. Kamal [email protected], Dr. Md. Azam Hossain azam@iut-dh · 2025

Read Progressive Code Integration for Abstractive Bug Report Summarization by Shaira Sadia Karim [email protected], Abrar Mahmud Rahim [email protected], Lamia Alam [email protected], Ishmam Tashdeed [email protected], Lutfun Nahar Lota [email protected], Dr. Md. Abu Raihan M. Kamal [email protected], Dr. Md. Azam Hossain azam@iut-dh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00325.txt.

Introduction

Bug reports are often long, unstructured, and hard for developers to absorb quickly. Shaira Sadia Karim and co-authors present progressive code integration for summarizing bug reports in 2025. Their focus is abstractive summaries, written in fresh words rather than copied lines.

Existing approaches lean on surface-level textual cues and often produce incomplete or redundant summaries. They also tend to ignore the code snippets attached to reports, which are essential for accurate diagnosis. Weaving code into the summary pipeline should help developers grasp defects faster and route fixes to the right place. Abstractive summaries can be graded against the report itself, keeping evaluation honest. Progressive integration adds code context step by step rather than all at once.

Catalog record

CREATORShaira Sadia Karim [email protected], Abrar Mahmud Rahim [email protected], Lamia Alam [email protected], Ishmam Tashdeed [email protected], Lutfun Nahar Lota [email protected], Dr. Md. Abu Raihan M. Kamal [email protected], Dr. Md. Azam Hossain azam@iut-dh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-00325

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Progressive Code Integration for Abstractive Bug Report Summarization Shaira Sadia Karim [email protected], Abrar Mahmud Rahim [email protected], Lamia Alam [email protected], Ishmam Tashdeed [email protected], Lutfun Nahar Lota [email protected], Dr. Md. Abu Raihan M. Kamal [email protected], Dr. Md. Azam Hossain [email protected] Abstract Bug reports are often unstructured and verbose, making it challenging for developers to efficiently comprehend software issues. Existing summarization approaches typically rely on surface-level textual cues, resulting in incomplete or redundant summaries, and they frequently ignore associated code snippets, which are essential for accurate defect diagnosis. To address these limitations, we propose a progressive code-integration framework for LLM-based abstractive bug report summarization. Our approach incrementally incorporates long code snippets alongside textual content, overcoming standard LLM context window constraints and producing semantically rich summaries. Evaluated on four benchmark datasets using eight LLMs, our pipeline outperforms extractive baselines by 7.5%–58.2% and achieves performance comparable to state-of-the-art abstractive methods, highlighting the benefits of jointly leveraging textual and code information for enhanced bug comprehension. 1 Introduction Bug reports are a critical component of software maintenance, providing developers with information about defects, failure conditions, and potential fixes. However, their unstructured nature, redundancy, and occasional ambiguity make them challenging to analyze efficiently [ 40 , 3 ] . Existing summarization methods, ranging from supervised learning approaches to classical NLP-based techniques, predominantly focus on textual content and often overlook the semantic connections between bug descriptions and their corresponding source code [ 23 ] . While extractive approaches are widely used, they can produce redundant, fragmented, or incoherent summaries. Abstractive methods, which have the potential to generate more concise and semantically rich summaries, remain underexplored due to their technical complexity [ 8 , 20 ] . The advent of Large Language Models (LLMs) has enabled more advanced summarization capabilities [ 38 , 2 ] . However, prior LLM-based approaches for bug-report summarization largely ignore the inclusion of full code snippets [ 7 ] , which are crucial for understanding the context of software defects. LLMs also face challenges related to missing background knowledge, domain-specific terminology, and structured code elements [ 5 , 27 ] , although prompt engineering has been shown to mitigate some of these limitations and improve generation quality [ 6 , 16 ] . To address these gaps, we propose an LLM-based abstractive bug-report summarization framework that integrates textual bug reports with complete code snippets through carefully designed prompt engineering. Our method is evaluated across multiple benchmark datasets, including SDS [ 30 ] , ADS [ 15 ] , Fang et al.’s corpus [ 9 ] , and Defects4J [ 18 ] . The primary contributions of this work are threefold: (1) the first explicit use of full code snippets to enhance abstractive bug-report summarization, (2) a prompt-engineered framework for effectively combining text and code, and (3) demonstrably improved semantic summary quality as measured by BERTScore [ 39 ] . 2 Related Work 2.1 Abstractive Bug Report Summarization Abstractive summarization of bug reports presents significant challenges due to the technical complexity, domain-specific terminology, and heterogeneous structure of report content [ 10 , 32 ] . Traditional methods often struggle to capture the semantic essence of both textual descriptions and associated code, leading to summaries that may omit critical fault-relevant information. Recent advances in Large Language Models (LLMs) have substantially improved context-aware summarization capabilities [ 38 ] . Approaches such as RTA [ 9 ] , KSCLP [ 33 ] , and SumLLaMA [ 36 ] leverage pre-training on large corpora, knowledge-specific or contrastive learning techniques, and parameter-efficient fine-tuning to enhance performance on bug-report summarization tasks. While these methods achieve improved fluency and abstraction compared to extractive techniques, they generally focus on the textual content of bug reports and do not incorporate the underlying buggy code [ 28 ] . This omission limits the ability of these models to fully capture the context of software defects and constrains their applicability in code-aware summarization scenarios. 2.2 Prompt Engineering Prompt engineering has emerged as a powerful technique for guiding LLMs in complex software engineering tasks [ 17 ] . Frameworks such as LIBRO [ 19 ] , ChatBR [ 4 ] , and LLIFT [ 21 ] employ structured prompts, few-shot examples, and progressive prompting strategies to enhance performance on tasks including test-case generation, bug detection, and bug-report generation. These methods leverage the inherent generative capabilities of LLMs while providing explicit cues to shape output content and maintain task relevance. Similarly, ChatGPT and other general-purpose LLMs have demonstrated effectiveness in vulnerability management and abstractive bug-report summarization [ 25 ] . However, current prompt-based approaches predominantly focus on textual bug reports and do not incorporate the underlying code associated with defects. This limitation constrains their ability to capture the full semantic and structural context of software bugs, highlighting a gap that motivates the development of code-aware abstractive summarization techniques. 3 Approach 3.1 Problem Statement Let \mathcal{X}_{T} denote the space of textual bug–report utterances (e.g., natural-language descriptions, reproduction steps, error messages) and let \mathcal{X}_{C} denote the space of code snippets (e.g., stack traces, diffs, method bodies). A bug report is represented as a pair x=(x_{T},x_{C})\in\mathcal{X}_{T}\times\mathcal{X}_{C}, where x_{T} is a sequence of natural-language tokens and x_{C} is a sequence of code tokens. Formally, x_{T}=(t_{1},t_{2},\dots,t_{n_{T}}),\qquad t_{i}\in V_{T}, x_{C}=(c_{1},c_{2},\dots,c_{n_{C}}),\qquad c_{j}\in V_{C}, with V_{T} and V_{C} denoting the vocabularies for text and code respectively. A summary is an abstractive natural-language sequence y=(y_{1},y_{2},\dots,y_{m})\in\mathcal{Y}, where y_{k}\in V_{T} and m\ll n_{T}+n_{C} . We define the abstractive bug-report summarization problem as learning a conditional probability distribution p_{\theta}(y\mid x_{T},x_{C}), parameterized by \theta , such that generated sequences y satisfy two criteria: • Semantic Sufficiency: The summary y preserves the core meaning of the bug report, capturing essential fault symptoms, reproduction conditions, and implicated code regions. More formally, we assume a semantic representation function \phi:\mathcal{X}_{T}\times\mathcal{X}_{C}\rightarrow\mathcal{Z}, mapping inputs to a latent semantic space \mathcal{Z} , and a corresponding summary-induced representation \psi:\mathcal{Y}\rightarrow\mathcal{Z}. A summary is semantically sufficient if d(\phi(x_{T},x_{C}),\psi(y))\leq\varepsilon, for a task-appropriate similarity metric d:\mathcal{Z}\times\mathcal{Z}\to\mathbb{R}_{\geq 0} (e.g., cosine distance in an embedding space) and a distortion threshold \varepsilon>0 . • Abstractive Novelty: The summary may contain tokens not present in the original bug report or code snippet. Formally, y\not\subseteq x_{T}\cup x_{C}\quad\text{is allowed}, distinguishing the task from extractive summarization, which restricts summaries to subsequences or selections from the input. Thus, abstractive summarization requires learning a generative transformation f_{\theta}:\mathcal{X}_{T}\times\mathcal{X}_{C}\rightarrow\mathcal{Y}, capable of synthesizing novel linguistic expressions while preserving semantic fidelity. To operationalize this transformation with a Large Language Model (LLM), we construct a structured prompt \pi(x)=g(x_{T},x_{C}), where g is a deterministic formatting function (e.g., using delimiters, metadata fields, or role annotations) that exposes salient textual and code structure to the model. The LLM produces a summary \hat{y}=\arg\max_{y\in\mathcal{Y}}p_{\theta}(y\mid\pi(x)), or a sampled approximation thereof. The objective of this work is to design the prompt representation g , specify an effective prompting or training strategy for the LLM, and evaluate the resulting summaries according to both linguistic quality and semantic fidelity with respect to the original bug report and its associated code. Figure 1: End-to-end pipeline for abstractive bug report summarization. Here long buggy code is chunked and summarized, combined with bug-report text through prompting and refined using LoRA-based fine-tuning to produce summaries. 3.2 Data Preprocessing We construct our dataset by leveraging Defects4J [ 18 ] , a curated

Read the complete text