Divide-Prompt-Refine: a Training-Free, Structure-Aware Framework for Biomedical Abstract Generation

Sylvey Lin, Joe Menke, Shufan Ming, Dongin Nam, Neil Smalheiser, Halil Kilicoglu · 2026

Read Divide-Prompt-Refine: a Training-Free, Structure-Aware Framework for Biomedical Abstract Generation by Sylvey Lin, Joe Menke, Shufan Ming, Dongin Nam, Neil Smalheiser, Halil Kilicoglu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20628.txt.

Introduction

Sylvey Lin and five colleagues propose DPR-BAG, a training-free way to write abstracts for biomedical papers that lack them. Many papers have full text but no abstract, which weakens search and curation. Their method splits a paper into Background, Objective, Methods, Results, and Conclusions facets and summarizes each in parallel. A final refinement step restores overall flow, and tests on 46,309 papers show fresher wording than strong baselines while staying factual.

Catalog record

CREATORSylvey Lin, Joe Menke, Shufan Ming, Dongin Nam, Neil Smalheiser, Halil Kilicoglu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70279
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20628

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Divide-Prompt-Refine: a Training-Free, Structure-Aware Framework for Biomedical Abstract Generation Sylvey Lin, Joe Menke, Shufan Ming, Dongin Nam, Neil Smalheiser, Halil Kilicoglu Abstract Biomedical abstracts play a critical role in downstream NLP applications, such as information retrieval, biocuration, and biomedical knowledge discovery. However, a non-trivial number of biomedical articles do not have abstracts, diminishing the utility of these articles for downstream tasks. We propose DPR-BAG (Divide, Prompt, and Refine for Biomedical Abstract Generation), a training-free, zero-shot framework that generates coherent and factually grounded abstracts for biomedical articles with full text but no abstract. DPR-BAG decomposes full-text documents into structured rhetorical facets following the Background-Objective-Methods-Results-Conclusions (BOMRC) schema, performs parallel LLM-based summarization for each facet, and applies a final refinement stage to restore global discourse coherence. On PMC-MAD, a distribution-aligned dataset of 46,309 biomedical articles, DPR-BAG improves abstractive novelty over strong extractive and fine-tuned baselines, while maintaining factual consistency. Our ablation study reveals a counterintuitive finding: increasing prompt complexity or explicitly injecting entity-level guidance can degrade factual alignment, highlighting the importance of controlled prompting strategies. These findings underscore the potential of training-free, structure-aware frameworks for scalable biomedical abstract generation in low-resource settings. Our data and code are available at https://huggingface.co/datasets/pmc-mad/PMC-MAD and https://github.com/ScienceNLP-Lab/MultiTagger-v2/tree/main/DPR-BAG . 1 Introduction Many biomedical NLP tasks rely heavily on abstracts, due to their accessibility and information density. Abstracts provide an author-written summary of core scientific findings, making them a useful proxy for full-text articles in downstream applications. For example, 23 showed that pre-training tasks designed around the title-abstract structure improve biomedical information retrieval; 35 used abstracts as an initial data source for biocuration. Beyond content, the structured organization of abstracts also benefits downstream tasks: 32 leverage abstract-level structure to refine retrieval; PubMedQA 18 is based on structured abstracts to support high-fidelity biomedical knowledge discovery. Moreover, abstracts alone can serve as a stronger training signal than full texts in some settings 13 . However, the absence of abstracts in a significant portion of biomedical articles creates a bottleneck for these tasks. As of April 2026, 11,603,796 out of 40,414,072 (~29%) PubMed articles were missing abstracts, with this volume continuing to rise despite a declining overall proportion, driven by the growth of publication types such as case reports, editorials, and letters. These publication types carry substantial scientific value. For instance, 15 and 9 utilized case reports for adverse drug event detection; 24 and 27 assessed letters to characterize post-publication scientific discourse, including patterns of critique, rhetorical features of disagreement, and trends in authorship; and 33 and 17 analyzed editorials to study how journals shape scientific discourse, including the distribution of topics, the framing of policy issues, and the presence of systematic biases. The absence of abstracts in these articles motivates the Biomedical Abstract Generation (BAG) task, which aims to automatically generate abstracts from full-text biomedical articles. Although related to standard document summarization, BAG differs in important ways. It must adhere to scientific reporting conventions, including structured presentation of methods, results, and conclusions, while preserving fine-grained biomedical entities, quantitative findings, and explicit argumentative relationships that are often critical for scientific interpretation. Early BAG work by 4 utilized extractive sentence selection, which can lead to fragmented coherence and poor lexical flow. Moreover, because full-length biomedical articles often exceed the context limits of standard models, BAG is inherently a long-context task, making it vulnerable to extractive bias and factual fidelity issues. For example, 34 demonstrates that even state-of-the-art models like GPT-4 suffer from hallucinations and information omission when extracting from non-decomposed scientific full texts, emphasizing the inherent fidelity risks in long-document processing required for BAG task. Beyond fidelity risks, recent analysis also reveals that when forced to process complex long full texts, even specialized models like LongT5 exhibit a strong extractive bias, relying on simple heuristics to copy verbatim snippets rather than synthesizing information 5 . As a result, these models can suffer from the same core issue as traditional extractive summarizers: they produce fragmented text that lacks the natural flow and cohesion of human-written summaries 10 . To address these limitations, we propose the Divide, Prompt and Refine Biomedical Article Generation (DPR-BAG) framework. Drawing on prior work showing that divide-and-conquer decomposition reduces intermediate errors in LLMs 38 , DPR-BAG decomposes full-text articles along their rhetorical structure, performs parallel summarization on each resulting facet, and applies a modular refinement stage to reconcile fragmented outputs and restore discourse coherence. We target six rhetorical facets: Background, Objectives, Methods, Results, Conclusions (BOMRC), and Others. BOMRC is adopted as it represents the standard discourse structure validated in the PubMed 200k RCT dataset 8 , while the “Others" facet retains any unclassified content. Using this design, we focus on three research questions: 1. Can we develop a training-free approach for the BAG task? 2. Does structure-aware decomposition of full-text articles improve the quality of generated abstracts compared to naive prompting? 3. To what extent does increasing prompting complexity (from detailed instructions to entity guidance) improve generation quality? Our main contributions are as follows: 1. We propose DPR-BAG, a training-free, structure-aware method for BAG. 2. We release a dataset of more than 46K biomedical full-text publications for BAG task. 3. We compare DPR-BAG to strong extractive and abstractive baselines. 4. We systematically evaluate the effect of various prompting and splitting strategies as well as entity guidance within DPR-BAG. Figure 1: Overview of the DPR-BAG framework for biomedical abstract generation. 2 Dataset We constructed a BAG dataset based on PubMed publications from 1987 to 2023. To ensure a representative sample, we first calculated the publication type (PT) distribution of articles lacking abstracts using PT queries adapted from prior work 25 . We then performed stratified sampling based on this distribution to retrieve 130,000 candidate XML files from the PubMed Central (PMC) Open Access subset, ensuring that the sampled articles reflect the publication type distribution of abstract-less PubMed records. For data processing, we adapted the extraction pipeline from the Long-summarization framework 7 to parse structured sections and abstracts from the raw XML files. After filtering out records that were unparseable or lacked extractable abstracts, the final dataset, hereafter referred to as PMC-MAD (Missing-Abstract Distribution-aligned PMC), consists of 46,309 articles. 3 Methods DPR-BAG follows a modular pipeline designed to generate structure-aware abstracts from biomedical full-text articles (Figure 1 ). The process begins by decomposing the document into five distinct facets based on BOMRC, plus an "Others" facet for unclassified content. For each facet, we perform parallel LLM-based summarization, which can optionally be augmented with entity guidance extension. The resulting sectional summaries are then concatenated and passed to a final LLM-based refinement stage to restore discourse coherence. DPR-BAG requires no task-specific training or fine-tuning; all components operate in a zero-shot manner using pre-trained, off-the-shelf models. 3.1 Task Formulation Given a full-text biomedical article D=(p_{1},p_{2},\ldots,p_{n}) , where each p_{i} denotes a paragraph, the goal is to generate an abstract A that covers a predefined set of rhetorical facets \mathcal{F}=\{ Background, Objectives, Methods, Results, Conclusions, Others \} (BOMRC+). We reformulate this as a facet-conditioned summarization problem, where the model generates content for each rhetorical facet separately. This decomposition allows the model to address each rhetorical component independently and capture discourse structure. Specifically, the document is partitioned into K=6 facet-specific sub-documents \{D_{f_{k}}\}_{k=1}^{K} , where each D_{f_{k}} aggregates paragraphs

Read the complete text