RadTimeline: Timeline Summarization for Longitudinal Radiological Lung Findings
2026
Read RadTimeline: Timeline Summarization for Longitudinal Radiological Lung Findings (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22820.txt.
Introduction
Zhou, Yetisgen, and Ostendorf frame radiology summary as timeline building. Tracking lung findings across many reports takes clinician time. Their format puts dated findings in columns and links related findings in rows. A three-step language model process builds each timeline. It pulls findings, names groups, then sorts findings by those names. The team built the RadTimeline dataset from chest imaging reports. Group naming proves key to good grouping. The best setup matches human annotators on grouping, with strong recall.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56089 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22820
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RadTimeline: Timeline Summarization for Longitudinal Radiological Lung Findings Abstract Tracking findings in longitudinal radiology reports is crucial for accurately identifying disease progression, and the time-consuming process would benefit from automatic summarization. This work introduces a structured summarization task, where we frame longitudinal report summarization as a timeline generation task, with dated findings organized in columns and temporally related findings grouped in rows. This structured summarization format enables straightforward comparison of findings across time and facilitates fact-checking against the associated reports. The timeline is generated using a 3-step LLM process of extracting findings, generating group names, and using the names to group the findings. To evaluate such systems, we create RadTimeline, a timeline dataset focused on tracking lung-related radiologic findings in chest-related imaging reports. Experiments on RadTimeline show tradeoffs of different-sized LLMs and prompting strategies. Our results highlight that group name generation as an intermediate step is critical for effective finding grouping. The best configuration has some irrelevant findings but very good recall, and grouping performance is comparable to human annotators. Keywords: stuctured summarization, longitudinal EHRs, LLMs RadTimeline: Timeline Summarization for Longitudinal Radiological Lung Findings Sitong Zhou, Meliha Yetisgen, Mari Ostendorf University of Washington {sitongz, melihay, ostendor}@uw.edu Abstract content 1. Introduction Tracking changes in status of findings in longitudinal radiology reports is critical for understanding disease progression, treatment response, and supporting disease risk assessment. Reading longitudinal reports can capture subtle changes that may be missed in isolated reports. Individual reports often document changes in status with short phrases (e.g., "improved", "persists") ( 5 ; 7 ) , but the longitudinal sequence of reports can provide details that make this information more useful. However, reading longitudinal records and pulling together related findings can be time consuming and contributes to cognitive overload. Artificial intelligence (AI) can support this work, both in the identification and presentation of relevant findings. While AI tools for summarization are effective for many tasks, most work on multiple documents has involved unstructured summaries, which complicates fact-checking of statements about temporal changes ( 1 ) . For high-stakes clinical scenarios, the ability to confirm source details behind an AI statement is critical. 9 propose a verifiable structured summarization format in which each fact is linked to its source document and organized into human-curated topics. A pre-defined set of topics is useful for large document collections, but this is not practical for summarizing radiological findings for specific patients, where it may be useful to track multiple nodules observed in the same region of the lung, for example. In this paper, we introduce a new two-dimensional timeline format for structured summarization that makes it easy to see temporal changes. As shown in Figure 1 for lung-related findings, each column corresponds to a time-stamped radiology exam (as indicated in the header), such as a chest CT taken in May of a given year. Each cell in a column corresponds to a lung finding fact from that report, including details relevant to lung cancer risk assessment (e.g., size, location, status, etc.), such as ”stable subsolid pulmonary nodule in the right upper lobe.” Each row represents a group that tracks the evolution of a particular finding over time, with a row header describing the distinguishing characteristics of that group. Figure 1: The timeline task and a three-step LLM approach. Each column corresponds to a time-stamped radiology exam (e.g., YYYY-05_chest-ct). Each cell in a column is a piece of lung finding fact (e.g., "stable subsolid pulmonary nodule in the right upper lobe") from that report including clinically important details (e.g., "stable", "subsolid"). Each row groups temporally related findings, with a row header describing the distinguishing characteristics of that group (e.g., "right upper lobe ground glass nodule"). To support research with this framework, we create RadTimeline, an evaluation dataset with lung-related radiological findings within longitudinal chest-related imaging reports where each patient is associated with a hand-corrected timeline. In addition, metrics are proposed for assessing automatically generated timelines in terms of finding factuality, group name quality, and finding grouping performance. We propose a 3-step LLM-based approach to timeline generation that: (i) extracts lung-related finding facts from individual reports (the cells in a column), (ii) generates interpretable group names (row headers) from longitudinal reports, and (iii) associates each finding with its corresponding group (row). In experiments with RadTimeline, we show that this 3-step timeline generation approach detects most lung findings correctly, but further work is needed to address irrelevant findings. We observe that group name quality is critical for effective grouping, particularly for weaker LLMs and embedding-based grouping strategies. The best prompting configuration reaches near-human performance in grouping findings. 2. Gold Timeline Dataset Curation We sample 10 patients from a patient cohort from an existing case-control dataset created for a lung cancer surveillance project in UW Medicine, 1 1 1 A subset of this cohort was previously used by 10 for lung cancer prediction. where temporal changes of lung-related findings are clinically important risk factors. We ensure that each of the sampled patients having at least four chest-related radiology exams, including chest CT, chest X-ray, and abdomen CT, within a five-year window. According to the state cancer registry, 6 patients have future lung cancer diagnosis records within 3 years, and 4 patients have no diagnosis records of any type of cancer. The raw EHRs contain 65 chest-related exam reports from all patients. The number of reports per patient ranges from 4 to 12, and longitudinal report lengths measured in tokens range from 646 to 4625, with an average at 2055. We create a timeline for each patient based on their longitudinal radiology reports, as illustrated in Figure 1. Each column represents the findings ( gold findings ) extracted from an individual radiology report, while each row captures the temporal evolution of a specific finding mentioned across multiple reports ( gold group assignments ). Each row is further assigned a gold group name , summarizing the key characteristics of the findings in this row. Since our focus is on tracking lung-related conditions, findings pertaining to other organs (e.g., the aorta) or descriptions of medical devices are considered irrelevant and are omitted from the timelines. We work with two medical students and one medical doctor as annotators during the timeline creation process. We first automatically generate timelines using LLMs (see Section 3 for details) and hand-correct LLM generated findings and group assignments based on the feedback from two medical student annotators. Finally, a third annotator reviews the gold finding groups, and hand-corrects row names of each version of gold group assignments to produce the gold group names. Annotation guidelines are included in Appendix A . 2.1. Gold Findings (Columns) Factuality evaluation: We ask two medical student annotators to rate the factuality of each generated finding against its associated report, and to add any missing findings that the model fails to include. In addition, they provide notes explaining the identified errors, which are later used by an author to manually correct the generated findings as the gold-standard reference. To reduce annotation efforts and focus on abnormalities, we manually drop absent findings, such as ”no new nodules,” and normal findings, such as “clear lungs.” The original automatically generated timelines contain 221 findings from 61 reports. After removing absent findings, we obtain 155 findings