TRACE: Temporal Radiology with Anatomical Change Explanation for Grounded X-ray Report Generation
OFM Riaz Rahman Aranya, Kevin Desai · 2026
Read TRACE: Temporal Radiology with Anatomical Change Explanation for Grounded X-ray Report Generation by OFM Riaz Rahman Aranya, Kevin Desai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02963.txt.
Introduction
Comparing chest X-rays over time is automated in a second 2026 paper by OFM Riaz Rahman Aranya and 1 co-author. Radiologists compare a prior and current scan to spot progression, response to treatment, or new findings. Earlier vision-language models handled single images, but none combined comparison, change classification, and localization together.
Their model, TRACE, takes both scans as input. It writes natural-language descriptions of interval changes, labeling each as worsened, improved, or stable. Each finding comes with box coordinates locating it in the image. Grounding score exceeded ninety percent. Ablation tests revealed something striking. Change finding emerged only when comparison and grounding were learned jointly, suggesting grounding supplies the spatial focus time thinking needs.
Catalog record
| CREATOR | OFM Riaz Rahman Aranya, Kevin Desai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02963
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TRACE: Temporal Radiology with Anatomical Change Explanation for Grounded X-ray Report Generation OFM Riaz Rahman Aranya, Kevin Desai Abstract Temporal comparison of chest X-rays is fundamental to clinical radiology, enabling detection of disease progression, treatment response, and new findings. While vision-language models have advanced single-image report generation and visual grounding, no existing method combines these capabilities for temporal change detection. We introduce Temporal Radiology with Anatomical Change Explanation (TRACE), the first model that jointly performs temporal comparison, change classification, and spatial localization. Given a prior and current chest X-ray, TRACE generates natural language descriptions of interval changes (worsened, improved, stable) while grounding each finding with bounding box coordinates. TRACE demonstrates effective spatial localization with over 90% grounding accuracy, establishing a foundation for this challenging new task. Our ablation study uncovers an emergent capability: change detection arises only when temporal comparison and spatial grounding are jointly learned, as neither alone enables meaningful change detection. This finding suggests that grounding provides a spatial attention mechanism essential for temporal reasoning. Code is available at https://github.com/UTSA-VIRLab/TRACE 1 Introduction Radiologists routinely compare current chest X-rays with prior studies to detect interval changes, determining whether findings have worsened, improved, or remained stable. These temporal assessments are critical for clinical decision-making: a worsening pneumothorax may require immediate intervention, while an improving pleural effusion suggests effective treatment. Studies have demonstrated that longitudinal chest X-ray analysis provides important insights into disease progression, guides treatment decisions, and improves prognostic accuracy [ 9 , 19 ] . In the MIMIC-CXR [ 15 ] dataset alone, more than 67% of patients undergo multiple examinations, yet existing automated methods largely ignore this temporal information. Figure 1 : Comparison of chest X-ray report generation approaches. Single-Image Report Generation (R2Gen [ 6 ] ) generates reports without temporal context or spatial grounding. Temporal Comparison (BioViL-T [ 2 ] , CheXRelNet [ 16 ] , CheXRelFormer [ 22 ] ) detects disease progression but outputs only classification labels. Grounded Report Generation (ChEX [ 25 ] ) produces spatially grounded reports but lacks temporal reasoning. Temporal Grounded Report Generation (MAIRA-2 [ 1 ] ) uses prior images with grounding but without explicit change classification. TRACE (Ours) is the first to combine explicit temporal change classification with spatial grounding, describing what changed, where, and how. Despite the clinical importance of temporal comparison, automated radiology report generation methods have predominantly focused on single-image analysis [ 14 , 6 , 24 , 5 ] . These approaches, while achieving impressive results on individual images, cannot capture disease progression or generate the comparison statements that are central to clinical radiology reports [ 11 ] . Recent surveys highlight this gap, noting that without access to prior studies, models often hallucinate spurious temporal references or fail to capture meaningful changes [ 23 ] . Recent advances in vision-language models have enabled substantial progress in medical image analysis. Encoder-decoder architectures with attention mechanisms [ 6 ] , memory-driven transformers [ 5 ] , and knowledge graph integration [ 31 , 17 ] have improved report quality. Large language models have further advanced the field, enabling conversational radiology assistance [ 26 ] and more natural report generation [ 20 , 18 ] . Separately, visual grounding methods have emerged to localize findings with bounding boxes, including MS-CXR [ 3 ] , medical phrase grounding approaches [ 4 ] , and grounded report generation systems [ 1 , 25 ] . These grounding methods improve interpretability by showing where findings are located, but operate on single images without temporal context. Conversely, methods that do address temporal comparison lack the ability to spatially localize where changes occur. Some recent work has begun to address temporal aspects of chest X-ray analysis. BioViL-T [ 2 ] introduced temporal pre-training to learn representations that capture changes across studies. CheXRelNet [ 16 ] proposed tracking longitudinal pathology relationships between chest X-ray pairs. MAIRA-2 [ 1 ] uses prior images and reports as context for current report generation, improving consistency. Methods incorporating longitudinal data have shown improved clinical accuracy [ 27 , 21 ] . However, none of these approaches combines explicit temporal change classification (worsened/improved/stable) with spatial grounding to localize where changes occur. We introduce TRACE (Temporal Radiology with Anatomical Change Explanation), the first model for grounded temporal change detection in chest X-rays. As illustrated in Figure 1 , existing methods address only subsets of this problem: single-image report generation lacks temporal context, temporal classification lacks spatial grounding, and grounded generation lacks temporal reasoning. TRACE unifies all three capabilities. Given a prior and current study, TRACE generates a natural language report describing interval changes while localizing each finding with bounding box coordinates. For example, given two chest X-rays, TRACE produces outputs such as: ‘‘Interval worsening of pneumothorax <box>0.19,0.11,0.52,0.63</box> in right lung.’’ This unified output provides clinically actionable information: the finding (pneumothorax), the change (worsening), and the location (bounding box). Our ablation study reveals a surprising finding: temporal change detection is an emergent capability that requires both temporal comparison and spatial grounding. Remarkably, a model with access to both prior and current images but without grounding supervision fails at change detection, predicting “stable” for all samples. We hypothesize that grounding provides a spatial attention mechanism that enables the model to focus on specific anatomical regions when comparing images temporally. Our contributions are: • We introduce grounded temporal change detection, a new task combining temporal comparison, change classification, and spatial localization in a unified framework. • We discover an emergent capability: change detection only arises when both temporal comparison and spatial grounding are combined. Without grounding supervision, models fail to detect changes even with access to both images. • We construct a large-scale dataset with grounded temporal annotations from MIMIC-CXR and Chest ImaGenome (79,202 training, 22,553 test samples) to enable systematic evaluation of temporal reasoning with spatial grounding. 2 Related Work Radiology Report Generation. Automated radiology report generation has evolved significantly from early template-based approaches to sophisticated deep learning methods. The encoder-decoder paradigm dominates the field, where visual encoders extract features from medical images and language decoders generate textual reports [ 14 , 6 ] . Jing et al. [ 14 ] employed CNN encoders with LSTM decoders and co-attention mechanisms to produce coherent reports. The introduction of Transformer-based architectures marked a significant advance, with R2Gen [ 6 ] and R2GenCMN [ 5 ] improving the capture of long-range dependencies and reducing repetitive text generation. Knowledge graph integration [ 31 , 17 ] injects medical domain knowledge to generate more clinically relevant descriptions. Miura et al. [ 24 ] applied reinforcement learning with clinical metrics as rewards to improve factual correctness. METransformer [ 29 ] captures fine-grained visual patterns through learnable expert tokens. Despite these advances, most methods process single images and cannot generate the temporal comparison statements that are fundamental to clinical radiology practice (Figure 1 , Row 1). Temporal Analysis in Chest Radiography. Longitudinal analysis of chest X-rays is essential for monitoring disease progression and treatment response [ 9 , 19 ] . Li et al. [ 19 ] employed Siamese neural networks to evaluate disease severity changes between longitudinal patient visits using metric learning. CheXRelNet [ 16 ] tracks pathology change relations between chest X-ray pairs using anatomy-aware graph