CCS : C linical C onsensus S election for Radiology Report Generation
Xi Zhang ♠ ~{}^{\spadesuit} , Yingshu Li ♣ ~{}^{\clubsuit} , Zaiqiao Meng ♠ , ♢ ~{}^{\spadesuit,\diamondsuit} , Jake Lever ♠ ~{}^{\spadesuit} , Edmond S. L. Ho ♠ ~{}^{\spadesuit} ♠ School of Computing Science, University of Glasgow ♣ School of Electrical and Computer Engineering, University of Sydney ♢ Language Technology Lab, University of Cambridge [email protected] [email protected], [email protected] [email protected], [email protected] https://x-izhang.github.io/CCS/ · 2026
Read CCS : C linical C onsensus S election for Radiology Report Generation by Xi Zhang ♠ ~{}^{\spadesuit} , Yingshu Li ♣ ~{}^{\clubsuit} , Zaiqiao Meng ♠ , ♢ ~{}^{\spadesuit,\diamondsuit} , Jake Lever ♠ ~{}^{\spadesuit} , Edmond S. L. Ho ♠ ~{}^{\spadesuit} ♠ School of Computing Science, University of Glasgow ♣ School of Electrical and Computer Engineering, University of Sydney ♢ Language Technology Lab, University of Cambridge [email protected] [email protected], [email protected] [email protected], [email protected] https://x-izhang.github.io/CCS/ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30131.txt.
Introduction
Xi Zhang and four colleagues propose Clinical Consensus Selection for radiology reporting at test time. Standard systems decode a single report, yet a fixed model often holds stronger reports elsewhere in its candidate pool. CCS samples several candidates and picks the one with the highest clinical consensus, joining text utilities with a radiology utility from an image-report scorer. Across three datasets and several radiology models, it beats single-path output and Best-of-N baselines, with the clearest gains on clinical metrics.
Catalog record
| CREATOR | Xi Zhang ♠ ~{}^{\spadesuit} , Yingshu Li ♣ ~{}^{\clubsuit} , Zaiqiao Meng ♠ , ♢ ~{}^{\spadesuit,\diamondsuit} , Jake Lever ♠ ~{}^{\spadesuit} , Edmond S. L. Ho ♠ ~{}^{\spadesuit} ♠ School of Computing Science, University of Glasgow ♣ School of Electrical and Computer Engineering, University of Sydney ♢ Language Technology Lab, University of Cambridge [email protected] [email protected], [email protected] [email protected], [email protected] https://x-izhang.github.io/CCS/ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53600 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30131
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CCS : C linical C onsensus S election for Radiology Report Generation Xi Zhang ♠ ~{}^{\spadesuit} , Yingshu Li ♣ ~{}^{\clubsuit} , Zaiqiao Meng ♠ , ♢ ~{}^{\spadesuit,\diamondsuit} , Jake Lever ♠ ~{}^{\spadesuit} , Edmond S. L. Ho ♠ ~{}^{\spadesuit} ♠ School of Computing Science, University of Glasgow ♣ School of Electrical and Computer Engineering, University of Sydney ♢ Language Technology Lab, University of Cambridge [email protected] [email protected], [email protected] [email protected], [email protected] https://x-izhang.github.io/CCS/ Abstract Radiology report generation (RRG) is commonly formulated as a single-path generation task, where a multimodal large language model (MLLM) produces one decoded report as the final output. While recent progress has largely been driven by scaling training data, model capacity, and retrieval mechanisms, improving report quality at inference time remains underexplored. In this work, we observe that fixed radiology MLLMs often generate clinically stronger reports elsewhere in their candidate pool than the one selected by default decoding, suggesting that inference-time decision making remains an overlooked bottleneck. To address this, we propose C linical C onsensus S election ( CCS ), a decoder-agnostic inference-time selection framework that samples multiple candidate reports and selects the one with the highest clinical consensus across the rollout pool. CCS unifies text-based utilities with a radiology-adapted utility computed by an image–report-trained multimodal embedder, which measures candidate agreement beyond surface-level textual similarity. Across three datasets and multiple radiology MLLMs, CCS consistently improves inference-time performance over single-path decoding and generic Best-of- N N baselines, with particularly clear gains on clinical metrics. Further analysis shows that image-grounded utility forms a selection axis distinct from textual consensus and that substantial headroom remains for improving RRG at inference time. 1 Introduction Figure 1: From Single-Path Generation to Clinical Consensus Selection (CCS). (a) Conventional RRG systems ultimately return one decoded report as the final output; (b) CCS forms a candidate rollout pool and selects the report with higher relative clinical consensus. Radiology report generation (RRG) aims to express clinical findings from radiology images, such as chest X-rays, as free-text reports, forming a core component of the radiology workflow ( 25 ; 29 ) . Recent multimodal large language models (MLLMs) have driven substantial progress on this task by scaling model capacity ( 39 ; 21 ) , training data ( 1 ; 45 ) , and retrieval-augmented generation ( 43 ; 9 ) . However, comparatively less attention has been paid to improving report quality at inference time , where the model parameters and external evidence are fixed. Despite this progress, automated chest X-ray report generation remains far from meeting the demands of real-world clinical practice ( 51 ) . Most MLLMs still rely on single-path generation, committing to one report token by token (Figure 1 - a ), and even recent test-time refinements, such as clinical contrastive decoding ( 50 ) , follow a single decoded trajectory. This is fragile: one unfavourable decoding step can omit a finding or assert one unsupported by the image, with no mechanism for recovery. In this work, we observe that a fixed model often places clinically stronger reports elsewhere in its candidate pool than the one returned by default decoding, leaving a gap to the pool-bounded oracle (as shown in Figure 3 ). The bottleneck lies not in what the model can generate, but in which candidate it commits to, suggesting that inference-time decision making is an underexplored opportunity for improving RRG without modifying or retraining the model. Selecting among multiple generations has become a key mechanism for improving generation quality at test time, as seen in Best-of- N ( 37 ; 11 ; 12 ) and self-consistency methods ( 40 ; 19 ; 5 ) . However, existing selection criteria are not designed for radiology reports. Fluency, average log-probability, and textual agreement may favour plausible-sounding or conservative reports, but clinical correctness cannot be reduced to surface quality, token confidence, or text-only similarity. This is especially problematic for open-ended RRG, where multiple phrasings can be clinically equivalent and no reference report is available at test time. Effective inference-time optimisation therefore requires identifying candidates with high clinical consensus in radiology-adapted representation spaces, rather than relying only on conventional text-based signals (e.g., perplexity). To address this, we propose C linical C onsensus S election ( CCS ), a decoder-agnostic inference-time selection framework for RRG (Figure 1 - b ). Given a rollout pool from a radiology MLLM, CCS scores candidate pairs with a pluggable utility and returns the report with the highest mean consensus over the pool. We instantiate a radiology-adapted utility using Qwen3-VL-Embed ( 22 ) , a multimodal embedder adapted on image–report pairs, which measures candidate agreement in a radiology representation space and provides a signal beyond text-only similarity, particularly for symptom-level findings. Our contributions are: ❶ We revisit the RRG task from an inference-time perspective and show that candidate pools routinely contain reports with higher clinical reliability and consistency than single-path outputs. ❷ We propose CCS , a decoder-agnostic Best-of- N framework that aggregates pairwise clinical consensus over a candidate pool using textual and image–report-adapted multimodal utilities. ❸ Extensive experiments across three datasets, multiple radiology MLLMs, and qualitative case analyses show that CCS consistently improves backbone performance for RRG at inference time, while identifying image-grounded utility as a distinct selection axis beyond textual consensus. 2 Related Work 2.1 Radiology Report Generation RRG aims to generate clinically coherent reports from medical images. Early methods typically adopt encoder–decoder architectures trained on paired image–report data ( 25 ; 29 ; 41 ) . Recent work extends this paradigm with radiology MLLMs, including LLaVA-Med ( 21 ) , LLaVA-Rad ( 45 ) , Libra ( 49 ) , MAIRA ( 13 ; 1 ) , and biomedical foundation models ( 39 ) , often further enhanced by retrieval augmentation ( 38 ) . However, most RRG methods still follow a single-trajectory inference paradigm. While token-level methods such as contrastive decoding or logit manipulation ( 23 ; 50 ) adjust generation locally, CCS further optimises inference through reference-free candidate selection. 2.2 Inference-Time Optimisation Inference-time optimisation improves generation by allocating extra decoding-time computation without updating model parameters ( 37 ; 12 ) . Common strategies include Best-of- N reranking, self-consistency ( 40 ) , rollout-based selection ( 35 ) , and reference-free scoring via likelihood, confidence, or text agreement ( 11 ; 19 ; 5 ) . However, scoring criteria based on likelihood, confidence, or text agreement are poorly suited to RRG, where lexically similar reports may differ in findings, anatomy, laterality, or temporal interpretation. CCS instead selects the report with the highest clinical consensus within the rollout pool. 2.3 Multimodal Embeddings Multimodal embedding models learn shared representations across images and text, ranging from general-domain contrastive models ( 34 ; 46 ) to instruction-tuned embedders ( 28 ) and biomedical variants ( 47 ; 32 ) . These models are primarily developed for retrieval or representation learning rather than report selection. CCS repurposes radiology-adapted multimodal embeddings ( 22 ) as utility functions for candidate comparison, enabling image-grounded consensus estimation during inference. 3 Clinical Consensus Selection Rethinking Radiology Report Generation. A key challenge in inference-time RRG is that report quality cannot be directly verified. Rollout-based methods in reasoning LLMs, such as Group Relative Policy Optimisation (GRPO) ( 35 )