A Unified Low-level Foundation Model for Enhancing Pathology Image Quality

Ziyi Liu, Zhe Xu, Jiabo Ma, Wenqaing Li, Junlin Hou, Fuxiang Huang, Xi Wang, Ronald Cheong Kin Chan, Terence Tsz Wai Wong, Hao Chen · 2025

Read A Unified Low-level Foundation Model for Enhancing Pathology Image Quality by Ziyi Liu, Zhe Xu, Jiabo Ma, Wenqaing Li, Junlin Hou, Fuxiang Huang, Xi Wang, Ronald Cheong Kin Chan, Terence Tsz Wai Wong, Hao Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01071.txt.

Introduction

Images of tissue under a microscope often suffer noise, blur, and low detail, which can slow or skew diagnosis. Ziyi Liu, with nine co-authors, builds a single foundation model to fix many such flaws at once. Earlier methods each handled one flaw only, such as removing noise or sharpening an image.

Their model restores images through tasks such as super-resolution, deblurring, and denoising, and it can also do virtual staining, where stain colors are added by software instead of chemicals. A contrast-based training step helps one design serve all these jobs. Liu and the team present it as the first unified low-level model of its kind for pathology, aiming for faster and more consistent lab work.

Catalog record

CREATORZiyi Liu, Zhe Xu, Jiabo Ma, Wenqaing Li, Junlin Hou, Fuxiang Huang, Xi Wang, Ronald Cheong Kin Chan, Terence Tsz Wai Wong, Hao Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE126 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01071

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Unified Low-level Foundation Model for Enhancing Pathology Image Quality Ziyi Liu, Zhe Xu, Jiabo Ma, Wenqaing Li, Junlin Hou, Fuxiang Huang, Xi Wang, Ronald Cheong Kin Chan, Terence Tsz Wai Wong, Hao Chen Abstract Foundation models have revolutionized computational pathology by achieving remarkable success in high-level diagnostic tasks, yet the critical challenge of low-level image enhancement remains largely unaddressed. Real-world pathology images frequently suffer from degradations such as noise, blur, and low resolution due to slide preparation artifacts, staining variability, and imaging constraints, while the reliance on physical staining introduces significant costs, delays, and inconsistency. Although existing methods target individual problems like denoising or super-resolution, their task-specific designs lack the versatility to handle the diverse low-level vision challenges encountered in practice. To bridge this gap, we propose the first unified Low-level Pathology Foundation Model (LPFM), capable of enhancing image quality in restoration tasks, including super-resolution, deblurring, and denoising, as well as facilitating image translation tasks like virtual staining (H&E and special stains), all through a single adaptable architecture.Our approach introduces a contrastive pre-trained encoder that learns transferable, stain-invariant feature representations from 190 million unlabeled pathology images, enabling robust identification of degradation patterns. A unified conditional diffusion process dynamically adapts to specific tasks via textual prompts, ensuring precise control over output quality. Trained on a curated dataset of 87,810 whole slied images (WSIs) across 34 tissue types and 5 staining protocols, LPFM demonstrates statistically significant improvements (p<0.01) over state-of-the-art methods in most tasks (56/66), achieving Peak Signal-to-Noise Ratio (PSNR) gains of 10-15% for image restoration and Structural Similarity Index Measure (SSIM) improvements of 12–18% for virtual staining. More importantly, LPFM represents a transformative advancement for digital pathology, as it not only overcomes fundamental image quality barriers but also establishes a new paradigm for stain-free, cost-effective, and standardized pathological analysis, which is crucial for enabling scalable and equitable deployment of AI-assisted pathology worldwide. keywords Computational Pathology, Image Restoration, Virtual Staining, Foundation Model Figure 1: Overview of the proposed low-level pathology foundation model (LPFM) for pathology image restoration and virutal staining. a. The pathology imaging and virtual staining workflow, illustrating the process from tissue sampling to pathology images. LPFM can achieve pathology image restoration and virtual staining in the workflow. b. The unified architecture of LPFM integrates contrastive pre-training and prompt-guided conditional diffusion for task-specific generation. c. The curated datasets includes 87,810 whole-slide images (WSIs) and 190 million patches from 37 data sources, encompassing 34 tissue types and 5 staining protocols. d. Our proposed LPFM was rigorously evaluated through 50 distinct experimental tasks organized into four fundamental image restoration categories, including 18 image super-resolution tasks (varying scale factors), 18 imaging deblurring tasks (different blurring kernel sizes), 18 Gaussian denoising tasks (with varying noise distributions), and 6 coupled-degradation pathology image restoration tasks (addressing composite artifacts). e. Performance evaluation of LPFM against competing methods across 6 virtual staining tasks, including Autofluorescence (AF) to Hematoxylin & Eosin (H&E) stains for rapid diagnosis, H&E to Periodic Acid-Schiff-Alcian Blue (PAS-AB) for glycoprotein detection, H&E to multiplex immunohistochemistry (mIHC) for biomarker analysis based on the original and degraded pathology images. 1 Introduction The advent of digital pathology has revolutionized modern medicine by transitioning traditional glass slides into high-resolution whole slide images (WSIs), enabling computerized analysis [ 1 ] , enhanced collaborative diagnostics across institutions [ 2 ] , and AI-assisted decision support [ 3 ] . This digital transformation began with slide scanning technologies [ 4 ] and has since evolved into an essential component of precision medicine [ 5 , 6 ] , allowing pathologists to examine tissue morphology at unprecedented scales [ 7 ] while facilitating large-scale collaborative research [ 8 , 9 ] . However, diagnostic utility is frequently compromised by multiple degradation problems in the imaging pipeline [ 10 , 11 ] . During slide preparation, tissue sections may suffer from folding [ 12 ] , tearing [ 13 ] , or staining inhomogeneity [ 14 ] , while scanning introduces optical blur [ 15 ] , noise [ 16 ] , and resolution limitations [ 17 ] . These degradations collectively obscure critical cellular features including nuclear pleomorphism [ 18 , 19 ] , inflammatory infiltrates [ 20 ] , and subtle pathological changes [ 21 ] , potentially leading to diagnostic uncertainty. The limitations of physical rescanning are manifold [ 22 , 9 ] : time constraints [ 18 ] , prohibitive costs [ 23 ] , technical irreversibility of preparation artifacts [ 4 ] , and frequent biopsy exhaustion [ 7 ] . This has spurred computational approaches to enhance image quality through both restoration techniques (e.g., noise reduction [ 10 ] , deblurring [ 24 ] , super-resolution [ 5 ] ) and virtual staining methods [ 25 , 26 ] . Current solutions remain fragmented [ 27 , 17 ] , typically addressing either restoration or staining separately [ 28 , 29 ] , with denoising models potentially altering stain characteristics [ 13 ] and staining networks amplifying artifacts [ 30 ] . The field lacks unified generative frameworks capable of handling diverse low-level vision tasks [ 31 , 32 ] , forcing clinics to maintain incompatible specialized systems [ 2 ] . Pathology imaging particularly suffers from this fragmentation despite shared underlying challenges [ 33 , 34 ] . Our work addresses this critical gap by introducing the first unified low-level generative foundation model for enhancing pathology image quality, including pathology image restoration and translation. Unlike existing task-specific models that process artifacts and stains in isolation, our approach recognizes that these challenges are fundamentally interconnected aspects of pathological image formation. This unified treatment enables synergistic improvements; for instance, stain-aware denoising and artifact-resistant stain transfer emerge naturally from the shared representation. We develop a novel pre-training paradigm using large-scale multi-tissue, multi-stain datasets, capturing both universal characteristics of pathological image degradation and stain-invariant morphological features. Furthermore, we pioneer a prompt-controlled framework that dynamically switches between low-level pathological tasks without architectural modifications. By integrating these innovations, we establish the first unified low-level pathology foundation model in computational pathology that moves beyond fragmented solutions to comprehensive image generation. 2 Results In this section, we conducted comprehensive evaluations across 66 distinct experimental tasks, systematically organized into six fundamental low-level vision categories: (i) super-resolution (18 tasks with varying scale factors and degradation models), (ii) image deblurring (18 tasks covering different kernel sizes), (iii) image denoising (18 tasks with varying noise intensities), (iv) coupled degradation restoration (6 tasks addressing composite artifacts), (v) virtual staining (3 tasks for stain transformation), and (vi) virtual staining for degraded pathology image (3 tasks combining physical degradations with stain conversion). Fig. 1 presents a comprehensive overview of the proposed low-level pathology foundation model (LPFM) for pathology image restoration and virtual staining. As shown in Fig. 1 b, LPFM included a contrastive pretraining framework that tackled multiple coupled degradation problems, generating coarsely restored and virtually stained images. The pretraining framework was trained through a contrastive loss by pulling closer the latent features of paired degraded images and their high-quality counterparts, while pushing away the features of unpaired samples. Building on the coarsely restored images, we proposed a conditional diffusion model that improved image quality through a guided denoising process, utilizing both

Read the complete text