Denoising study of Fluoroscopic Images in real time tumor tracking System based on Statistical model of noise

Yongxuan Yan, Fumitake Fujii, Takehiro Shiinoki · 2024

Read Denoising study of Fluoroscopic Images in real time tumor tracking System based on Statistical model of noise by Yongxuan Yan, Fumitake Fujii, Takehiro Shiinoki (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00199.txt.

Description

A 2024 arXiv research paper by Yongxuan Yan, Fumitake Fujii, Takehiro Shiinoki. This study investigates the noise characteristics of intraoperative X-ray fluoroscopic images acquired during real-time image-guided radiotherapy (IGRT), and presents a novel noise image generation method based on the identified noise amplitude and spatial probability patterns. Initially, noise-free digitally reconstructed radiographs (DRRs) were generated using patient CT data combined with projection algorithms and the spatial configuration of the real-time tumor tracking system.

Catalog record

CREATORYongxuan Yan, Fumitake Fujii, Takehiro Shiinoki
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE12 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-00199

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Denoising study of Fluoroscopic Images in real time tumor tracking System based on Statistical model of noise Yongxuan Yan, Fumitake Fujii, Takehiro Shiinoki Abstract This study investigates the noise characteristics of intraoperative X-ray fluoroscopic images acquired during real-time image-guided radiotherapy (IGRT), and presents a novel noise image generation method based on the identified noise amplitude and spatial probability patterns. Initially, noise-free digitally reconstructed radiographs (DRRs) were generated using patient CT data combined with projection algorithms and the spatial configuration of the real-time tumor tracking system. Based on the observed noise probability and amplitude distributions, noise was then added to these DRRs to create Dataset 1. As a control, Dataset 2 was generated by adding Gaussian noise with the same mean and variance as Dataset 1; however, the noise probability in Dataset 2 is independent of pixel location and pixel intensity. Both datasets were used to fine-tune a pre-trained SwinIR model with identical training parameters. Tests on phantom images containing real noise show that the SwinIR model trained with the proposed noise model dataset achieves superior denoising performance over the model trained with Gaussian noise and the model without transfer learning, with an average PSNR improvement of 1.45 dB. This study contributes to a deeper understanding of noise patterns in these fluoroscopic images and is crucial for enhancing image quality and the accuracy of real-time tumor tracking in radiotherapy. 1 Introduction Stereo X-ray tumor tracking systems are widely used in IGRT for lung cancer [ 1 ] . Investigating noise characteristics in these X-ray fluoroscopic images is essential to improve image quality and the subsequent accuracy of real-time tumor tracking. The X-ray tube is typically embedded beneath the floor while the imaging plane is mounted on the ceiling in stereo X-ray imaging systems. This alignment allows the linear accelerator and treatment table to move freely [ 2 , 3 ] . This unique geometry significantly increases the object-to-image distance (OID), (a) Noise probability distribution (b) Fluoroscopic image (c) Average noise amplitude Figure 1: Noise probability distribution and amplitude in a SyncTraX fluoroscopic X-ray image. (a) This heatmap reveals lower noise probabilities in the square regions corresponding to embedded aluminum blocks, while in the circular area representing the gelatin, the noise probability decreases as the distance to the image center decreases. (b) The contrast of this image has been enhanced to clearly show the aluminum blocks. The central circular area represents the gelatin, inside which four aluminum blocks of varying thicknesses are placed to simulate human tissue and bones. (c) This heatmap shows the distribution of average noise amplitude across the entire image. The noise amplitude is lowest and smoothest within the gelatin, while the amplitude peaks and fluctuates sharply at the gelatin boundaries. which exacerbates noise in the images. We use a real-time tumor tracking system SyncTraX (Shimadzu, Co. Ltd, Kyoto, Japan) in this study. The OID of this imaging system is 2091 with 10 mm installation tolerances. The increased OID may result in higher noise levels in the captured images, sharply contrasts with traditional diagnostic X-rays where the patient is positioned as close as possible to the imaging plane. Despite the importance of improving the image quality of such fluoroscopic images for radiotherapy, there is limited research on denoising algorithms specifically designed for these images. Most existing efforts have focused on diagnostic X-ray images [ 4 ] or CT images [ 5 ] , leaving a gap in the literature for applications specific to IGRT. 2 Materials and Methods To investigate the noise characteristics in the SyncTraX fluoroscopic images, two cylindrical gelatin phantoms were created: one entirely composed of gelatin, and the other embedded with aluminum blocks as shown in Fig. 2 . 300 X-ray fluoroscopic images were taken under ’100KV, 80mA, 4ms’ X-ray condition. The acquired 16-bit raw data were preprocessed to obtain uint8 384 × 384 images for imaging group 3, as shown in Fig. 3 . Figure 2: Image acquisition site (left) and the gelatin cylinder (right) with aluminum blocks which are numbered as 4, 3, 2, and 1 from left to right. Figure 3: Pre-processed images from collected 16-bit raw data. From left to right are (1) original image. In the background, the area with relatively higher brightness in the lower left corner is the air, whereas the rest corresponds to the treatment couch. (2) Contrast-enhanced image, and (3) image with the non-gelatin regions removed. For each group of images, we calculated the difference between each image and the reference image. The reference images I_{\text{ref}} were obtained by averaging all captured images of each group I_{\text{ref}}=\frac{1}{N}\sum_{i=1}^{N}I_{i}, where N is the total number of images and I_{i} is each individual image in a group. We define the noise image Noise_{i} as follows: Noise_{i}=I_{i}-I_{\text{ref}} To calculate the noise probability, a threshold T is defined, and the noise probability at a pixel P(x,y) is calculated as the frequency of its value in Noise_{i} exceeding the threshold: P(x,y)=\frac{1}{N}\sum_{i=1}^{N}\mathbb{f}\left(|Noise_{i}(x,y)|>T\right) where the indicator function \mathbb{f}(\cdot) is defined as follows: \mathbb{f}(|Noise_{i}(x,y)|>T)=\begin{cases}1,&\text{if }|Noise_{i}(x,y)|>T\\ 0,&\text{if }|Noise_{i}(x,y)|\leq T\end{cases} This allowed us to isolate the noise from the background. We altered the noise detection threshold T from 0 to 50, with an increment of 1, to evaluate how different thresholds impacted noise probability. Noise probability heatmaps were generated for each threshold as illustrated in Fig. 4 . We also created amplitude distribution maps to visualize noise amplitude across the entire image space as illustrated in Fig. 1 (c). These maps provide a comprehensive view of the noise characteristics in the fluoroscopic images. We generated noise onto noise-free DRR images based on the spatial distribution and amplitude characteristics of the observed noise probability. 800 DRR images were generated using a ray-projection algorithm on patient CT data, and both the DRR and noise images were used as training data for transfer learning of the pre-trained SwinIR [ 6 ] model. A control groups were designed for comparison by using a traditional Gaussian noise generation algorithm to create standard noisy images for SwinIR training. We refer to the models as SwinIR-c and SwinIR-n to represent the SwinIR model trained with our noise images, and the model trained with standard Gaussian noise images, respectively. The training batch size is 256, with initial learn rate of 0.001 and 10 epochs. As the patients move their body based on respiration and heartbeat, it was not feasible to create noise-suppressed reference images through averaging. Therefore, we used phantom images of types (2) and (3) from Fig. 3 to test the SwinIR models, with reference images as the ground truth for model evaluation. 3 Experimental Results The spatial probability distribution and amplitude characteristics of the noise are summarized in Fig. 5 and Fig. 6 . Based on these statistical models, we developed a method for calculating noise probability. For each pixel in the DRR images generated in this experiment, the composite noise probability is determined by the basic global noise probability shown in Fig.7 and the pixel’s intensity. Lower pixel values indicate greater X-ray absorption at that pixel, leading to a lower noise probability. The composite noise probability P(i,j) in this experiment is calculated as follows: P_{(i,j)}=P_{f(i,j)}+V_{(i,j)}\cdot\delta, where P_{f(i,j)} is the basic noise probability of pixel (i,j) , V_{(i,j)} represents the intensity of a pixel

Read the complete text