MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss
Can Zhao, Pengfei Guo, Dong Yang, Yucheng Tang, Yufan He, Benjamin Simon, Mason Belue, Stephanie Harmon, Baris Turkbey, Daguang Xu · 2025
Read MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss by Can Zhao, Pengfei Guo, Dong Yang, Yucheng Tang, Yufan He, Benjamin Simon, Mason Belue, Stephanie Harmon, Baris Turkbey, Daguang Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-05772.txt.
Introduction
Can Zhao and co-authors present MAISI-v2 in a 2025 paper on making three-dimensional medical images with a computer. Made-up scans can help train tools and protect patient privacy, but many methods work only for one body part, run slowly, or drift from the traits they were asked to show. The team's earlier system fixed the first flaw but stayed slow and loose in its control.
MAISI-v2 uses a faster flow-based method to speed up image making by a large factor while keeping quality high. A new training loss makes the output match the region of interest more closely. Tests show top image quality, and made-up images also helped a task that outlines organs, which points to value for training data.
Catalog record
| CREATOR | Can Zhao, Pengfei Guo, Dong Yang, Yucheng Tang, Yufan He, Benjamin Simon, Mason Belue, Stephanie Harmon, Baris Turkbey, Daguang Xu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-05772
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss Can Zhao, Pengfei Guo, Dong Yang, Yucheng Tang, Yufan He, Benjamin Simon, Mason Belue, Stephanie Harmon, Baris Turkbey, Daguang Xu Abstract Medical image synthesis is an important topic for both clinical and research applications. Recently, diffusion models have become a leading approach in this area. Despite their strengths, many existing methods struggle with (1) limited generalizability that only work for specific body regions or voxel spacings, (2) slow inference, which is a common issue for diffusion models, and (3) weak alignment with input conditions, which is a critical issue for medical imaging. MAISI, a previously proposed framework, addresses generalizability issues but still suffers from slow inference and limited condition consistency. In this work, we present MAISI-v2 , the first accelerated 3D medical image synthesis framework that integrates rectified flow to enable fast and high quality generation. To further enhance condition fidelity, we introduce a novel region-specific contrastive loss to enhance the sensitivity to region of interest. Our experiments show that MAISI-v2 can achieve SOTA image quality with 𝟑𝟑 × \mathbf{33\times} acceleration for latent diffusion model. We also conducted a downstream segmentation experiment to show that the synthetic images can be used for data augmentation. We release our code, training details, model weights, and a GUI demo to facilitate reproducibility and promote further development within the community. Code and model weights — https://github.com/Project-MONAI/tutorials/tree/main/generation/maisi GUI demo — https://build.nvidia.com/nvidia/maisi Introduction Medical image synthesis is a foundational task in medical AI, supporting applications such as data augmentation, modality translation, anomaly simulation, and privacy-preserving data sharing. By generating anatomically plausible and condition-aware 3D images, synthesis models help train robust models in low-data regimes, support cross-modality translation, and enable reproducible benchmarking on synthetic datasets. As medical imaging advances toward more personalized, heterogeneous, and multimodal data, the need for generalizable and controllable synthesis frameworks becomes increasingly critical. Most existing medical image synthesis methods generally fall into three categories: (1) direct regression , which directly predicts voxel intensities from condition inputs using supervised loss functions ( Zhao et al. 2017 ; Dewey et al. 2019 ) ; (2) GAN-based models , which generate realistic images by adversarial training ( Yang et al. 2020 ; Nie et al. 2017 ; Chartsias et al. 2017 ; Sun et al. 2022 ) ; and (3) diffusion-based models , which learn to reverse a forward noising process through a series of denoising steps ( Dorjsembe et al. 2024 ; Pinaya et al. 2022 ; Guo et al. 2025 ; Zhu et al. 2023 ; Friedrich et al. 2024 ; Chen et al. 2024 ; Wang et al. 2024 ) . Among these three categories, diffusion models have emerged as the state of the art in image generation, due to their stability and ability to model complex distributions. Their application to 3D medical imaging is particularly promising, yet their clinical deployment remains limited due to three primary challenges: (1) large variation for real-world medical images, (2) slow inference for diffusion models like Denoising Diffusion Probabilistic Models (DDPM) ( Ho, Jain, and Abbeel 2020 ) , and (3) weak condition fidelity. First, many diffusion-based medical synthesis models are trained on narrow datasets—specific organs, modalities, or voxel spacings—limiting their ability to generalize to real-world clinical data, which varies widely in resolution, anatomy, and acquisition protocol ( Dorjsembe et al. 2024 ; Pinaya et al. 2022 ; Zhu et al. 2023 ; Friedrich et al. 2024 ) . Second, diffusion models typically require hundreds of iterative denoising steps during inference, which becomes computationally prohibitive in 3D. Existing methods either can only generate relatively small volumes like 256\times 256\times 256 ( Dorjsembe et al. 2024 ; Pinaya et al. 2022 ; Zhu et al. 2023 ; Friedrich et al. 2024 ; Chen et al. 2024 ; Xu et al. 2024 ) or take a long time (over 10 minutes) to generate high-resolution volumes such as 512\times 512\times 512 ( Guo et al. 2025 ; Wang et al. 2024 ) . If the cost to generate a synthetic image is too high, the practical value of medical image synthesis will be limited. Third, while recent work in 2D natural image synthesis like ControlNet++ ( Li et al. 2024 ) has improved condition fidelity over ControlNet ( Zhang, Rao, and Agrawala 2023 ) , such strategies are underexplored in 3D medical synthesis, often leading to unsatisfying alignment between the conditioning input and the output. This is a particularly critical issue in medical image applications. To address generalization, the MAISI framework ( Guo et al. 2025 ) and 3D MedDiffusion ( Chen et al. 2024 ) were introduced as unified 3D medical image synthesis systems that leverage latent diffusion models (LDMs) and ControlNet to handle diverse anatomical structures and voxel spacings. However, they both still inherit two major limitations of standard LDM and ControlNet: slow inference and lack of robust condition control. To tackle efficiency, rectified flow models ( Liu, Gong, and Liu 2022 ) have recently emerged as a powerful alternative to traditional diffusion models. By replacing the stochastic denoising process with a deterministic ordinary differential equation (ODE), rectified flow enables faster sampling while preserving generation quality. This approach has shown promising results in natural image generation and video generation, including Open Sora ( Peng et al. 2025 ) and Stable Diffusion 3.0 ( Esser et al. 2024 ) , but has not yet been extended to 3D medical imaging. To improve condition fidelity, cycle-consistency loss like ControlNet++ ( Li et al. 2024 ) has been proposed in 2D generative models. But it requires to train an additional reverse network using ground-truth conditions, which makes the procedure complicated. Also the error in the reverse network propagates. In this work, we present MAISI-v2 , a next-generation framework for accelerated and condition-consistent 3D medical image synthesis. Our contributions are as follows: • First Rectified Flow Model for 3D Medical Image Synthesis: We adapt rectified flow to the 3D medical domain and integrate it into a latent diffusion framework, achieving substantial \mathbf{33\times} acceleration in inference while preserving image quality. • Novel Region-Specific Contrastive Loss: We propose a region-specific contrastive loss to enhance the model’s sensitivity to small, localized conditions, such as small tumors, while maintaining background consistency. • Open-Source Framework and Pretrained Models: We release code, training details, model weights, and a GUI demo to support reproducibility and provide a strong baseline for future research in controllable and efficient 3D image synthesis. Related Work MAISI: Medical AI for Synthetic Imaging MAISI ( Guo et al. 2025 ) is a modular 3D medical image synthesis framework designed to handle diverse anatomical structures and acquisition protocols. It consists of three key components: 1. Variational Autoencoder (VAE): MAISI compresses high-resolution 3D volumes into a compact latent space using a VAE trained with a reconstruction loss. The 1-channel images are spatially compressed by 4\times 4\times 4 and generate 4 channel latent features. The overall compression rate is 16. 2. DDPM-based Latent Diffusion Model (LDM): MAISI uses a DDPM-based LDM to generate synthetic latent volumes. Given a latent z , the model learns to denoise noisy versions z_{t} over time steps t . The training objective minimizes the standard denoising loss: \mathcal{L}_{\text{ddpm}}=\mathbb{E}_{z,\epsilon,t}\left[\left\|\epsilon-\epsilon_{\theta}(z_{t},c,t)\right\|^{2}\right] (1)