MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentation
Chamani Shiranthika, Hadi Hadizadeh, Parvaneh Saeedi · 2026
Read MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentation by Chamani Shiranthika, Hadi Hadizadeh, Parvaneh Saeedi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04108.txt.
Introduction
Chamani Shiranthika, Hadi Hadizadeh, and Parvaneh Saeedi propose MuCALD-SplitFed, a framework for medical image segmentation across sites that cannot share raw data. Federated learning combines model updates instead of data, and split federated learning further divides the model between clients and a server. Real clinical teams, however, work on different tasks at different sites. Standard setups handle that poorly, and with privacy vulnerabilities.
Their multi-task split-federated framework joins causal representation learning with latent diffusion. In experiments it improved results while a baseline split-federated method failed to converge. The approach also reduced information leakage at split points. It blunted reconstruction-based and membership inference attacks. It outperformed state-of-the-art personalized and multi-task federated learning methods.
Catalog record
| CREATOR | Chamani Shiranthika, Hadi Hadizadeh, Parvaneh Saeedi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.04108
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentation Chamani Shiranthika, Hadi Hadizadeh, Parvaneh Saeedi Abstract Federated Learning enables decentralized training by aggregating model updates across clients without sharing raw data, while Split Federated Learning further partitions the model between clients and a server to reduce computation and communication at the client side. However, decentralized medical institutions rarely operate on a single shared task, making standard Federated and SplitFed collaborations poorly aligned with real clinical workflows. Multi-task FL extends these frameworks by allowing clients to handle different tasks, but often introduces instability and privacy vulnerabilities. This study proposes MuCALD-SplitFed , a multi-task SplitFed framework that integrates causal representation learning and latent diffusion. Experiments show MuCALD-SplitFed consistently improves segmentation, while baseline SplitFed fails to converge. The proposed approach further reduces information leakage at split points, mitigating reconstruction-based and membership inference attacks. Additionally, MuCALD SplitFed outperforms state-of-the-art personalized FL and multi-task FL approaches. The code repository is: https://github.com/ChamaniS/MuCALD_SplitFed . † † address: School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada 1 Introduction Medical image segmentation plays a critical role in clinical workflows. Hospitals, clinics, and research laboratories often differ in imaging modalities, annotation quality, acquisition protocols, population demographics, etc. Practical medical AI systems therefore require learning frameworks that can generalize across heterogeneous tasks while preserving privacy. Decentralized learning paradigms such as Federated Learning (FL) [ 23 ] , Split Learning (SL) [ 11 ] , and Split Federated Learning (SplitFed) [ 33 ] enable collaborative model training without sharing raw data. However, these approaches implicitly assume all clients solve the same task—the non-IID assumption [ 23 ] . which is unrealistic in real clinical settings. Multi-task learning relaxes this constraint by allowing clients to train on domain-specific tasks while benefiting from shared global representations. In the literature, multi-task refer to clients with non-IID institutional data, or clients working on related but different tasks (which is neither IID nor non-IID), or setups where multiple objectives (e.g., segmentation and classification) are learned jointly. Multi-task FL methods- MOCHA [ 31 ] , sheaf-based FL [ 14 ] , FedAlign [ 12 ] , and multi-task SplitFed variants- FedBone [ 5 ] , FedMSplit [ 4 ] , homomorphically encrypted multi-task SL [ 9 ] demonstrate effective collaboration under heterogeneous tasks. Multi-task SplitFed systems often introduce convergence instability, as clients optimize heterogeneous objectives across different data distributions and label spaces. During federated aggregation, gradients from different tasks can conflict, leading to unstable or oscillatory updates. The shared latent representation at split points entangles task-specific features, amplifying cross-task interference and hindering convergence. Multi-task SplitFed further introduces generalization and privacy challenges. Split-point communications can leak sensitive information, enabling attacks such as membership inference, reconstruction, property inference, and task-driven client drift. These risks are amplified by diverse task semantics in shared representations. Addressing these vulnerabilities requires going beyond correlation-based representations. Causality explicitly models cause–effect relationships rather than statistical associations, enabling models to distinguish task-relevant structure from spurious correlations [ 26 ] . Recent research in causality in medical AI shows that causal representations improve robustness, reduce bias, and support trustworthy clinical decision-making [ 3 ] . Causality-driven models- C-CAM [ 6 ] , CauSSL [ 24 ] , and MACAW [ 35 ] demonstrate that modelling cause-effect structure yields stronger generalization under distribution shifts. Causal diffusion models— CausalDiffAE [ 17 ] , Diff-structural causal model (SCM) [ 28 ] , and latent-causal DDPMs [ 36 ] indicate that combining causality and diffusion disentangles semantic factors, suppresses spurious correlations, and enables fine-grained control. However, these ideas have not been explored in multi-task SplitFed. To address these gaps, we propose MuCALD-SplitFed, a causal, diffusion-driven multi-task SplitFed framework for privacy-preserving medical image segmentation. The contributions are: integrating causal modelling within the SplitFed latent space for multi-task segmentation in heterogeneous clinical settings; combining causal representations with latent diffusion and adversarial denoising to improve robustness and reduce information leakage at split points; disentangling task-relevant causal factors from domain-specific information to enhance segmentation performance and privacy; and extensive evaluation on five heterogeneous medical datasets over Baseline SplitFed and state-of-the-art multi-task and personalized FL methods. Section 2 introduces the MuCALD-SplitFed methodology, Section 3 presents experiments and SoTA comparisons, and Section 4 concludes the paper. 2 Proposed MuCALD-SplitFed Our Baseline SplitFed architecture, [ 30 , 29 ] , based on [ 33 ] (Fig. 1 ), partitions a model into front-end (FE), server-side (SS), and back-end (BE) components. Clients receive copies of the global FE and BE models from the federated server and the SS model from the main server. Each client then trains locally for several epochs, after which parameters are aggregated via federated averaging [ 23 ] and redistributed. This process repeats for multiple rounds until convergence. Proposed MuCALD-SplitFed framework (left side of Fig. 2 ) consists of three stages: (1) proxy-label construction and causal graph discovery, (2) causal representation and diffusion module (CRDM), and (3) domain-adversarial causal alignment (DACA). Each stage improves robustness, reduces leakage, or mitigates domain shift, respectively, without added cross-client dependencies. Figure 1: Baseline SplitFed where all clients collaborate on a single shared task (blastocysts segmentation). Figure 2: Left: Proposed MuCALD SplitFed (CS-FE to SS split point). Right: Causal relationships discovered using Notears-MLP [ 37 ] for Neural SCM modeling. A symmetric configuration operates at the SS to CS-BE split point. 2.1 Proxy-label construction and causal graph discovery First, domain-specific morphological and intensity features are extracted from the five datasets as proxy labels for weakly supervised causal learning. • Blastocyst [ 20 ] : zona pellucida thickness variation (ZPTV), ZP area, blastocoel (BL) area, blastocyst diameter, BL symmetry, inner cell mass (ICM) area/ solidity/ compactness/ entropy/ brightness, trophectoderm (TE) area/brightness/granularity, embryo expansion grade, bubble count/area, and ZP sharpness. • FHPsAOPMSB [ 21 ] : fetal head size, perimeter, major/ minor axes, circularity, solidity, intensity statistics, bounding-box dimensions, symphysis features, head–symphysis geometric relations, and vertical alignment. • HAM10K [ 34 ] , MosMed [ 25 ] , and Kvasir-SEG [ 15 ] : lesion size, perimeter, compactness, bounding-box size, orientation, solidity, asymmetry, intensity statistics, RGB/ HSV statistics, colour variance, and entropy. Dataset-specific causal graphs are then learned from these proxy features using Notears-MLP [ 37 ] . Three strongest causal relations per dataset are selected (right side of Fig. 2 ). 2.2 Causal Representation and Diffusion Module (CRDM) The CRDM block consists of the exogenous encoder, neural SCM, and the denoising LDDM, followed by a forward diffusion step. First the CS-FE model produces feature maps z_{fe} , which the exogenous encoder maps to low-dimensional exogenous variables u=z_{exo}=f_{exo}(z_{fe}) . Second, the Neural-SCM learns a causal factorization that produces causally structured latents ( z_{causal}=f_{SCM}{u} ). Third, forward diffusion is applied to the encoder features ( z_{fe\_noisy}=forward\_diffusion(z_{fe}) ), to obfuscate transmitted activations. Next, a causal diffusion decoder (LDDM-1) denoises the noisy latents z_{fe\_noisy} conditioned on the causal latents z_{causal} , generating z_{denoised} , which will be sent to the server-side. These causally structured, diffusion-noised latents expose less reconstructive information than standard SplitFed activations, reducing reconstruction and membership inference risks. 2.3 Domain-Adversarial Causal Alignment (DACA) The server-side DACA block enforces domain invariance and suppresses task-specific biases in the received latents. It comprises a gradient reversal layer (GRL) [ 10 ] , which inverts