BrainGuard : Privacy-Preserving Multisubject Image Reconstructions from Brain Activities

Zhibo Tian, Ruijie Quan, Fan Ma, Kun Zhan, Yi Yang · 2025

Read BrainGuard : Privacy-Preserving Multisubject Image Reconstructions from Brain Activities by Zhibo Tian, Ruijie Quan, Fan Ma, Kun Zhan, Yi Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14309.txt.

Introduction

Zhibo Tian and co-authors present BrainGuard, a 2025 system for rebuilding images from brain activity while guarding privacy. Brain computer interfaces can now reconstruct what a person saw from their brain scans. Early tools trained a separate model per person and missed shared patterns. Multi person tools pooled raw brain data, which raises privacy risks for very sensitive records.

BrainGuard trains in a split way. Each person's model stays on their own data. A shared global model learns the common patterns across people. A sync strategy lets local models borrow from the global one as they train, without any raw scans leaving their home. Tests set new marks on both high level and low level quality scores. The authors present the design as proof that privacy and accuracy can advance together in brain decoding.

Catalog record

CREATORZhibo Tian, Ruijie Quan, Fan Ma, Kun Zhan, Yi Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-14309

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BrainGuard : Privacy-Preserving Multisubject Image Reconstructions from Brain Activities Zhibo Tian, Ruijie Quan, Fan Ma, Kun Zhan, Yi Yang Abstract Reconstructing perceived images from human brain activity forms a crucial link between human and machine learning through Brain-Computer Interfaces. Early methods primarily focused on training separate models for each individual to account for individual variability in brain activity, overlooking valuable cross-subject commonalities. Recent advancements have explored multisubject methods, but these approaches face significant challenges, particularly in data privacy and effectively managing individual variability. To overcome these challenges, we introduce BrainGuard , a privacy-preserving collaborative training framework designed to enhance image reconstruction from multisubject fMRI data while safeguarding individual privacy. BrainGuard employs a collaborative global-local architecture where individual models are trained on each subject’s local data and operate in conjunction with a shared global model that captures and leverages cross-subject patterns. This architecture eliminates the need to aggregate fMRI data across subjects, thereby ensuring privacy preservation. To tackle the complexity of fMRI data, BrainGuard integrates a hybrid synchronization strategy, enabling individual models to dynamically incorporate parameters from the global model. By establishing a secure and collaborative training environment, BrainGuard not only protects sensitive brain data but also improves the image reconstructions accuracy. Extensive experiments demonstrate that BrainGuard sets a new benchmark in both high-level and low-level metrics, advancing the state-of-the-art in brain decoding through its innovative design. 1 Introduction Deciphering brain activities and recovering encoded information represents a fundamental objective in the field of cognitive neuroscience ( Chen et al. 2023 ; Bullmore and Sporns 2009 ; Parthasarathy et al. 2017 ; Beliy et al. 2019 ) . Functional Magnetic Resonance Imaging (fMRI) data ( Kwong et al. 1992 ) is commonly used to recover visual information and plays a crucial role in delineating brain activity by observing fluctuations in blood oxygenation level. Initially, methods for interpreting brain activity from fMRI mainly involved image classification ( Kamitani and Tong 2005 ; Cox and Savoy 2003 ) . With the integration of deep generative models, the focus has shifted towards more sophisticated fMRI-to-Image (f2I) reconstruction approaches ( Shen et al. 2019 ; Beliy et al. 2019 ) . However, the inherent variability in fMRI across individuals presents significant challenges, as individuals exhibit unique brain activation patterns in response to the same visual stimulus ( Chen et al. 2023 ) . Figure 1: (a) Early subject-specific methods require separate training for each individual using their respective fMRI, overlooking intersubject commonalities. (b) Recent multisubject methods that combine all subjects’ fMRI for training pose substantial privacy concerns. (c) BrainGuard captures intersubject commonalities while preserving data privacy. Earlier f2I reconstruction methods employed a subject-specific approach, where distinct models are developed for each individual’s fMRI to address the significant variance in brain activity across different subjects (Fig. 1 (a)) ( Lin, Sprague, and Singh 2022 ; Scotti et al. 2023 ; Gu et al. 2023 ; Chen et al. 2023 ; Takagi and Nishimoto 2023 ) . However, this approach is inherently limited by its focus on individual differences, which results in the neglect of valuable insights that could be obtained from commonalities across multisubject fMRI. Recent advancements increasingly focus on multisubject or cross-subject methods (Fig. 1 (b)) ( Quan et al. 2024 ; Scotti et al. 2024 ; Wang et al. 2024 ) , which aims to train a unified model capable of reconstructing images from the fMRI of multiple individuals. These methods incorporate simple subject-specific layers, such as ridge regression, to project fMRI of different subjects into a common embedding space, thus accounting for individual differences while training on combined dataset. However, two primary challenges remain. First , exiting multisubject methods that combine all subjects’ fMRI for training poses substantial privacy concerns. Brain data is highly personal and confidential, and aggregating it without robust privacy protections is problematic, especially considering that the data often originates from multiple organizations. Second , the subject-specific layers employed in these methods are inadequate for fully addressing the complex differences in fMRI among individuals. As illustrated in Fig. 2 (a), the embedding output from the subject-specific layers in MindBridge ( Wang et al. 2024 ) fails to effectively map the fMRI to a common embedding space. These simplistic mappings struggle to capture the distinctive neural patterns of each subject, thus limiting the model’s ability to generalize effectively across diverse data. Figure 2: (a) t-SNE visualization of the embeddings output from the subject-specific layers in MindBridge ( Wang et al. 2024 ) . (b) represents ones from BrainGuard models. Both are visualized upon the NSD ( Allen et al. 2022 ) test set. In response to these challenges, we introduce BrainGuard , the first privacy-preserving collaborative training framework designed for multisubject f2I reconstruction (Fig. 1 (c)). BrainGuard adopts a global-local model, consisting of individual models for each subject and a global model that captures and leverages shared patterns across subjects. During the training phase, the global model integrates the updated parameters from each individual model, which are independently trained on their respective subject’s fMRI, and then the individual models dynamically synchronize the merged parameters from the global. This design promotes a distributed and collaborative learning mechanism that balances personalization with generalization, thereby enhancing reconstruction quality while maintaining data privacy. Furthermore, unlike typical image and text, fMRI reflects complex neural activity and is typically preprocessed into a 1D vector of high-dimensional voxels. This complexity renders standard data processing methods less effective. To address this, we introduce a hybrid synchronization strategy in BrainGuard , specifically designed to meet the unique challenges of fMRI. This strategy synchronizes different parts of the model layers in a hybrid manner, effectively capturing both the distinct neural activity of individual subjects and the shared patterns across subjects by leveraging the specialized capabilities of different model layers. Specifically, it consists of three parts: ❶ retention for foundational layers, ❷ global alignment for intermediate layers, and ❸ adaptive tuning for advanced layers. The foundational layers retain the subject-specific features inherent in fMRI, preserving the individual variability that is crucial for accurate modeling. Then, the intermediate layers are synchronized with the global model to integrate shared insights, which helps generalize across different subjects. Finally, the advanced layers are adaptively tuned using a Dynamic Fusion Learner (DFL) module, which selectively incorporates global model parameters into the individual models. This hybrid strategy is specifically designed to balance individual uniqueness and commonalities, thereby enhancing the model’s generalization ability across diverse subjects while safeguarding the privacy of sensitive data. BrainGuard enjoys several attractive qualities: First, BrainGuard adeptly balances individual uniqueness and commonalities across subjects, enhancing the model’s generalization capabilities (Fig. 2 (b)) while preserving the specificity of individual subject data. Second, the hybrid synchronization strategy within BrainGuard ensures that individual models dynamically incorporate broader dataset patterns, thereby improving the precision and personalization of image reconstructions. Third, BrainGuard ensures the privacy and security of sensitive fMRI by facilitating a collaborative learning framework, allowing for collaborative training without the need for direct data sharing, thus upholding stringent data confidentiality standards. In summary, our contributions are threefold: • To the best of our knowledge, this is the first method to propose a privacy-preserving approach for reconstructing images from fMRI. We introduce BrainGuard , a framework that captures both

Read the complete text