BrainMAP: Learning Multiple Activation Pathways in Brain Networks
Song Wang, Zhenyu Lei, Zhen Tan, Jiaqi Ding, Xinyu Zhao, Yushun Dong, Guorong Wu, Tianlong Chen, Chen Chen, Aiying Zhang, Jundong Li · 2024
Read BrainMAP: Learning Multiple Activation Pathways in Brain Networks by Song Wang, Zhenyu Lei, Zhen Tan, Jiaqi Ding, Xinyu Zhao, Yushun Dong, Guorong Wu, Tianlong Chen, Chen Chen, Aiying Zhang, Jundong Li (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-17404.txt.
Introduction
Song Wang and ten co-authors present a framework for reading brain activity as pathways, not just connections, in a 2024 paper. Brain scans called fMRI show which regions rise and fall together, and graph neural networks are a popular way to model them. But real tasks light up chains of regions in sequence, and standard graph methods miss such long-range paths. Their framework, BrainMAP, reorders regions into sequences so sequential models can spot the chains.
A mixture-of-experts module then learns from several pathways at once. Across their experiments, the framework beat earlier approaches at the tasks tested. It also supports explanation: analysts can see which regions mattered most for a task. The authors release their code and argue that pathway thinking brings brain network models closer to how the brain actually works.
Catalog record
| CREATOR | Song Wang, Zhenyu Lei, Zhen Tan, Jiaqi Ding, Xinyu Zhao, Yushun Dong, Guorong Wu, Tianlong Chen, Chen Chen, Aiying Zhang, Jundong Li |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-17404
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BrainMAP: Learning Multiple Activation Pathways in Brain Networks Song Wang, Zhenyu Lei, Zhen Tan, Jiaqi Ding, Xinyu Zhao, Yushun Dong, Guorong Wu, Tianlong Chen, Chen Chen, Aiying Zhang, Jundong Li Abstract Functional Magnetic Resonance Image (fMRI) is commonly employed to study human brain activity, since it offers insight into the relationship between functional fluctuations and human behavior. To enhance analysis and comprehension of brain activity, Graph Neural Networks (GNNs) have been widely applied to the analysis of functional connectivities (FC) derived from fMRI data, due to their ability to capture the synergistic interactions among brain regions. However, in the human brain, performing complex tasks typically involves the activation of certain pathways , which could be represented as paths across graphs. As such, conventional GNNs struggle to learn from these pathways due to the long-range dependencies of multiple pathways. To address these challenges, we introduce a novel framework BrainMAP to learn M ultiple A ctivation P athways in Brain networks. BrainMAP leverages sequential models to identify long-range correlations among sequentialized brain regions and incorporates an aggregation module based on Mixture of Experts (MoE) to learn from multiple pathways. Our comprehensive experiments highlight BrainMAP’s superior performance. Furthermore, our framework enables explanatory analyses of crucial brain regions involved in tasks. Our code is provided at https://github.com/LzyFischer/BrainMAP. 1 University of Virginia, 2 Arizona State University, 3 University of North Carolina at Chapel Hill, 4 Florida State University {sw3wv, vjd5zr, zrh6du, xsa5db, jundong}@virginia.edu, [email protected], {jiaqid, xinyuzh, tianlong}@cs.unc.edu, [email protected], [email protected] 1 Introduction Recently, significant research has focused on learning complex patterns in brain activities, which has promoted tasks such as cognitive process decoding ( Li and Fan 2019 ; Thomas, Ré, and Poldrack 2022 ; Finn, Poldrack, and Shine 2023 ) and the diagnosis of mental health disorders ( Jo, Nho, and Saykin 2019 ; Eslami et al. 2019 ) . Generally, brain activities could be represented as functional magnetic resonance imaging (fMRI) data ( Fox and Raichle 2007 ; Zhang, Ji, and Liu 2024 ) , which measures blood-oxygen-level-dependent (BOLD) responses and reflects changes in metabolic demand associated with neural activity ( Kohoutová et al. 2020 ; Davis et al. 2020 ) . By leveraging fMRI’s unique blend of spatial and temporal characteristics, researchers can delve into the complexities of cognitive processes in the human brain ( Bassett and Sporns 2017 ) . More specifically, BOLD signals are commonly used to construct networks of brain regions from fMRI data, where the functional connectivities (FC) among distinct brain regions are associated with various normal and pathological states ( Kawahara et al. 2017 ) , as shown in Fig. 1 . Studying the FC features that correspond to the different brain states enables the identification of specific behavioral traits and neurological disorders linked to particular FC patterns ( Morris et al. 2019 ) . Figure 1: An illustration of the transition from fMRI data to FC graphs, along with two challenges for learning from pathways in FC graphs: (1) The sequential dependency, a fundamental feature of human brain activity, is not naturally presented in FC graphs; (2) Multiple pathways exist in FC graphs, making the extraction of them more difficult. To extract patterns in FC features, they are generally modeled as FC graphs, where nodes represent brain Regions of Interest (ROIs), and edges represent their relationships ( Cui et al. 2022b ; Cui et al. 2022a ) . In this way, the correlations among brain regions could be explicitly represented ( Said et al. 2023 ) . With the development of Graph Machine Learning (GML) techniques, Graph Neural Networks (GNNs) are widely applied to FC graphs ( Wang et al. 2022 ; Zhou et al. 2020 ) . By capitalizing on the structured nature of the FC graphs and integrating local information, GNNs facilitate learning from patterns in functional connectivities and informative features ( Li et al. 2021 ) . While FC graphs offer valuable connectivity insights by depicting correlations among brain regions, existing works often overlook the activation pathways that are inherently present in these graphs. Specifically, in the human brain, performing tasks typically involves the activation of certain pathways ( Sporns 2011 ) , which could be represented as paths across the FC graphs ( Sankar et al. 2018 ) , as shown in Fig. 1 . These pathways indicate the transmission of neural signals to a particular brain region. By incorporating these pathways into analysis, we could capture the complex interactions that might be overlooked when only considering pairwise correlations. Furthermore, these pathways provide insights into how different brain regions segregate into functional modules and collaborate to perform complex tasks. However, despite the benefits of considering activation pathways on FC graphs, learning from these pathways is challenging. Since they are not explicitly represented in the graphs, without ground truth, models struggle to accurately learn and interpret them. Generally, pathways exhibit two crucial properties as shown in Fig. 1 : (1) Sequential dependency is a fundamental feature of brain networks, where multiple regions co-activate and interact over long distances ( Dahan et al. 2021 ) . For example, in emotional memory processing, the hippocampus encodes memories, the amygdala assesses their emotional significance, and the prefrontal cortex uses this information for decision-making, exemplifying the long-range dependencies across multiple brain regions ( Said et al. 2023 ) . Nevertheless, while capturing these sequential dependencies is crucial for understanding the information flow in the brain, the structural nature of FC graphs makes it challenging to effectively model such dependencies. (2) Multiple pathways are generally necessary for the brain to process different behaviors and perform complex tasks. For example, in visual processing, the brain utilizes two parallel pathways: one along the dorsal visual cortex, which handles fast but coarse information, and the “what” stream along the ventral visual cortex, which processes slower but more detailed information ( Lee et al. 2016 ) . These distinct pathways correspond to different aspects of visual stimuli, emphasizing the need for multiple pathways in visual processing. Nevertheless, it is especially challenging to capture multiple pathways with existing GNN architectures. Due to the inherent limitations of the message-passing mechanism ( Kipf and Welling 2017 ; Veličković et al. 2018 ; Tan et al. 2022b ) , which focuses on aggregating information from neighboring nodes, GNNs struggle to effectively model the complex, long-range interactions in multiple pathways ( Kim, Ye, and Kim 2021 ) . Moreover, the interpretability of functional connectivity patterns is underexplored in current GNN-based approaches. Existing interpretable GNN models ( Ying et al. 2019 ; Luo et al. 2020 ) , which are typically designed to explain the importance of individual nodes and edges rather than considering their relationships within an activation path, struggle to provide explanations for interactions in long-range paths. In this work, we propose BrainMAP to effectively learn from and interpret M ultiple A ctivation P athways present in FC (functional connectivities) graphs while tackling the challenges posed by long-range dependencies and pathway correlations. To achieve this: (1) We propose an Adaptive Graph Sequentialization module to transform each FC graph into a node sequence that reflects the order of information flow, which enables the extraction of the hidden pathways that are crucial for modeling long-range interactions. (2) We design