Hierarchical Mesh Transformers with Topology-Guided Pretraining for Morphometric Analysis of Brain Structures
Yujian Xiong, Mohammad Farazi, Yanxi Chen, Wenhui Zhu, Xuanzhao Dong, Natasha Lepore, Yi Su, Raza Mushtaq, Stephen Foldes, Andrew Yang, Yalin Wang · 2026
Read Hierarchical Mesh Transformers with Topology-Guided Pretraining for Morphometric Analysis of Brain Structures by Yujian Xiong, Mohammad Farazi, Yanxi Chen, Wenhui Zhu, Xuanzhao Dong, Natasha Lepore, Yi Su, Raza Mushtaq, Stephen Foldes, Andrew Yang, Yalin Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05215.txt.
Introduction
Xiong and 10 colleagues give a net tool for analysis that runs on tree splits built from shapes. The design handles volume and surface grids in one build, giving focus without tweaks. A mapping module maps tags into the tree, splitting shape from feature size. Training via masked rebuild of points and channels on raw cohorts yields a shared encoder for tasks and types. On dementia tests and amyloid guessing with ADNI meshes, and flaw spotting on MELD meshes, it hits the best results.
Catalog record
| CREATOR | Yujian Xiong, Mohammad Farazi, Yanxi Chen, Wenhui Zhu, Xuanzhao Dong, Natasha Lepore, Yi Su, Raza Mushtaq, Stephen Foldes, Andrew Yang, Yalin Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21572 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05215
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hierarchical Mesh Transformers with Topology-Guided Pretraining for Morphometric Analysis of Brain Structures Yujian Xiong, Mohammad Farazi, Yanxi Chen, Wenhui Zhu, Xuanzhao Dong, Natasha Lepore, Yi Su, Raza Mushtaq, Stephen Foldes, Andrew Yang, Yalin Wang Abstract Representation learning on large-scale unstructured volumetric and surface meshes poses significant challenges in neuroimaging, especially when models must incorporate diverse vertex-level morphometric descriptors—such as cortical thickness, curvature, sulcal depth, and myelin content—that carry subtle disease-related signals. Current approaches either ignore these clinically informative features or support only a single mesh topology, restricting their use across imaging pipelines. We introduce a hierarchical transformer framework designed for heterogeneous mesh analysis that operates on spatially adaptive tree partitions constructed from simplicial complexes of arbitrary order. This design accommodates both volumetric and surface discretizations within a single architecture, enabling efficient multi-scale attention without topology-specific modifications. A feature projection module maps variable-length per-vertex clinical descriptors into the spatial hierarchy, separating geometric structure from feature dimensionality and allowing seamless integration of different neuroimaging feature sets. Self-supervised pretraining via masked reconstruction of both coordinates and morphometric channels on large unlabeled cohorts yields a transferable encoder backbone applicable to diverse downstream tasks and mesh modalities. We validate our approach on Alzheimer’s disease classification and amyloid burden prediction using volumetric brain meshes from ADNI, as well as focal cortical dysplasia detection on cortical surface meshes from the MELD dataset, achieving state-of-the-art results across all benchmarks. Keywords Hierarchical spatial indexing ⋅ \cdot Attention-based mesh learning ⋅ \cdot Neuroimaging ⋅ \cdot Self-supervised pretraining ⋅ \cdot Morphometric analysis 1 Introduction Learning from 3D medical meshes is a fundamental challenge in neuroimaging analysis. Structural MRI has become prominent for its non-invasive nature, high resolution, and suitability for longitudinal studies, playing a critical role in detecting fine-grained deformations such as cortical thinning or volumetric atrophy 26 . Crucially, clinical pipelines routinely produce rich per-vertex morphometric signals including cortical thickness, curvature, sulcal depth, and myelin content, which carry critical diagnostic information for conditions such as Alzheimer’s disease (AD) and focal cortical dysplasia (FCD). Traditionally, MRI data are processed as voxel grids which have fixed resolution and are inherently limited in modeling intricate anatomical geometry 9 , while unstructured meshes (tetrahedral/triangular) offer a topologically coherent and expressive alternative for both surface and interior anatomy. Yet existing frameworks are largely restricted to a single mesh type and operate on raw coordinates, ignoring the morphometric features that clinicians rely upon in practice. 1.1 Related Work Voxel and Graph-based Networks extend 2D CNNs into 3D by discretizing space into regular grids 20 ; 37 , but suffer from cubic computational cost. Sparse variants restrict computation to non-empty voxels via octrees 32 ; 27 or hash tables 3 , and recent works further introduce windowed transformers over sparse voxels 31 ; 25 . For irregular meshes, GNNs have become a natural choice 9 ; 10 ; 22 , yet most encode neighborhoods as topological graphs while overlooking underlying geometry, are limited to surface meshes 17 , and none incorporate the per-vertex morphometric signals that are clinically important. Point-based Transformers offer strong global modeling 40 ; 36 but face quadratic complexity on large meshes 2 . Windowed attention 19 ; 8 reduces cost but assumes regular density, causing information loss under spatially varying mesh structures 8 . OctFormer 33 achieves near-linear complexity via adaptive octree windows, yet targets generic point clouds without heterogeneous mesh or morphometric feature support. Autoencoders emerge as a powerful self-supervised pretraining paradigm, first demonstrated on images by MAE 13 and SimMIM 38 . This has been extended to 3D domains: Point-MAE 24 pioneers masked modeling on point clouds with an asymmetric transformer, and Point-M2AE 39 introduces multi-scale masking for hierarchical geometry learning. MAE principles have further been applied to LiDAR 21 , NeRF 14 , and spatio-temporal data 34 . However, none of these works address pretraining on heterogeneous medical meshes with morphometric features, nor exploit shared mesh topology across subjects to amortize structural construction cost: leaving a clear gap for clinical neuroimaging. We present OctEncoder , a unified octree transformer pretraining pipeline that addresses these gaps. Our key contributions are: • Multiple simplex-aware octrees construction which supports both tetrahedral and triangular meshes via octree-guided depthwise convolution. • A geometry-morphometry fusion module enabling flexible per-vertex clinical feature integration without architectural changes. • A MAE pretraining pipeline for general medical meshes, capturing both geometry features and vertex morphometry for any downstream tasks. 2 Methods 2.1 Simplex-Aware Octree Construction As shown in Fig. 1 , OctEncoder supports both tetrahedral and triangular meshes, with a flexible choice of representative points that can be adapted to dataset requirements. Formally, given a mesh \mathcal{M}=(\mathcal{V},\mathcal{S}) where \mathcal{V} is the vertex set and \mathcal{S} the set of simplices, we define a representative point function c:\mathcal{M}\rightarrow\{\mathbb{R}^{3}\} that produces a set of spatially localized points from the mesh. For complex meshes, our pipeline can construct multiple complementary octrees. For example, the first uses tetrahedron centroids to capture volumetric interior geometry, while the second uses mesh vertices directly: c_{1}(\mathcal{M})=\left\{\frac{1}{4}\sum_{v_{i}\in t}v_{i},\ t\in\mathcal{S}\right\},\quad c_{2}(\mathcal{M})=\left\{v_{i},\ v_{i}\in\mathcal{V}\right\},\quad\dots\quad,\ c_{K}(\mathcal{M}) The octree \mathcal{O}_{k} is constructed by inserting all representative points x\in c_{k}(\mathcal{M}) up to a user-defined depth d , and nodes are ordered along a 3D Z-order space-filling curve for memory-contiguous window partitioning and efficient parallel construction 41 . More generally, octrees can be constructed from any choice of simplex (vertex, edges/faces/tetrahedron center, etc.), and a learned weighted linear fusion strategy \mathcal{F}(\mathcal{O}_{1},\dots,\mathcal{O}_{K}) merges outputs across branches. The specific choice of simplex and number of octrees is a design decision driven by the dataset and task; our configuration reflects the setting used in our experiments. Conditional Positional Encoding (CPE) 4 is applied independently within each octree branch before fusion, allowing each branch to develop spatially aware embeddings prior interaction. Figure 1: Overview of the framework on MAE (step-1) and downstream (step-2). 2.2 Auxiliary Clinical Feature Embedding Beyond constructing octrees from spatial coordinates alone, each vertex v_{i}\in\mathcal{V} may carry a set of F auxiliary feature channels derived from neuroimaging or geometry-morphometry pipelines, such as cortical thickness, curvature, etc. Given a per-vertex feature vector \mathbf{f}_{i}\in\mathbb{R}^{F} , any combination of per-vertex attributes can be incorporated, and the number of channels F is flexible. To embed such morphometric information into the octree representation, we augment each representative point x\in c_{k}(\mathcal{M}) by projecting the concatenation of its spatial coordinate and feature vector through a learnable linear layer: x^{\prime}=W\begin{bmatrix}x\\ \mathbf{f}_{i}\end{bmatrix}+\mathbf{b} where x^{\prime}\in\mathbb{R}^{3+F} is the resulting enriched embedding. This allows OctEncoder to accommodate varying neuroimaging features without architectural changes. 2.3 Octree Attention, MAE Pretraining and Downstream Transformer attention is computed within local windows defined by the octree’s Z-order partitioning, keeping attention complexity near-linear in the number of nodes. Dilated attention complements local windows by sampling tokens at a fixed stride across the octree, enlarging the receptive field without additional memory cost. Each transformer block follows a standard residual design with layer normalization and a feedforward MLP 33 . For pretraining on large unlabeled brain surfaces, we adopt a masked autoencoder strategy tailored to octree-structured data. A fixed proportion of octree tokens are masked, and the encoder processes only the visible subset to produce latent representations. A lightweight transformer decoder then reconstructs the masked tokens \hat{x}^{\prime}=[\hat{x},\mathbf{\hat{f}}] , supervised by a hybrid loss combining both Chamfer Distance over