TractoRC: A Unified Probabilistic Learning Framework for Joint Tractography Registration and Clustering
Yijie Li, Xi Zhu, Junyi Wang, Ye Wu, Lauren J. O’Donnell, Fan Zhang (✉) · 2026
Read TractoRC: A Unified Probabilistic Learning Framework for Joint Tractography Registration and Clustering by Yijie Li, Xi Zhu, Junyi Wang, Ye Wu, Lauren J. O’Donnell, Fan Zhang (✉) (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10418.txt.
Introduction
Yijie Li and co-authors present TractoRC, a single system that aligns brain tract scans and groups their streamlines together, two jobs usually done apart. Both jobs seek the same white matter structure, so the team let them share one learned space for streamline points. In that space, alignment uses learned landmark points, while grouping forms bundles from shared patterns. A self-supervised trick keeps the learned features aware of shape even when scans are moved or turned. Doing both jobs together beat leading separate methods on each task.
Catalog record
| CREATOR | Yijie Li, Xi Zhu, Junyi Wang, Ye Wu, Lauren J. O’Donnell, Fan Zhang (✉) |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20140 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.10418
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TractoRC: A Unified Probabilistic Learning Framework for Joint Tractography Registration and Clustering Yijie Li, Xi Zhu, Junyi Wang, Ye Wu, Lauren J. O’Donnell, Fan Zhang (✉) Abstract Diffusion MRI tractography enables in vivo reconstruction of white matter (WM) pathways. Two key tasks in tractography analysis include: 1) tractogram registration that aligns streamlines across individuals, and 2) streamline clustering that groups streamlines into compact fiber bundles. Although both tasks share the goal of capturing geometrically similar structures to characterize consistent WM organization, they are typically performed independently. In this work, we propose TractoRC , a unified probabilistic framework that jointly performs tractogram registration and streamline clustering within a single optimization scheme, enabling the two tasks to leverage complementary information. TractoRC learns a latent embedding space for streamline points, which serves as a shared representation for both tasks. Within this space, both tasks are formulated as probabilistic inference over structural representations: registration learns the distribution of anatomical landmarks as probabilistic keypoints to align tractograms across subjects, and clustering learns streamline structural prototypes that capture geometric similarity to form coherent streamline clusters. To support effective learning of this shared space, we introduce a transformation-equivariant self-supervised strategy to learn geometry-aware and transformation-invariant embeddings. Experiments demonstrate that jointly optimizing registration and clustering significantly improves performance in both tasks over state-of-the-art methods that treat them independently. Code will be made publicly available at https://github.com/yishengpoxiao/TractoRC . 1 Introduction Diffusion MRI (dMRI) tractography enables in vivo reconstruction of white matter (WM) pathways and serves as a fundamental tool for studying brain structural connectivity [ 2 , 31 ] . In tractography analysis, there are two important computational tasks: 1) tractogram registration , which aligns anatomical fiber tract structures across subjects, and 2) streamline clustering , which groups streamlines into anatomically meaningful fiber bundles [ 26 ] . One common feature of the two tasks is to capture common geometrically similar streamline structures to characterize consistent WM organization. Currently, these tasks are typically performed independently, while the joint analysis to leverage complementary information of the two tasks is lacking. Tractogram registration methods include volume-based and streamline-based approaches. Volume-based methods align diffusion-derived images, such as fractional anisotropy (FA), using conventional image registration frameworks, but often fail to preserve fine-grained streamline geometry [ 12 , 28 ] . Streamline-based methods instead directly optimize geometric distances between streamlines, typically requiring iterative correspondence estimation [ 8 , 15 ] . Recent keypoint-based methods improve robustness but remain limited in capturing globally consistent anatomical alignment across subjects [ 21 ] . In parallel, streamline clustering methods aim to group streamlines into coherent bundles based on geometric similarity. Classical approaches rely on pairwise similarity computation in the original space, leading to high computational cost and limited scalability [ 7 , 16 ] . More recent learning-based methods perform clustering in latent spaces to improve efficiency and robustness [ 3 ] . However, they do not explicitly incorporate cross-subject alignment, resulting in potentially inconsistent cluster assignments. Recent advances in point cloud registration offer an alternative by modeling geometric structures as distributions over representative components [ 5 , 11 ] . Instead of enforcing explicit point-to-point correspondences, these approaches represent each point cloud using a set of latent components defined by centers and membership weights, and perform registration via distribution matching. By modeling structures at the distributional level, these methods enable robust alignment under structural heterogeneity. Building on this insight, we propose TractoRC , a unified probabilistic framework that jointly performs tractogram registration and streamline clustering within a single optimization scheme. By coupling the two tasks, the framework enables clustering-guided alignment and registration-refined clustering, allowing them to mutually reinforce each other. Unlike prior approaches that treat these tasks independently, our method unifies them within a shared representation space. Our contributions are threefold: 1) a unified probabilistic formulation for joint registration and clustering; 2) a transformation-equivariant self-supervised pretraining strategy for learning geometry-aware and transformation-invariant embeddings; and 3) a joint optimization scheme that enables mutual reinforcement between registration and clustering. 2 Method Fig. 1 illustrates the TractoRC framework for joint tractogram registration and streamline clustering. First, a tractogram embedding network maps each streamline point to a latent feature space. These embeddings are then fed into two parallel subnetworks for registration and clustering. In the registration branch, a keypoint prediction module extracts representative streamline keypoints capturing shared anatomical landmarks across subjects, followed by a thin-plate spline (TPS) transformation [ 17 , 32 ] to align the input tractogram to the target. In the clustering branch, the point embeddings are aggregated into streamline-level embeddings and fed into a Deep Convolutional Embedded Clustering (DCEC) model [ 3 , 9 ] to cluster streamlines into anatomically meaningful bundles. To ensure robust initialization, we perform self-supervised pretraining of the streamline embedding network that learns geometry-aware and transformation-invariant representations, enabling discriminative modeling of streamline structures. The pretrained weights are then used to initialize the full network, after which the registration and clustering subnetworks are jointly optimized, enabling mutual reinforcement between the clustering and registration tasks. Figure 1: Overview of the proposed TractoRC framework. 2.1 Network Architecture Tractogram Embedding Subnetwork. The tractogram embedding subnetwork computes point-wise embeddings for each streamline point. In our work, tractograms are represented as point clouds, where each streamline consists of a sequence of 3D points. To capture the contextual information provided by the neighborhood relationships among points, we adopt the Dynamic Graph Convolutional Neural Network (DGCNN) model [ 3 , 22 ] . Specifically, the model takes the point spatial coordinates as input. For a streamline with N_{p} sampled points, a k -nearest neighbor graph is dynamically constructed and processed by EdgeConv layers to capture local geometric structures. The outputs are point-wise embeddings h_{ik} for the k -th point of the i -th streamline. Tractogram Registration Subnetwork. The registration subnetwork first estimates a set of keypoints from the computed point-wise embeddings for the input tractogram and a target tractogram randomly selected from the training dataset. To do so, we model keypoints as expectations over a learned spatial distribution [ 20 , 21 ] , with the a -th keypoint defined as p_{a}=\sum_{i}{\pi_{ia}x_{i}} , where x_{i} denotes the i -th point and \pi_{ia} is the probability of assigning x_{i} to keypoint a , predicted by a learnable classifier (1D convolutions). This constrains keypoints to lie within the input support, avoids unstable coordinate regression, and provides compact structural components for distributional alignment across subjects. Then, the predicted keypoints serve as control points for registration between the source and target tractograms. Correspondence is implicitly established by the shared keypoint prediction module via consistent keypoint ordering, and a TPS transformation is estimated in closed form [ 17 , 32 ] : R(x)=Ax+U(x)W, (1) where x denotes a spatial point in the source tractogram, A models the global affine transformation, W captures local deformation, and U(x)=x^{2}\ln{x} encodes the non-linear relationships between x and the control keypoints. The warped source and target tractograms are then used for registration loss computation (see Section 2.2 ). Streamline Clustering Subnetwork. The clustering subnetwork first computes streamline-level embeddings z_{i} by aggregating point-wise embeddings along each streamline via symmetric pooling. These streamline embeddings are then fed into a DCEC model for clustering [ 3 , 9 ] . With learnable centroids \mu_{j}