MambaNetLK: Enhancing Colonoscopy Point Cloud Registration with Mamba

Linzhe Jiang, Jiayuan Huang, Sophia Bano, Matthew J. Clarkson, Zhehua Mao, Mobarak I. Hoque · 2025

Read MambaNetLK: Enhancing Colonoscopy Point Cloud Registration with Mamba by Linzhe Jiang, Jiayuan Huang, Sophia Bano, Matthew J. Clarkson, Zhehua Mao, Mobarak I. Hoque (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00260.txt.

Introduction

Linzhe Jiang and five colleagues present C3VDReg, a benchmark for matching views inside the colon during colonoscopy. Doctors need to know where a live camera view sits on a stable 3D map, but colon walls look alike, folds repeat, views are partial, and depth data is noisy. The benchmark builds matched point cloud pairs from a colonoscopy video dataset and CT scans.

More than ten thousand viewpoint-matched pairs are included, with a held-out test set and a fixed scoring protocol. Surprisingly, high overlap between views does not yield reliable matching with current methods. The main failure is sliding along the tube-like anatomy, a translation error. Stronger use of anatomy and context, the authors argue, is the way forward.

Catalog record

CREATORLinzhe Jiang, Jiayuan Huang, Sophia Bano, Matthew J. Clarkson, Zhehua Mao, Mobarak I. Hoque
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00260

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MambaNetLK: Enhancing Colonoscopy Point Cloud Registration with Mamba Linzhe Jiang, Jiayuan Huang, Sophia Bano, Matthew J. Clarkson, Zhehua Mao, Mobarak I. Hoque Abstract Purpose: Accurate 3D point cloud registration underpins reliable image-guided colonoscopy, directly affecting lesion localization, margin assessment, and navigation safety. However, biological tissue exhibits repetitive textures and locally homogeneous geometry that cause feature degeneracy, while substantial domain shifts between pre-operative anatomy and intra-operative observations further degrade alignment stability. To address these clinically critical challenges, we introduce a novel 3D registration method tailored for endoscopic navigation and a high-quality, clinically grounded dataset to support rigorous and reproducible benchmarking. Methods: We introduce C3VD-Raycasting-10k, a large-scale benchmark dataset with 10,014 geometrically aligned point cloud pairs derived from clinical CT data. We propose MambaNetLK, a novel correspondence-free registration framework, which enhances the PointNetLK architecture by integrating a Mamba State Space Model (SSM) as a cross-modal feature extractor. As a result, the proposed framework efficiently captures long-range dependencies with linear-time complexity. The alignment is achieved iteratively using the Lucas-Kanade algorithm. Results: On the clinical dataset, C3VD-Raycasting-10k, MambaNetLK achieves the best performance compared with the state-of-the-art methods, reducing median rotation error by 56.04% and RMSE translation error by 26.19% over the second-best method. The model also demonstrates strong generalization on ModelNet40 and superior robustness to initial pose perturbations. Conclusion: MambaNetLK provides a robust foundation for 3D registration in surgical navigation. The combination of a globally expressive SSM-based feature extractor and a large-scale clinical dataset enables more accurate and reliable guidance systems in minimally invasive procedures like colonoscopy. 1 Introduction Image-guided surgery (IGS) leverages medical imaging and spatial tracking to provide anatomy-referenced navigation and decision support, integrating preoperative, intraoperative, and/or live multimodal data across diverse surgical workflows Linte et al. 2016 . In colonoscopy, aligning preoperative CT models with real-time endoscopic data enables precise localization of pathological tissues and improves diagnostic accuracy Bobrow et al. 2023 . However, this requires addressing a difficult technical challenge: performing real-time, cross-modal registration of partial, noisy intraoperative point clouds to dense, complete preoperative 3D models. Existing registration methods face critical limitations in this setting. Correspondence-based approaches (e.g., GeoTransformer Qin et al. 2022 ) suffer from feature degeneracy on smooth, textureless organ surfaces and cross-modal domain shift. Correspondence-free methods (e.g., PointNetLK Aoki et al. 2019 ) avoid explicit matching but rely on MLP-based feature extractors with local receptive fields that struggle to capture long-range geometric dependencies and complex anatomical topology. While Transformer architectures Vaswani et al. 2017 can capture long-range dependencies through self-attention, they remain limited in surgical applications. Additionally, progress has been impeded by the lack of suitable benchmarks for 3D alignment. Existing datasets like SimCol3D Rau et al. 2024 focus on reconstruction tasks without registration ground truth, while others emphasize 2D analysis Zia et al. 2025 , making robust evaluation nearly impossible Yang et al. 2024 . To address these challenges, we propose MambaNetLK , a correspondence-free framework that integrates Mamba Gu and Dao 2023 , a State Space Model (SSM), into the Lucas–Kanade alignment pipeline. By treating point clouds as sequences, MambaNetLK captures global geometric structure efficiently. We also introduce C3VD-Raycasting-10k , a benchmark dataset comprising 10,014 geometrically aligned point-cloud pairs derived from clinical data Bobrow et al. 2023 . Using physics-based ray casting, we generate partial target point clouds from complete CT meshes that precisely match intraoperative viewpoints, enabling standardized evaluation of partial-to-partial alignment algorithms. The key contributions of this work are as follows: • We propose MambaNetLK , a novel correspondence-free registration framework that couples a Mamba SSM point-cloud encoder with an IC-LK alignment module for superior long-range dependency modeling and discriminative shape learning. • We introduce C3VD-Raycasting-10k , a clinically grounded benchmark with 10,014 viewpoint-matched point-cloud pairs generated from clinical CT and endoscopy data, providing ground truth for cross-modal registration evaluation. • We conduct comprehensive evaluation demonstrating state-of-the-art results on C3VD-Raycasting-10k, competitive generalization on ModelNet40, and superior robustness to large initial rotations. 2 Methodology 2.1 Problem Formulation In this work, we focus on an IGS setting in which intraoperative navigation is achieved by registering a 3D reconstruction obtained during the procedure to a preoperative volumetric scan (e.g., CT or MRI), a common paradigm in many IGS systems. We assume that the intraoperatively reconstructed point cloud serves as the source , while the point cloud extracted from preoperative data serves as the target . Formally, let the source point cloud be P_{S}=\{p_{i}\}_{i=1}^{N_{S}}\subset\mathbb{R}^{3} and the target point cloud be P_{T}=\{q_{j}\}_{j=1}^{N_{T}}\subset\mathbb{R}^{3} . Our goal is to estimate G=\{R,t\}\in SE(3) that aligns P_{S} to P_{T} : G=\arg\min_{G\in\mathrm{SE}(3)}d\big(G(P_{S}),\,P_{T}\big) (1) where d(\cdot,\cdot) is an alignment objective realized in our case by minimizing a feature residual inside an inverse-compositional Lucas–Kanade (IC-LK) loop. 2.2 Framework Overview Inspired by PointNetLK Aoki et al. 2019 , we propose MambaNetLK, a correspondence-free iterative registration framework. As illustrated in Fig. 1 , the architecture features a shared-weight MambaNet Feature Extractor encoding source ( P_{S} ) and target ( P_{T} ) point clouds into global feature vectors \phi(P_{S}) and \phi(P_{T}) . An Iterative Alignment Module then employs the Lucas-Kanade (LK) algorithm to iteratively solve for a rigid transformation G minimizing the difference between these feature vectors, repeatedly computing an incremental transformation \Delta G based on the feature residual until convergence. Without explicit point-wise matches, our method aligns point clouds by minimizing the discrepancy between global structure descriptors extracted by a deep neural network. Figure 1: An overview of the MambaNetLK framework. The blue arrow indicates a one-time pre-computation: the Jacobian Solver uses the target’s feature vector \phi(P_{T}) to generate the Jacobian J . The brown arrows depict the iterative loop: the Transformations Calculator uses the feature residual between \phi(P_{T}) and \phi(P_{S}) and the pre-computed Jacobian J to solve for an incremental transformation, which repeatedly updates the source point cloud’s pose until convergence. 2.3 MambaNet Feature Extractor To overcome the limited capacity of MLP-based extractors, we design MambaNet using the Mamba State Space Model Gu and Dao 2023 ; Liang et al. 2024 , which effectively models relationships across the entire point cloud for superior shape understanding. The MambaNet workflow (Fig. 1 ) is as follows: 1. Input Serialization and Positional Encoding : We project the unordered point set P\in\mathbb{R}^{N\times 3} into a higher-dimensional feature space X\in\mathbb{R}^{N\times D_{\text{model}}} using a linear layer, then add learnable absolute positional encoding E_{\text{pos}}\in\mathbb{R}^{M\times D_{\text{model}}} (where M is the maximum number of points) for positional awareness. 2. Mamba Encoding : The position-aware feature sequence is processed by a stack of Mamba blocks. Each block employs a structured SSM with input-dependent state transitions, selectively propagating or forgetting information to capture global shape characteristics critical for complex anatomical structures. 3. Global Feature Aggregation : The encoder output passes through two MLP layers for feature fusion. Max-pooling then produces a single K -dimensional global descriptor \phi(P) , encapsulating rich shape information. 2.4 Iterative Alignment with Lucas-Kanade The inverse compositional Lucas-Kanade (IC-LK) algorithm Aoki et al. 2019 is adopted for alignment. We calculate Jacobian and transformations in feature space (see Fig. 1 ), iteratively minimizing the residual between global feature vectors of source and target clouds. At each iteration, it solves a linear least-squares problem to find the optimal transformation increment \Delta\xi : \Delta\xi=\arg\min_{\Delta\xi}\|\phi(P_{S})-\phi(P_{T})-J\Delta\xi\|_{2}^{2}, (2) where J is the Jacobian of the feature extractor \phi with respect

Read the complete text